Azure AI studio how to create space between inline citation

Question

Azure AI studio how to create space between inline citation

Junheok Cheon 120

Hello, I am currently trying to modify the AI through Azure AI studio.

My goal is to make it so that there is space between inline citation.

My current approach is to create python code block that finds certain pattern and inserts space between.

User's image

The code looks like above, and the flow graph looks like this:

User's image

Problem arises when testing this feature.
When tested inside the prompt flow screen (using chat functionality),
Sometimes it doesn't work:

User's image

Sometimes it works:
User's image

After deploying the flow into the endpoint, it always does not work.

Reason why I want to make a space between the citation is because when we output AI's prompt to the user's interface, we change inline citation into the hyperlink that leads to the doc's page. Due to this reason, when there are many citations in a row, links look like they are single piece.

What is the proper way to achieve this?

Thanks,

Junheok

romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2024-10-15T10:50:51.5+00:00

@Junheok Cheon Are you using citations in your input before passing them to the Azure OpenAI endpoint or are you trying to add a space to the response from your endpoint where there are more than one citation? Since you are generating reply after adding space I had this doubt.
Junheok Cheon 120 Reputation points

2024-10-15T11:05:20.04+00:00

@romungi-MSFT
I want to make it so that when endpoint gives a reply, inline citations are separated with a space. I thought if I create a space between and then create reply off of it, space would still remain, but I guess it wasn't the case. I tried to have python code after the reply generation block, so I can just take the reply and add the space, but I couldn't redirect the output of the reply generation to the python code (it would simultaneously output to both final output and the python code block).
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2024-10-15T14:49:21.8666667+00:00

Thanks for clarification @Junheok Cheon

Do you think using activate config can be used to run the python code only after the node that generates the response has an output?
Junheok Cheon 120 Reputation points

2024-10-16T08:38:56.97+00:00
I was able to achieve what I want by:

Make final output to be linked with python code block instead of reply generation block.

Reply generation block outputs to the python code block.

However, despite being able to achieve this, there was a unexpected behaviour of Microsoft logic app automatically removing comma between inline citation for some reason, so I ended up implementing this in logic app side (using js code block).
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2024-10-17T06:12:51.2333333+00:00

Thanks @Junheok Cheon for the update. I will go ahead and post your solution as an answer if some one needs similar behavior. Thanks!!

Accepted answer

0 additional answers

Your answer

romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2024-10-15T10:50:51.5+00:00

@Junheok Cheon Are you using citations in your input before passing them to the Azure OpenAI endpoint or are you trying to add a space to the response from your endpoint where there are more than one citation? Since you are generating reply after adding space I had this doubt.
Junheok Cheon 120 Reputation points

2024-10-15T11:05:20.04+00:00

@romungi-MSFT
I want to make it so that when endpoint gives a reply, inline citations are separated with a space. I thought if I create a space between and then create reply off of it, space would still remain, but I guess it wasn't the case. I tried to have python code after the reply generation block, so I can just take the reply and add the space, but I couldn't redirect the output of the reply generation to the python code (it would simultaneously output to both final output and the python code block).
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2024-10-15T14:49:21.8666667+00:00

Thanks for clarification @Junheok Cheon

Do you think using activate config can be used to run the python code only after the node that generates the response has an output?
Junheok Cheon 120 Reputation points

2024-10-16T08:38:56.97+00:00

I was able to achieve what I want by:

Make final output to be linked with python code block instead of reply generation block.

Reply generation block outputs to the python code block.

However, despite being able to achieve this, there was a unexpected behaviour of Microsoft logic app automatically removing comma between inline citation for some reason, so I ended up implementing this in logic app side (using js code block).
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2024-10-17T06:12:51.2333333+00:00

Thanks @Junheok Cheon for the update. I will go ahead and post your solution as an answer if some one needs similar behavior. Thanks!!

Answer 1

As posted by OP as a resolution:

Make final output to be linked with python code block instead of reply generation block.
Reply generation block outputs to the python code block.

However, despite being able to achieve this, there was a unexpected behaviour of Microsoft logic app automatically removing comma between inline citation for some reason, so they ended up implementing this in logic app side (using js code block).

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Share via

Azure AI studio how to create space between inline citation

0 additional answers

Your answer