Azure OpenAI: DataSource & Few Shot Prompting

Question

Azure OpenAI: DataSource & Few Shot Prompting

matteo 25

Hi, I have connected my cognitive search in Azure OpenAI playground to search my own data. As a next step, I wanted to add few shot examples to add some functionality to my bot. However, this is not possible, as I receive the error message "Few shot examples are not used when source data has been added. Any previous examples have been cleared. Once data is removed, then examples can be added."

Is there a way to do it anyways or how should I proceed? Since function calling is not available in my region, how can I add functionality?

Thanks in advance.

matteo 25 Reputation points

2023-08-22T14:09:03.44+00:00

Thanks for the response! I'm using TypeScript and simply try to access Azure OpenAi via fetch, is there a different way to do it other than with Langchain?
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-08-23T08:50:27.1933333+00:00

@matteo I do not think the chat completions API with BYOD currently supports this method.
Eau 0 Reputation points

2023-08-27T18:07:18.3033333+00:00

Hey, hey, I was looking for exactly this ! Is there a way to instruct playground prompt to use your data but in the system message box, formulate a structure that indicate that there is Few Shot example in your azure data.
Dipti Agravat 0 Reputation points

2024-01-10T11:52:10.9366667+00:00

I am facing the same issue. I have created a bot using own data. I have used blobstorage as my dataset. In this case I am not able to provide few shot examples. I tried to set the example in the prompt with the role "system". I also tried uploading a new document with few shot example but it is not working that way as well! It gives the same answer "The requested information is not available in the retrieved data. Please try another query or topic."

I think there is no way to do prompt engeniaring with own data provided. We have to define a custom flow. For ex., redirect bot to CLU and get appropriate answer when we dont have any answer from OpenAi.

Please let me know if anyone has some solution for this case.
CSource 41 Reputation points

2024-04-29T15:26:59.4666667+00:00

any update to this?

Accepted answer

0 additional answers

Your answer

matteo 25 Reputation points

2023-08-22T14:09:03.44+00:00

Thanks for the response! I'm using TypeScript and simply try to access Azure OpenAi via fetch, is there a different way to do it other than with Langchain?
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-08-23T08:50:27.1933333+00:00

@matteo I do not think the chat completions API with BYOD currently supports this method.
Eau 0 Reputation points

2023-08-27T18:07:18.3033333+00:00

Hey, hey, I was looking for exactly this ! Is there a way to instruct playground prompt to use your data but in the system message box, formulate a structure that indicate that there is Few Shot example in your azure data.
Dipti Agravat 0 Reputation points

2024-01-10T11:52:10.9366667+00:00

I am facing the same issue. I have created a bot using own data. I have used blobstorage as my dataset. In this case I am not able to provide few shot examples. I tried to set the example in the prompt with the role "system". I also tried uploading a new document with few shot example but it is not working that way as well! It gives the same answer "The requested information is not available in the retrieved data. Please try another query or topic."

I think there is no way to do prompt engeniaring with own data provided. We have to define a custom flow. For ex., redirect bot to CLU and get appropriate answer when we dont have any answer from OpenAi.

Please let me know if anyone has some solution for this case.
CSource 41 Reputation points

2024-04-29T15:26:59.4666667+00:00

any update to this?

Answer 1

romungi-MSFT 48,906 Microsoft Employee Moderator

@matteo I believe you are referring to the studio screen where this message is seen when a data source is added and adding the example button is greyed out. I don't think there is a way to define this from the studio functionality with BYOD now, however I have seen a previous example from Github repo that uses Azure OpenAI endpoint along with search index and langchain where examples are defined and then queried from own data i.e the search index. Here is the link to the notebook that showcases this functionality through API. You could try to use this to define examples and using your own data? Thanks!!

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

CSource 41 Reputation points

2024-04-29T15:13:10.0733333+00:00

please update this as your link is no longer valid

Share via

Azure OpenAI: DataSource & Few Shot Prompting

0 additional answers

Your answer