Azure AI Studio Evaluation Error in Microsoft Learn Module

Question

I am going thru the tutorial: Tutorial: Build and deploy a question and answer copilot with prompt flow in Azure AI Studio. I am now in the evaluation phase as shown in this link: https://learn.microsoft.com/en-us/azure/ai-studio/tutorials/deploy-copilot-ai-studio#view-the-evaluation-status-and-results

I have been getting failed results across the board:

After going through each failed status, I can see that this is the main issue:

How can I resolve this? Is there a way to increase the model's context length?

Answer 1

@Ziggy Zulueta The limits in this case cannot be increased unless you use a model that has higher limits. See the table on this page. Posting the same here for reference.

Answer 2

Hello Ziggy Zulueta

Welcome to the Microsoft Q&A and thank you for posting your questions here.

Sequel to your questions, I understand that you encountered an issue with while building and deploying a question-and-answer copilot with prompt flow in Azure AI Studio at evaluation phase, and you requested how to solve it.

The error message you're encountering indicates that the content length of your input exceeds the maximum allowed length for the model you're using in Azure AI Studio., based on your provided information.

To resolve this, you need to reduce the length of the input provided to the model.

I want to believe you're following the training but check the contents of your input lengths, that is 1. Try to provide shorter prompts or questions to the model. Instead of providing lengthy paragraphs or multiple questions at once, break them down into smaller, more concise inputs.

Secondly, if the current model you're using has strict limitations on input length, consider experimenting with other models that may have higher limits or different capabilities better suited to your use case. I assume you're using the same model suggested by the trainer, carefully check again that it's the same and your input content are not long. Otherwise, use correct version of Model or alternative.

Once you've reduced the length of the input, try running the evaluation again in Azure AI Studio to see if the issue persists. If you continue to encounter errors, review the input and make further adjustments as needed until the evaluation runs successfully.

I hope this is helpful! Do not hesitate to let me know if you have any other questions.

Please remember to "Accept Answer" if answer helped, so that others in the community facing similar issues can easily find the solution.

Best Regards,

Sina Salam