This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 3%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EF%3C/text%3E%3C/svg%3E)
Hi Microsoft community, I am developing a chatbot and using prompt flow to iterate and build the best chatbot with my own grounded data. I use built-in evaluation option.
However today I encounter an error related to the evaluation of metrics. As you can see on the screenshot, what is Completed is the run on variant 0 and 1. What results as Failed is evaluation with the corresponding metrics such as Groundedness or GPT-Similarity.
More precisely I read: "Error Failed to submit bulk run due to Flow runtime not found."
Can you please provide some guidance?
Many thanks in advance.
@ferrand Do you think the compute instance or the run time associated with this run is stopped or deleted? As a pre-req a runtime with compute instance to run the evaluation is required.
A runtime is a compute instance with environment attached. If you don't have any runtime available, navigate to Build > AI project settings > Compute instances to create one. Since the error mentions flow runtime is not available, try creating a prompt flow runtime from AI project settings page. Thanks!!
@romungi-MSFT the compute instance and runtime are in status "Running". When I look into the prompt flow section I can also see that this runtime is selected. The automatic runtime is also active even though I did not activate it.
I didn't have this issue before. It all started the day I deleted the compute instance and runtime and created new ones.
I have noticed this error as well:
How can I proceed?
@ferrand Did you get a chance to check if the above response helped? Thanks!!
I have deployed another model, GPT4-32k and now everything seems to be ok. Many thanks for your support @romungi-MSFT
Thanks great @ferrand
I have moved my comment to answer, please feel free to accept if it helped. Thanks!!
Do you think if your Azure OpenAI deployment available under your connection is still available? I think the chosen deployment or model is unavailable causing this evaluation to fail. Thanks!!
If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.