"Failed to submit bulk run due to Flow runtime not found" in custom evaluation on Azure AI Studio.

27851973 5 Reputation points
2024-02-27T23:14:18.99+00:00

I am trying to create a built in evaluation for a prompt flow for RAG on Azure AI Studio. My data mapping is as follows: User's image

But it always fails with the following error "Failed to submit bulk run due to Flow runtime not found"

User's image

When seeing the job details, the prompt flow runs, but the evaluation flow causes error:

User's image

The runtime is also available:

User's image

The evaluation runs fine when no flows are selected, but fails otherwise.

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,838 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,894 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,771 questions
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 44,671 Reputation points Microsoft Employee
    2024-02-29T05:18:07.7666667+00:00

    @27851973 Did you try to add a prompt runtime from your compute settings and then re-run the evaluation? I found the logs under the evaluation to be helpful to understand what failed during the run. User's image

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.