Service inside AKS wants to consume data from ML online endpoints

Ravichandran, Gopi Krishna 161 Reputation points
2023-09-19T12:57:59.0666667+00:00

Hi,

I have a use case where I wanted to consume real-time scoring data from an ML online endpoint. We have a service hosted in the AKS cluster and this service wanted to consume data on a real-time basis from the AML online endpoint.

Do we have any references for this kind of use case it would be great if you could share that information.

Regards,

Gopi

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,846 questions
Azure Kubernetes Service (AKS)
Azure Kubernetes Service (AKS)
An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.
2,073 questions
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 44,771 Reputation points Microsoft Employee
    2023-09-20T10:02:07.7766667+00:00

    Ravichandran, Gopi Krishna You can use REST API of the online deployment to consume it, if your networking is setup to access the endpoint you should be able to consume it. See here for REST API deployment and consumption of the endpoint.

    curl --location --request POST $scoringUri \
    --header "Authorization: Bearer $accessToken" \
    --header "Content-Type: application/json" \
    --data-raw @endpoints/online/model-1/sample-request.json
    
    

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.