Service inside AKS wants to consume data from ML online endpoints

Ravichandran, Gopi Krishna 111 Reputation points
2023-09-19T12:57:59.0666667+00:00

Hi,

I have a use case where I wanted to consume real-time scoring data from an ML online endpoint. We have a service hosted in the AKS cluster and this service wanted to consume data on a real-time basis from the AML online endpoint.

Do we have any references for this kind of use case it would be great if you could share that information.

Regards,

Gopi

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,083 questions
Azure Kubernetes Service (AKS)
Azure Kubernetes Service (AKS)
An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.
1,550 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. romungi-MSFT 38,481 Reputation points Microsoft Employee
    2023-09-20T10:02:07.7766667+00:00

    Ravichandran, Gopi Krishna You can use REST API of the online deployment to consume it, if your networking is setup to access the endpoint you should be able to consume it. See here for REST API deployment and consumption of the endpoint.

    curl --location --request POST $scoringUri \
--header "Authorization: Bearer $accessToken" \
--header "Content-Type: application/json" \
--data-raw @endpoints/online/model-1/sample-request.json

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.
    0 comments