Share via

Service inside AKS wants to consume data from ML online endpoints

Ravichandran, Gopi Krishna 161 Reputation points
2023-09-19T12:57:59.0666667+00:00

Hi,

I have a use case where I wanted to consume real-time scoring data from an ML online endpoint. We have a service hosted in the AKS cluster and this service wanted to consume data on a real-time basis from the AML online endpoint.

Do we have any references for this kind of use case it would be great if you could share that information.

Regards,

Gopi

Azure Machine Learning
Azure Kubernetes Service
Azure Kubernetes Service

An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Rohit Mungi 49,126 Reputation points Microsoft Employee Moderator
    2023-09-20T10:02:07.7766667+00:00

    Ravichandran, Gopi Krishna You can use REST API of the online deployment to consume it, if your networking is setup to access the endpoint you should be able to consume it. See here for REST API deployment and consumption of the endpoint.

    curl --location --request POST $scoringUri \
--header "Authorization: Bearer $accessToken" \
--header "Content-Type: application/json" \
--data-raw @endpoints/online/model-1/sample-request.json

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.
    0 comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.