Cost for Online Endpoint in Azure Machine Learning

Question

I created the online endpoint for my object detection model but i am curious about the bill. I know the endpoint is available and online at anytime and I though Azure is going to charge me based on how long the endpoint takes to complete several request. But I see some articles (https://bea.stollnitz.com/blog/aml-online-endpoint/) stated that the bill starts from the creation of endpoint, not duration to complete every request sent by us. The official does not explain much on the way they charge the endpoint, but it just encourages me to delete endpoint once it is not used. Hope anyone can clarify and share their experience on cost of online endpoint. thank you :)

Answer 1

Muhammad Harriz Azham I am not sure if you have created managed online endpoint or a kubernetes online endpoint. But, in either case the charges for the endpoint are based on the compute that is used for the endpoint. If the compute is up and running the charges will be applicable along with networking charges for the traffic that is generated when requests are made. See the note on this page for section Manged Online endpoints which explains how the charges are incurred. It is recommended to lookup costs of your endpoint through cost analysis page of your subscription. This allows you to monitor the costs regularly and moderate the usage of endpoint when it is not required.