Share via

Generating scoring.py for azure ml model deployment

Yuzu 26 Reputation points
2022-01-18T09:50:10.857+00:00

Hi,
I have registered a pretrained model to azure ml and i wish to deploy the model.
There is a compulsory file attachment called scoring file that i need to attach in order to deploy my model.
May i know how do i generate this scoring.py file?
Thanks in advance

Azure Machine Learning

3 answers

Sort by: Most helpful
  1. Houston Muzamhindo 0 Reputation points
    2023-07-20T09:52:30.97+00:00

    I am very interested to know how to do this for a real time deployment of a large language model like GPT4All. I have the binary file and registered the model but don't how to deploy / create the endpoint. Is the scoring file the same as a Machine Learning .pkl file?

    Was this answer helpful?

    0 comments No comments

  2. Andrew 1 Reputation point
    2022-10-26T04:53:39.51+00:00

    See this link:
    https://learn.microsoft.com/en-us/azure/machine-learning/how-to-deploy-managed-online-endpoints?tabs=azure-cli#understand-the-scoring-script

    See this other thread as well:
    https://learn.microsoft.com/en-us/answers/questions/713048/azure-ml-how-should-my-score-script-look-like-to-d.html

    In my case, using Automated ML, I was able to download the scoring script by clicking on the model (yolov5 in my case) then clicking download
    @I am Beginner

    Was this answer helpful?

    0 comments No comments

  3. YutongTie-9091 54,021 Reputation points Moderator
    2022-01-18T17:38:53.153+00:00

    @Yuzu

    Hello,

    Thanks for reaching out to us. Please follow below documentation to define your entry script after you registered your model.

    https://learn.microsoft.com/en-us/azure/machine-learning/how-to-deploy-and-where?tabs=azcli#define-a-dummy-entry-script

    Please start with define a dummy entry and do the steps after.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

    Was this answer helpful?


Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.