LLM solution in azure machine learning

Question

Hello, I want to deploy my LLM to azure. Please guide me how to do it. I am now working on azure machine learning studio but I do think it’s only for general ML model but not a solution for LLMs. Thanks.

Answer 1

@Larl Sigitov

Thanks for reaching out to us, I think you can try Prompt Flow to see if that meet your needs.

Azure Machine Learning prompt flow is a development tool designed to streamline the entire development cycle of AI applications powered by Large Language Models (LLMs). As the momentum for LLM-based AI applications continues to grow across the globe, Azure Machine Learning prompt flow provides a comprehensive solution that simplifies the process of prototyping, experimenting, iterating, and deploying your AI applications.

With Azure Machine Learning prompt flow, you'll be able to:

• Create executable flows that link LLMs, prompts, and Python tools through a visualized graph.
• Debug, share, and iterate your flows with ease through team collaboration.
• Create prompt variants and evaluate their performance through large-scale testing.
• Deploy a real-time endpoint that unlocks the full power of LLMs for your application.

If you're looking for a versatile and intuitive development tool that will streamline your LLM-based AI application development, then Azure Machine Learning prompt flow is the perfect solution for you.

But, please be aware that, this feature is now a preview feature, please see more information here -

https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/overview-what-is-prompt-flow?view=azureml-api-2

Prompt flow is currently in public preview. This preview is provided without a service-level agreement, and is not recommended for production workloads. Certain features might not be supported or might have constrained capabilities. For more information, see Supplemental Terms of Use for Microsoft Azure Previews.

I hope this helps.

Regards,

Yutong

-Please kindly accept the answer and vote 'Yes' if you feel helpful to support the community, thanks a lot.