NVIDIA supportability in azure

Eib Mccain 20 Reputation points
2023-11-28T00:46:00.79+00:00

Hello team, please guide me to integrate NVIDIA model to azure, what is the best way to use NVIDIA LLM in azure? Does azure language or azure OpenAI plan to include it also as a base model

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,714 questions
0 comments No comments
{count} votes

Accepted answer
  1. YutongTie-MSFT 48,491 Reputation points
    2023-11-28T01:37:53.0866667+00:00

    @Eib Mccain

    Thanks for reaching out to us, are you mentioning NVIDIA Nemotron-3 8B LLMs model?

    If yes, this model in supported in Azure Machine Learning Studio Model Catalog feature as this blog - https://techcommunity.microsoft.com/t5/ai-machine-learning-blog/introducing-nvidia-nemotron-3-8b-llms-on-the-model-catalog/ba-p/3983569

    NVIDIA Nemotron-3 8B Models

    Nemotron-3-8B Base Model: This is a foundational model with 8 billion parameters. It enables customization, including parameter-efficient fine-tuning and continuous pre-training for domain-adapted LLMs.

    Nemotron-3-8B Chat Models: These are chatbot-focused models that target LLM-powered chatbot interactions. Designed for global enterprises, these models are proficient in 53 languages and are trained in 37 different coding languages. There are three chat model versions:

    Nemotron-3-8B-Chat-SFT: A building block for instruction tuning custom models, user-defined alignment, such as RLHF or SteerLM models.

    Nemotron-3-8B-Chat-RLHF: Built from the SFT model and achieves the highest MT-Bench score within the 8B category for chat quality.

    Nemotron-3-8B-Chat-SteerLM: Offers flexibility for customizing and training LLMs at inference, allowing users to define attributes on the fly.

    Nemotron-3-8B-Question-and-Answer (QA) Model: The Nemotron-3-8B-QA model is a question-and-answer model that's been fine-tuned on a large amount of data focused on the target use case.

    The Nemotron-8B models are curated by Microsoft in the ‘nvidia-ai’ Azure Machine Learning (AzureML) registry and show up on the model catalog under the NVIDIA Collection [Fig 1]. Explore the model card to learn more about the model architecture, use-cases and limitations.

    ![thumbnail image 1 of blog post titled

    						Introducing NVIDIA Nemotron-3 8B LLMs on the Model Catalog
    						
    					
    				
    		
    	
    
    		
    

    ](/api/attachments/a5a425a6-9c1b-48bf-b4d8-9e1ba59628bc?platform=QnA)

    Let me know how it works, I hope this helps.

    Regards,

    Yutong

    -Please kindly accept the answer and 'Yes' if you feel helpful to support the community, thanks a lot.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful