NVIDIA supportability in azure

Question

Hello team, please guide me to integrate NVIDIA model to azure, what is the best way to use NVIDIA LLM in azure? Does azure language or azure OpenAI plan to include it also as a base model

Answer 1

@Eib Mccain

Thanks for reaching out to us, are you mentioning NVIDIA Nemotron-3 8B LLMs model?

If yes, this model in supported in Azure Machine Learning Studio Model Catalog feature as this blog - https://techcommunity.microsoft.com/t5/ai-machine-learning-blog/introducing-nvidia-nemotron-3-8b-llms-on-the-model-catalog/ba-p/3983569

NVIDIA Nemotron-3 8B Models

Nemotron-3-8B Base Model: This is a foundational model with 8 billion parameters. It enables customization, including parameter-efficient fine-tuning and continuous pre-training for domain-adapted LLMs.

Nemotron-3-8B Chat Models: These are chatbot-focused models that target LLM-powered chatbot interactions. Designed for global enterprises, these models are proficient in 53 languages and are trained in 37 different coding languages. There are three chat model versions:

Nemotron-3-8B-Chat-SFT: A building block for instruction tuning custom models, user-defined alignment, such as RLHF or SteerLM models.

Nemotron-3-8B-Chat-RLHF: Built from the SFT model and achieves the highest MT-Bench score within the 8B category for chat quality.

Nemotron-3-8B-Chat-SteerLM: Offers flexibility for customizing and training LLMs at inference, allowing users to define attributes on the fly.

Nemotron-3-8B-Question-and-Answer (QA) Model: The Nemotron-3-8B-QA model is a question-and-answer model that's been fine-tuned on a large amount of data focused on the target use case.

The Nemotron-8B models are curated by Microsoft in the ‘nvidia-ai’ Azure Machine Learning (AzureML) registry and show up on the model catalog under the NVIDIA Collection [Fig 1]. Explore the model card to learn more about the model architecture, use-cases and limitations.

![thumbnail image 1 of blog post titled

						Introducing NVIDIA Nemotron-3 8B LLMs on the Model Catalog
						
					
				
		
	

		

](/api/attachments/a5a425a6-9c1b-48bf-b4d8-9e1ba59628bc?platform=QnA)

Let me know how it works, I hope this helps.

Regards,

Yutong

-Please kindly accept the answer and 'Yes' if you feel helpful to support the community, thanks a lot.