Summary

Completed

In this module, you learned:

• Understand when to fine-tune a model.
• Explore different fine-tuning techniques including supervised fine-tuning, reinforcement fine-tuning, and direct preference optimization.
• Prepare your data to fine-tune a chat completion model, including generating synthetic data.
• Fine-tune a base model in the Microsoft Foundry portal.

Learn more

• Customize a model with fine-tuning
• Fine-tune models using standard deployments in Microsoft Foundry
• Reinforcement fine-tuning in Microsoft Foundry
• Direct preference optimization in Microsoft Foundry
• Generate synthetic data for fine-tuning
• Microsoft Foundry Discord
• Microsoft Foundry Developer Forum