Share via

Query regarding microsoft phi-2 SLM model

Abhishek Bhadoriya 0 Reputation points
2023-12-04T09:37:12.5666667+00:00

Hello Microsoft community,
We are excited with recently launched model called Phi-2. The SLM performance compared to LLMs ( <10 millions parameters) is impressive. We are excited to test the model but however we couldn't find any information on finetuning it. Is it possible to fine-tune the model for specific task like categorisation? If so, How can one fine tune phi-2 model and use it for inference?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,271 questions
Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,307 questions
Azure AI Language
Azure AI Language
An Azure service that provides natural language capabilities including sentiment analysis, entity extraction, and automated question answering.
506 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Mansooreh Karami 5 Reputation points Microsoft Employee
    2024-02-23T19:30:39.6+00:00

    @romungi-MSFT I can see there is now a fine-tuning option available. I have tried to fine-tune Phi-2 on my data. However, for 160 samples, I ran it for 5 days and it was still running. I stopped the job and tried again, 2 days passed, and it is still running. Is that usually the case? How much do you think it should take? Thanks

    1 person found this answer helpful.
    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.