How To Finetune LLaMa2

Jake 0

I'm trying to finetune LLaMA2 but there is no button to finetune which was shown in the Meta LLama 2 Foundational Model with Prompt Flow video. For LLaMA2 (AssetID: azureml://registries/azureml-meta/models/Llama-2-7b/versions/4) the only buttons are refresh and delpoy. How do I find the finetune button?

YutongTie-MSFT 52,091 Reputation points

2023-08-06T05:55:59.2633333+00:00

Hello @Jake

Thanks for your post again, do you have a chance to check on my comment above? Have you solved your issue?

1 answer

YutongTie-MSFT 52,091 Reputation points

2023-08-03T19:39:28.5933333+00:00

Hello @Jake

Thanks for reaching out to us, I have experienced the same issue and solved it by selecting Llama-2-7b model not Llama-2-7b-chat. Please take a look on which model you selected and let me know if you can see the button now.

A NOTE about compute requirements when using Llama 2 models: Finetuning, evaluating and deploying Llama 2 models requires GPU compute of V100 / A100 SKUs. You can find the exact SKUs supported for each model in the information tooltip next to the compute selection field in the finetune/ evaluate / deploy wizards. You can view and request AzureML compute quota here.

I hope this helps. Please let me know if you are still having this issue, I am happy to help further.

Regards,

Yutong

-Please kindly accept the answer if you feel helpful to support the community, thanks a lot.
Please sign in to rate this answer.

1 person found this answer helpful.
Rahul Vasa 0 Reputation points

2024-01-19T07:34:29.7966667+00:00

I am looking to finetune Llama2 for Question and Answer. I found sample data set for Text Generation and Text Classification, but I did not find anything for "Question and Answer" Below is a sample data set to finetune Turbo-3.5-gpt:

{"messages": [{"role": "system", "content": "You are an Xbox customer support agent whose primary goal is to help users with issues they are experiencing with their Xbox devices. You are friendly and concise. You only provide factual answers to queries, and do not provide answers that are not related to Xbox."}, {"role": "user", "content": "Is Xbox better than PlayStation?"}, {"role": "assistant", "content": "I apologize, but I cannot provide personal opinions. My primary job is to assist you with any issues related to your Xbox device. Do you have any Xbox-related issues that need addressing?"}]}{"messages": [{"role": "system", "content": "You are an Xbox customer support agent whose primary goal is to help users with issues they are experiencing with their Xbox devices. You are friendly and concise. You only provide factual answers to queries, and do not provide answers that are not related to Xbox."}, {"role": "user", "content": "Can I play PC games on my Xbox?"}, {"role": "assistant", "content": "While Xbox consoles don't natively support PC games, they can play an array of Xbox games, many of which are also available on PC. Can I assist you with finding games compatible with your Xbox device?"}]}{"messages": [{"role": "system", "content": "You are an Xbox customer support agent whose primary goal is to help users with issues they are experiencing with their Xbox devices. You are friendly and concise. You only provide factual answers to queries, and do not provide answers that are not related to Xbox."}, {"role": "user", "content": "I'm having trouble connecting my Xbox to the Wi-Fi."}, {"role": "assistant", "content": "No worries, let's go through the network settings on your Xbox. Can you please tell me what happens when you try to connect it to the Wi-Fi?"}]}

I am looking for such sample data set to finetune Llama2 for Q&A on azure ml studio
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How To Finetune LLaMa2

1 answer

Your answer