Finetuning Llama-2-7B

Question

Finetuning Llama-2-7B

Ganesh Saravanan 0

Hi, I needed to know if it is possible to finetune Llama-2 7B model, through azure model catalog. And the finetune (for llama-2-chat) mentions text classification, but i want to finetune for a different purpose, is this possible?

AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2023-09-11T14:57:37.36+00:00

Ganesh Saravanan Did you get a chance to see my response?

Do let me know if that helps or have any further queries.
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2023-09-19T14:17:26.6366667+00:00

Ganesh Saravanan

Just checking if we are still connected on this discussion? Please let us know if you need further help.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further queries do let us know.

1 answer

Your answer

AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2023-09-11T14:57:37.36+00:00

Ganesh Saravanan Did you get a chance to see my response?

Do let me know if that helps or have any further queries.
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2023-09-19T14:17:26.6366667+00:00

Ganesh Saravanan

Just checking if we are still connected on this discussion? Please let us know if you need further help.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further queries do let us know.

Answer 1

AshokPeddakotla-MSFT 35,971 Moderator

Ganesh Saravanan Greetings & Welcome to Microsoft Q&A forum!

I needed to know if it is possible to finetune Llama-2 7B model, through azure model catalog.

To answer your query, yes it is possible. Please see Fine-tuning and evaluating Llama 2 models incase if you haven't checked earlier.

Also, see similar query here which has been addressed recently.

i want to finetune for a different purpose, is this possible?

Can you add more details what exactly are you referring here when you say different purpose?

Rahul Vasa 0 Reputation points

2024-01-19T07:31:45.06+00:00

I am looking to finetune Llama2 for Question and Answer. I found sample data set for Text Generation and Text Classification, but I did not find anything for "Question and Answer"

Share via

Finetuning Llama-2-7B

1 answer

Your answer