Azure Machine Learning
An Azure machine learning service for building and deploying models.
Deploy Batch Endpoint in ML studio with LLama2 in different region
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 8%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anonymous
Hi All,
I want to kindly ask you, if it is possible to create the LLaMA2 model in different region.
My company created Subscription in NorthEU . recommendetation for using / finetuning / deploying etc is using A100 , V100 GPUs. I see that for NorthEU there are no available GPUs in that region. I see that for East US are available.
so my question - it is possible to deploy LLaMA2 model for different region if my subscription is for North EU and i want to use GPU from East US for example.
if yes - can you tell me how i can do that.
thank you
Jan
Azure Machine Learning
{count} votes
-
Anonymous
2023-08-11T10:51:29.75+00:00 I tried to use script for deploying batch endpoint from Model catalog. everything is fine. i created the endpoint. everything is okay. but then .... becuase I used subscription id from north eu. and there are no available gpus. when i tested the model. in test tab. i got error that i have to use GPU. or i have to change torch script and change data types to float32 etc. .................... so i forgot to mention. i created the endpoint. everything was okay. i created the endpoint via script in Model catalog in that model. but then when i tried to test the model. i am getting errors regarding available GPUs for my region. which are 0. ...
thats why i am asking if it is possible to change region. or what i can do .
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 1%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYM%3C/text%3E%3C/svg%3E)
YutongTie-MSFT 54,011 Reputation points Moderator2023-08-12T03:13:56.9366667+00:00 Hello @Anonymous
Thanks for reaching out to us, you can create a new resource in the region you want so that you can leverage the model you want to use. But if you are far from the region, you may experience some reasonable delay.
Please let me know if this helpful.
Regards,
Yutong
Sign in to comment
Sign in to answer