How can I deploy the Huggingface model ColPali on Azure

duToit, Neil 0

I would like to deploy the ColPali model from Huggingface on Azure

I have seen that there is a collaboration between Azure and Huggingface, and over 1000 models available, however I don't see ColPali available.

I would like to know what alternative options I have to deploy ColPali, and whether it will receive direct support in Azure AI Studio?

Saideep Anchuri 160 Reputation points Microsoft Vendor

2024-10-03T21:35:48.6366667+00:00
Hi duToit, Neil,

Welcome to Microsoft Q&A Forum, Thank you for posting our query here!

Based on scenario few possible cases:

Using a specific model like ColPali from Huggingface on Azure can be a bit tricky if it is not directly available in the Azure Machine Learning model catalog. But you can use other methods to work with Alternative Deployment Options

Reporting using Azure Machine Learning: Download Model: First download the ColPali model from Huggingface to your environment. Import to Azure: Import the model to your Azure Machine Learning workstation. Create a custom environment: Define a custom environment in Azure ML that includes all the dependencies required by the ColPali model. Deploy the model: Use Azure ML to deploy the model to the online end. This involves creating a scoring script and setting up required computer resources.

Using Azure Functions: Containerize the Model: Install the ColPali model into a Docker container. Deploy to Azure Functions: Deploy containers to Azure Functions, which can process HTTP requests and serve your model.

Azure Kubernetes Service (AKS): 1.1. Contain the model: Similar to the Azure Functions method, place the model in a Docker container. Deploy to AKS: Use the Azure Kubernetes Service to manage and scale your containerized model.

Direct support in Azure AI Studio Currently, the ColPali instance may not be directly supported in Azure AI Studio. But the collaboration between Azure and Huggingface is expanding, with more models being added regularly. It’s worth keeping an eye on the Azure and Huggingface updates for any new additions.

For More information: https://learn.microsoft.com/en-us/azure/machine-learning/how-to-deploy-models-from-huggingface?view=azureml-api-2

Please let us know if you have any further queries.

Thank you.
Saideep Anchuri 160 Reputation points Microsoft Vendor

2024-10-04T14:35:47.69+00:00

Hi duToit, Neil,

Following up to see if the given response was helpful.

Thank You.
Saideep Anchuri 160 Reputation points Microsoft Vendor

2024-10-07T15:19:20.62+00:00

Hi duToit, Neil,

We haven’t heard from you on the last response and was just checking back to see if the give response was helpful.

Thank You.

1 answer

Jose Quan 0 Reputation points

2024-10-31T17:38:37.4433333+00:00

Check this Colpali in Azure implementation... it was published Oct 22, 2024.

Hope it helps...

https://techcommunity.microsoft.com/t5/ai-azure-ai-services-blog/introduction-to-ocr-free-vision-rag-using-colpali-for-complex/ba-p/4276357
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How can I deploy the Huggingface model ColPali on Azure

1 answer

Your answer