Custom flags required with docker run, is this possible with online endpoint

Question

Custom flags required with docker run, is this possible with online endpoint

adm.t1.mowen 0

My custom Docker environment breaks unless I can provide the following flags with the docker run command: --gpus all --ipc=host --ulimit memlock=-1 --ulimit stack=67108864. This has led to me being unable to deploy endpoints either locally, or online, since presumably the docker run command is being handled in the backend by azure ml. So my question is, can I somehow include custom docker run commands on deployment, or is there a workaround which would allow me to use this environment with an endpoint deployment?

Thanks in advance, and apologies if I am asking a naïve question, I am quite new to this. I could not find anything in the documentation that seemed applicable.

Saideep Anchuri 9,500 Reputation points Moderator

2025-04-09T16:16:40.2133333+00:00

Hi adm.t1.mowen

Could you share a sample docker image to replicate the issue too.

Thank You.
adm.t1.mowen 0 Reputation points

2025-04-10T07:41:37.0466667+00:00

Hello, thanks for coming back to me on this. I would prefer not to share the Dockerfile if it can be avoided, but I don't think you need it to answer my question? Can you please let me know if I can use custom docker run flags when generating endpoints or if there is another way around this. Many thanks!
Prashanth Veeragoni 5,170 Reputation points Microsoft External Staff Moderator

2025-04-11T21:25:29.5766667+00:00

Hi adm.t1.mowen,

Following up to see if the above suggestion was helpful. And, if you have any further queries do let us know.

Thank you!
santoshkc 15,345 Reputation points Microsoft External Staff Moderator

2025-04-14T09:22:56.6033333+00:00

Hi @adm.t1.mowen,

We haven’t heard from you on the last response and was just checking back to see if the given response provided by Saideep Anchuri was helpful. In case if you have any resolution, please do share that same with the community as it can be helpful to others.

Thank you.

1 answer

Your answer

Saideep Anchuri 9,500 Reputation points Moderator

2025-04-09T16:16:40.2133333+00:00

Hi adm.t1.mowen

Could you share a sample docker image to replicate the issue too.

Thank You.
adm.t1.mowen 0 Reputation points

2025-04-10T07:41:37.0466667+00:00

Hello, thanks for coming back to me on this. I would prefer not to share the Dockerfile if it can be avoided, but I don't think you need it to answer my question? Can you please let me know if I can use custom docker run flags when generating endpoints or if there is another way around this. Many thanks!
Prashanth Veeragoni 5,170 Reputation points Microsoft External Staff Moderator

2025-04-11T21:25:29.5766667+00:00

Hi adm.t1.mowen,

Following up to see if the above suggestion was helpful. And, if you have any further queries do let us know.

Thank you!
santoshkc 15,345 Reputation points Microsoft External Staff Moderator

2025-04-14T09:22:56.6033333+00:00

Hi @adm.t1.mowen,

We haven’t heard from you on the last response and was just checking back to see if the given response provided by Saideep Anchuri was helpful. In case if you have any resolution, please do share that same with the community as it can be helpful to others.

Thank you.

Answer 1

Saideep Anchuri 9,500 Moderator

Hi adm.t1.mowen

You have to use build parameter in environment class to provide dockerfile path with the required parameters and then use this environment in the deployment of online endpoint.

Kindly refer below links: Environmentclass

Deploya model in a custom container to an online endpoint

Thank You.

Share via

Custom flags required with docker run, is this possible with online endpoint

1 answer

Your answer