Setting shm-size and ulimit in AKS

Question

Hi, I'm trying to deploy a torchserve service on my EKS cluster. The thing is it needs some specific configuration to work.

How can I set shm-size and ulimit for my deployments on AKS ? --shm-size=1g, --ulimit memlock=-1 and --ulimit stack=67108864

docker run --rm --shm-size=1g \
        --ulimit memlock=-1 \
        --ulimit stack=67108864 \
        -p8080:8080 \
        -p8081:8081 \
        -p8082:8082 \
        -p7070:7070 \
        -p7071:7071 \
        --mount type=bind,source=/path/to/model/store,target=/tmp/models <container> torchserve --model-store=/tmp/models

Thanks,

Answer 1

@KarishmaTiwari-MSFT sorry for bothering, but if there was any update on this? I'm experiencing the same issue, and only one way to overcome it is by using daemonset to modify ulimit on the node, but it seems a bit unfancy.