Hi varun - thanks for your question. The short answer is yes App Service supports this for Linux (please note it's currently a preview feature) and there's a "getting started" tutorial here that demonstrates the concept. See here.
Did you check spin up the docker compose file locally to check the correct ports are open etc etc?