@Madhu Sudana Thanks for reaching out to Microsoft Q&A, apologize for any inconvenience caused on this.
App service with hybrid connection is supported for Windows and Linux apps. it is not supported for custom containers as mentioned in the documentation here.
Feel free to reach back to me if you have any further questions on this.