Found the answer, if you're following the [doc][1], you would have inevitably tried to use this "server=tcp:<server-name>.database.windows.net;database=<db-name>;"
format for your connection string. Which is NOT RIGHT, for EDMX based connection string, you just need to swap our the server value and the database name in your existing connection string removing all the user id and password from it. The working connection string should look similar to below in your web.config:
"metadata=res://*/AdventureWorks.csdl|res://*/AdventureWorks.ssdl|res://*/AdventureWorks.msl;provider=System.Data.SqlClient;provider connection string="data source=yourdbserver.database.windows.net;initial catalog=yourdbtable;MultipleActiveResultSets=True;App=EntityFramework""
- NOTE: the " in the value should be substituted with actual single quote if the conn string is injected through Azure App Configuration