@Aatish Master - You may checkout the article which helps to access databases with managed identity:Tutorial: Access Azure databases with managed identity - Azure App Service | Microsoft Learn
Note: I have not tried it, but it may be possible to SQL server (have not tried application insights, log analytics)
Hope this helps. Do let us know if you have any further queries.