Hello @Chris !
Welcome to Microsoft QnA!
It is quite strange , but it could have an explanation
Can you find anything in the Activity Logs of the SQL ?
What SQL DB Tier are you using ? Is it Serverless ? It is strange but maybe the pause due to inactivity switch , triggers the behavior ? I dont find it logical.....
Please inspect the Activity Logs !
Anyway the Best Practice instructs the use of Private Link
Private Link
Private Link allows you to connect to a server via a private endpoint. A private endpoint is a private IP address within a specific virtual network and Subnet.
If your endusers are also coming via Azure Subscriptions it is quite easy to Setup the Service
https://learn.microsoft.com/en-us/azure/azure-sql/database/private-endpoint-overview?view=azuresql
I hope this helps!
Kindly mark the answer as Accepted and Upvote in case it helped!
Regards