I'd increase the tier of the database, ensure you can connect and start looking into queries that are taking the most utilization, or database size, or number of connections.
So, yes it is possible it is a free plan or tier issue. consider upgrading the database sku.
https://azure.microsoft.com/en-us/pricing/details/azure-sql-database/single/
You can mark it 'Accept Answer' and 'Upvote' if this helped you
Regards,
Abiola