Thank you for asking this question on the Microsoft Q&A Platform.
Static Web Apps don't have a limit on the number of users that can log in to your app (Source).
However, if you need more bandwidth, a service level agreement (SLA), or advanced features, you should consider the Standard plan. To learn more, see Hosting plans and Quotas. (Source)
Hope this helps!
Accept Answer and Upvote, if any of the above helped, this thread can help others in the community looking for remediation for similar issues.
NOTE: To answer you as quickly as possible, please mention me in your reply.