Hello @sbastiendillier-8557 and thanks for reaching out. There are several options here. If it's a one time only import the easiest is to write PowerShell script that adds a user at a time, this authenticating as a User Administrator or similar Azure AD role. A faster way is to use batching, but since this is not yet supported in the PowerShell you will have to do it in JavaScript, TypeScript or C#. Throttling will happen if Identity and access service limits are surpassed or in situations when the services are under heavy load. In any case your script should implement a retry strategy based on Best practices to handle throttling and Throttling and batching.
Let us know if you need additional assistance. If the answer was helpful, please accept it and complete the quality survey so that others can find a solution.