Hi @Shuvajit Roy ,
Great to know that and thanks for sharing the update here.
By the way, since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others.". and according to the scenario introduced here: Answering your own questions on Microsoft Q&A, I would make a brief summary of this thread:
Facing an Issue with SharePoint User Profile Service Provisioning through power shell. The provisioning takes lot of time and does not accomplish in the end.
The issue has been solved.The reason for this is that the UPSA(User Profile Service) application was not in compliant state that is the reason the state was in starting state.
You could click the "Accept Answer" button for this summary to close this thread, and this can make it easier for other community members to see the useful information when reading this thread.
Thanks for your understanding!