Here is an example to let me clarify a bit more about what is a Limited Access permission.
There is a common list. User A does not have permission for this list. But we need user A to check a specific item inside the list. So, we share the specific item with user A. In this way, user A now can view the specific item and still have no access to other items in this list. To make it happen, SharePoint automatically grant user A with the Limited Access permission.
The Limited Access permission represents user A has permission for the specific item and has limited access to other items in this list. Item's unique permission determines that Limited Access permission will be generated.
In conclusion, every time a file or page is shared with users, the Limited Access permission is automatically granted to users by SharePoint. Exactly, there is no need to remove the Limited Access permission.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.