Hi,
Have a look at this article which explains how to set the permissions on GPO, which will control which GPO are applied. While this refers to computers, the same is true for users as well.
As for limitation, you can add users, computers, or groups to the permissions. It's better to add groups rather than individual users or computers to the permissions, as it limits the number of entries and simplifies the management as groups tend not to be deleted.
Gary.