Please do not forget to "Accept the answer" if the information provided helps you to help others in the community.
Hello @ELFIGHA, Oussama
This is not directly possible, however, I see a possible a workaround with using pipeline templates called from a different repository. Thus, giving you that sort of restriction you want to have as you can grant the user limited access to your own repository, where the source code lives, and allow them more access to the other repository (remote pipeline template repository).
If this sound like a good idea to you please read, you can read more about it here:
Here is another example levelling on remote template
This way, they can update pipeline configurations without accessing the main codebase.
I hope this helps.