Hello @Bmutluoglu ,
Thanks for reaching out.
Ideally this must work, just tested with my environment. Could you please confirm error that non-working user getting? if possible could you please check the behavior when non-working user try login to device directly rather than remote? also it's worth to try out configuration detailed here for remote scenario.
Hope this helps.