I've noticed the same behaviour in our RDS environment. We're running standard User Profile Disks.
If I enable the "New Outlook" for myself it downloads/installs it but then upon closing and re-opening Outlook the current/standard version reapplies.
My guess is that the new Outlook switch isn't designed to work in a multi-user/RDS environment. It works fine outside of RDS.