Firstly, remove any unwanted keyboard layouts.
Make your preferred keyboard is set as default.
Settings > Accounts > Sync your settings > Turn off "Language preferences"
Right-click on the taskbar > Taskbar Settings > Enable Show language bar.
This will help to switch over keyboards.