Hi Will
Open the Settings App
Go to Devices - Mouse
Set your Primary button to Left
Check to see if the issue is resolved
If not
Open Control Pane - Mouse
On the resulting dialog, click the Buttons Tab
If 'Switch Primary and Secondary Buttons' is checked, uncheck it
Save that setting