Hi FlorisKleijne,
Thank you for reaching Microsoft Community.
Please run these steps first on your Surface Pro 4 to make sure that the device is up to date then test if the issue persist:
1: Run Surface Diagnostic Toolkit and check Windows Update
2: Update drivers and firmware
Check what is the current OS Build of your Windows version by going to Settings > System > About.
Go to Download driver and firmware for Surface, choose Surface Pro 4 then click Download on the next page.
Choose the .msi file that matches your current OS Build and click Next.
After downloading, run and install the .msi then Restart.
3: Run System File Checker Tool in Windows 10
If in case the issue persist, please check what is the current Driver version of the following drivers installed on the device. Double-click the driver then go to its Driver tab to see the Driver version:
Under Human Interface devices
**Intel Precise Touch**
**HID-compliant touchscreen**
Under Firmware
**Surface Touch**