Hi true181,
I'm Rodrigo and I will help you.
Usually, this sound comes from the Bluetooth device, not from Windows.
One way to disable this behavior is using changing the registry to disable the Absolute Volume feature (changing the volume on Windows changes the volume on the device too) without it, each device has its own volume controls, and the volume will not beep when changed on Windows
Follow the steps on the link below to disable the absolute volume.
https://winaero.com/enable-or-disable-bluetooth...
Standard Disclaimer: This is a non-Microsoft website. The page appears to be providing accurate, safe information. Watch out for ads on the site that may advertise products frequently classified as a PUP (Potentially Unwanted Products). Thoroughly research any product advertised on the site before you decide to download and install it.