Hello, this is Emily.
This type of issue can be typically fixed by reinstalling the audio driver from the computer's manufacturer website.
Just to confirm, this issue happens when you use the keyboard volume keys, AND also it happens when you use the mouse to drag the slider, right?
If you need help finding driver, please type msinfo32.exe in the search on the taskbar and hit enter, then share a screenshot of the pop up please.