The settings dialog for the mouse is useless for this problem.
Try the Control Panel > Mouse dialog. Exactly how it looks depends on your mouse driver. The mouse driver may take over.
I don't see a way of controlling the specific feature you mention. If you have a "wheel" tab, try changing the Vertical Scrolling amount (larger and smaller) .
Notice that the last tab on my screen capture is the (Microsoft) Mouse and Keyboard Center. That is a separate dialog associated with MS branded Mice and Keyboards. It may have options to control this (I don't have a MS mouse so I can't say).
PS: I noted that my MS Mouse and Keyboard Center was several versions out of date. Apparently it is not included in Windows updates ... <sigh>