Seems the setting from Win10 is no longer available :(
(thank you microsoft)
Current workaround:
Set the display scale to one where the icons are smaller (in my case I went from 125% to 100%) and then go to accessibility settings > text size and change the text size (I set it to 125%). Some apps are iffy with this but it works for now. Posting since I didn't see this elsewhere.