You don't need an HDMI splitter if you have a docking station. The splitter may only just duplicate your displays. Plug your monitors into the docking station and try. Use an adapter to go from Display port to HDMI, USB to HDMI, Thunderbolt to HDMI, USB-C to HDMI, etc. if your monitor has only HDMI in. Docking stations usually have all the ports you need.
Press Win +P to select display options.
I'm not tech savvy so I'm wondering if this has to do with the graphic or computer specs? windows 11 ?
No. I wouldn't think so.
https://www.guidingtech.com/best-docking-stations-multiple-monitors/