Hello, thank you for reaching out to Microsoft Q&A.
Have you tried restarting the File Explorer process in Task Manager before, and see if it helps?
Open the Task Manager.
Locate Windows Explorer Process in the lists, right-click and select 'Restart'.
========================================================================
If that doesn't resolve your issue,
Open an elevated Command Prompt.
Run the commands one by one below and click Enter for each command.
Dism /Online /Cleanup-Image /RestoreHealth
sfc /scannow
Once completed, restart your computer.
============================================================================
Another method,
running the command will reset Windows components related to Start Menu and Taskbar UI.
Open a PowerShell (Administrator) window and run the command below.
Get-AppxPackage Microsoft.Windows.StartMenuExperienceHost | Reset-AppxPackage
Once completed, please restart your computer and check if the taskbar icons work without any crashes.