It is not a matter of Windows File Explorer versus Word, Excel, etc. The insert key's status does not apply to a particular program; it applies to all of Windows.
The insert key is a toggle. It's toggles between insert mode and overwrite mode. Whatever mode it's currently in, press it and it will switch to the other.