I have found the cause and a solution to this over on the Foxit forms. The problem is that the Microsoft PDF Previewer keeps taking over the preview pane and the Microsoft PDF Previewer has a bug where it cannot load a preview of files containing the # symbol. I'm not sure if the Preview Handler takeover happens during Windows updates or when but its very annoying. For one of my clients, I've had to run a script via Task Scheduler when the user logs in to make sure the issue doesn't come back.
Solution:
Change the "[HKEY_CLASSES_ROOT.pdf\ShellEx{8895b1c6-b41f-4c1c-a562-0d564250836f}\Default" key from {3A84F9C2-6164-485C-A7D9-4B27F8AC009E} which is MS PDF Previewer to {1B96FAD8-1C10-416E-8027-6EFF94045F6F} which is the Foxit PDF Preview handler.
If you don't use Foxit, you should be able to find your preview handler here: HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\PreviewHandlers
Then copy the value of your preferred preview handler and use that instead.
Here is the simple .bat script I wrote to do this:
@echo off
REM Check if Microsoft PDF Previewer took over the preview pane.
for /f "tokens=3" %%a in ('reg query "HKCR.pdf\ShellEx{8895b1c6-b41f-4c1c-a562-0d564250836f}" /VE ^|findstr /ri "REG_SZ"') do if %%a=={3A84F9C2-6164-485C-A7D9-4B27F8AC009E} (goto Fix) else (exit)
:Fix
REM Check for Admin.
if not "%1"=="am_admin" (powershell start -verb runas '%0' am_admin & exit /b)
REM Fix preview pane - set it to work with Foxit Phantom PDF
REG add HKCR.pdf\ShellEx{8895b1c6-b41f-4c1c-a562-0d564250836f} /ve /d {1B96FAD8-1C10-416E-8027-6EFF94045F6F} /f
REG add HKCR.pdf\ShellEx{8895b1c6-b41f-4c1c-a562-0d564250836f} /v PrevPreviewHandler /d {1B96FAD8-1C10-416E-8027-6EFF94045F6F} /f
exit
I hope this helps.