A family of Microsoft spreadsheet software with tools for analyzing, charting, and communicating data
Dear [bc]_OM,
Good day! Thank you for posting to Microsoft Community. We are happy to help you.
As per your description, please don’t worry, we can work together to narrow down and resolve the situation.
Based on my test result, it seems that I cannot meet the same behavior as lie you desired above. I open Excel file in Excel desktop client app(from SharePoint online document library) and I also tested in Excel online and it work normal(cell reference).
Here is my test screenshot for your reference:
Excel desktop client app result:
Excel for web(online) result:
Here is my "'Paste Special" dialog box setting: