Hi @Michele DuBose ,
"Read without Client Integration" Do you mean you unchecked Use Client Integration Features?
Please check the test user permissions and make sure you granted the right custom permission level.
Per my test, i can remove Export To Spreadsheet option by unchecking Use Client Integration Features in permission level.
For Reference: User permissions and permission levels in SharePoint Server
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.