Hi Gail,
Thanks for the updates. The Office version should be ok. As I have tested in the same version and it works well by my side.
For the new created testing list, you can just create a new simple list of 2 or 3 items.
You mentioned that “My database is located on a department server”, so I would like to confirm: If you create a new Access database file, store it in your local PC, check whether you can link SharePoint Online list to the database file.
In the meantime, refer to Issues when you retrieve SharePoint list data in Access, there can be some cause of such issue.

Is your list too large or complex? This can describe why the issue only happens when you in "All items" view.
If so, you can try the steps in the article to change the registry to increase the time-out in Access to see if there’s any changes.
Important This section, method, or task contains steps that tell you how to modify the registry. However, serious problems might occur if you modify the registry incorrectly. Therefore, make sure that you follow these steps carefully. For added protection, back up the registry before you modify it. Then, you can restore the registry if a problem occurs. For more information about how to back up and restore the registry, click the following article number to view the article in the Microsoft Knowledge Base:
322756**- How to back up and restore the registry in Windows
Thanks,
Rena