As a workaround, I used the regular chat and asked Copilot if it was familiar with the information in the notebook. (Prompt I used: Are you familiar with the data in the [name of notebook] notebook?)
With Copilot acknowledging the files that were in that notebook, I then asked my questions in that chat. But agreed - this isn't how it should work.