@ComputerHabit Thank you for reaching out to us, As I understand you have query on all sensitivity labels are showing in the SharePoint site.
As far I am aware, I do not believe this has anything to do with label policies. If you have labels scoped for SPO you can see them there.
Let me know if you have any further questions, feel free to post back.