Additional SQL Server features and topics not covered by specific categories
Generally, it is said that Query Store adds an overhead of 3-4%, and this is perfectly tolerable. Not the least when you take in consideration that it can help you to improve performance by finding slow queries.
However, there are workloads where Query Store can take SQL Server over the brink. The typical case would be an application that submits a lot of short quick queries, and it is even worse if they are unparameterised. They have improved this in SQL 2019 by providing different capture more, and the default mode, AUTO, will ignore these single-use queries.
Query Store is a tremendous asset, and I think you should turn it on, and only turn if off, if you find that it causes problems.