As you've mentioned is about how to leverage serverless options for your Qlik Sense data source, given that you're already using MySQL Flexible Server as the main production database for the application. Additionally, you mentioned that you cannot have a standalone serverless database because the application depends on the Flexible Server as its production database.
For this here is a clearer explanation:
To take advantage of serverless options while still using MySQL Flexible Server as the production database, with the goal of optimizing costs and scaling infrastructure without disrupting your production environment, you can implement a hybrid architecture. This will involve incorporating serverless features in areas that don't affect your critical transactional workloads but help reduce costs and scale your system as needed.
Replicate Data to Serverless Databases for Read-Heavy Workloads
Flexible Server for Production:
- Your MySQL Flexible Server will remain your primary production database that handles transactional operations, ensuring the stability and performance of your core application.
Serverless Database for Reporting/Analytics:
- For workloads that are more read-heavy and do not require real-time data from the production database, you can replicate data to a serverless database. This will allow you to scale based on demand and optimize costs.
This is How you can Implement:
Data Replication:
- Set up replication from your Flexible Server to a serverless database (such as Azure SQL Database Serverless, or a MySQL-compatible serverless option). Use MySQL's native replication or managed services (like Azure Database Migration Service) to sync data from your production environment to the serverless database. HELPS:
- Your production MySQL Flexible Server remains isolated, while the serverless database handles the read-heavy, analytical, or reporting queries. The serverless database scales based on the amount of compute required for queries, ensuring cost efficiency during periods of low demand.
- Use Qlik Sense with Serverless Database: Connect Qlik Sense to the serverless database to run analytical queries and generate reports. This avoids overloading the production MySQL Flexible Server with reporting queries while providing the flexibility to scale during peak reporting times.
Benefits:
- Cost Optimization: You pay only for the compute resources used by the serverless database, helping you reduce costs during periods of low demand.
- Scalability: The serverless database can automatically scale resources based on demand, ensuring it can handle heavy reporting or query workloads when needed without having to provision fixed resources.
- Optimize costs by scaling resources only when needed (e.g., using serverless databases that scale automatically).
- Ensure stability and performance for your production database by isolating it from read-heavy or heavy computation tasks.
- Scale infrastructure efficiently with serverless features without the need to provision dedicated servers for each workload.
- This strategy balances the flexibility and cost benefits of serverless computing with the stability and control of your Flexible Server for critical production data.
I hope this information helps you find a more cost-effective solution for your Qlik Sense setup use serverless option for flexible server. Please do let us know if you have any further queries.