All,
We have an elastic pool in an Azure SQL DB PaaS instance with a master database. The idea is to create multiple databases (call them Transform Dbs) on the fly/demand within the elastic pool, and import data into each of the database from several data sources with each of them with the same schema. Each of the dataset imported into the databases is self-contained and will be processed (without any locks or contention) and the processed data in each of the databases will be exported to the master database.
Can Azure Sync Data be used to synch the data from many Transform DBs into the master db? If it can be used, will Sync Agent be needed? Assuming it can be used, since the synching can happen only after the processing completes, it has to be configured to sync manually. How do I synch manually? Can someone refer me to some documentation?
After the synching is done, the Transform DBs will be dropped and the cycle will be repeated for future processing needs.
If this does not work, then we will have to look at Eternal Tables.
Thanks,
grajee