Reading the settings in a config table

Question

I would like to have a configTable which shows the name of the servers, databases, objects to read inside the databases, etc.
The datafactory, at present reads this configTable (Which at present is in a database in an on.prem sql server), and loads the objects into the blobstorage containers appropriately...
Note that in future, the sources of the objects to read can be azure sql server, excel, etc.

Question:
This design is working fine but I would like to know if I should place the configTable as a file such as .csv inside a blobstorage container and read the config settings from there? If you think this is a better design then how is this achieved in terms of reading the settings, etc.?
I personally think the config in on-prem is simple to read and loop through as I am doing now using a copy activity...

Your thoughts please?

Thank you

Answer 1

Hi @arkiboys ,

Thank you for posting query here.

you ConfigTable data can be placed on blob as file or on SQL as Table. Both should be fine from execution point of you. But difference comes when it can comes to flexibility.

If you have your configuration data in Table will actually helps you to write queries as well on top of your table data to fetch only desired rows.

Below image shows difference between SQL dataset and Blob dataset for lookup activity.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators