config file to read from before processing

arkiboys 9,686 Reputation points
2021-09-14T04:00:00+00:00

Hello,
At present my configuration is being read from on-prem sql server table...
Which file format is best to have instead of the on-prem sql table?
For example, I can have .csv or excel, json, etc and read through the rows of the file but would like to kow which one is best to use and place in cloud blobstorage?
Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,199 questions
0 comments No comments
{count} votes

Accepted answer
  1. Nandan Hegde 31,511 Reputation points MVP
    2021-09-14T05:12:37.643+00:00

    Hey,
    Every file type has its own advantages and disadvantages.
    The file type selection should depend on how comfortable the team is parsing those files in case of any changes or modifications etc .
    And also since you are planning to move from table to file for Config details, be sure that there are some limitations in lookup activity w.r.t the amount of records that can be retrived.


0 additional answers

Sort by: Most helpful