Primary Key As a file Name

Question

I am fetching data from CRM system and trying to put in blob storage using Azure Data factory - copy activity.
I wanted to store each record in separate file with primary key as file name...
Any Suggestion please?

Answer 1

Hello @Harvail Singh ,

Thanks for the question and using MS Q&A platform.

As lookup activity support Dynamics CRM, you can leverage it to make a lookup of your primary keys and have a subsequent ForEach activity to loop through the list of primary keys (each item in the loop == each Primary Key from CRM ), then inside For Each you can have a copy activity point to your source CRM and sink Azure Storage and in the source use a query to get the record for that particular primary key of that iteration and in the sink settings use that @concat(item.PrimaryKeyValue, '.csv') as file name while saving the data in your storage. (Please note you will be using @item.PrimaryKeyValue both in the source query and in the sink file name settings)

Reference doc: Use the Lookup activity result

Note: Below are current known limitations and possible workaround with lookup activity:

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Answer 2

@KranthiPakala-MSFT Thanks For replying.There is lot of valuable information.
I am able to use @item.PrimaryKeyValue in source of the copy activity..but this option is not available in sink.
My CRM System is Salesforce, so in source I am using Salesforce connection, it is working as you describes but in sink, I am not able parametrised file name using Foreach activity current item.