Is it possible to Append data from rest API in same csv file in Azure Data Lake storage from REST API

Question

I am trying to copy the data from the rest of API IBM where I am getting data in range but I am to store the data in same CSV using append or incremental approach(meant my store file remain same but data stored incrementally line first 0-99 data than 100-199 data like that) is there any way to do that.

Please suggest how to handle like that data

Answer 1

Hello @Kumari, Shweta ,
Thanks for the ask and using Microsoft Q&A platform .
To my understanding the intend is to have only CSV file . At this time the copy activity in ADF may be help you with this , but you can achive this my using mapping data flow with a copy activity .

1. Use a copy activity to have a source as REST API and sink as a csv blob .
2. Add a mapping data flow and the use UNION , The sterps are called out here .
   https://www.youtube.com/watch?v=WbDTBAyYte8

Please do let me know how it goes .
Thanks
Himanshu

-------------------------------------------------------------------------------------------------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators