Fetch all list names under sharepoint online list dataset

Question

I wanted to read more than one sharepoint online url and need copy the document library folders inside it from sharepoint online to data lake. I get the list of url and parameterized the linked service to copy files using azure data factory copy activity.

The online sharepoint connector is working fine. While I am selecting the dataset under a linked service, it shows the list of file names under list name property which i need to copy. But, I can able to select only one at a time. I want to copy all file names showing, just need help if it can be parameterized through dynamic content and to move all the files in a single pipeline run.

Answer 1

Hi Aravind Chelladurai,

Thank you for posting query in Microsoft Q&A Platform.

Try to get the list using azure function or custom activity and then pass that list to ForEach activity. Inside ForEach activity, use the sharepoint online dataset. For List Name property use Enter Manually and have to dynamic content there to pass every sheet name from Foreach loop.

Hope above helps. Please let me know if any further queries.

---

Please consider hitting Accept Answer button. Accepted answers help community as well. Thank you.