Read sharepoint list data and convert to csv using ADF

sankon437 41 Reputation points
2024-09-23T14:39:19.3766667+00:00

Is it possible to read sharepoint list data using ADF with having 60 sites and 100+ list items and automate XML response to CSV files ?

We already did POC using databricks, its working fine, but want to know whether ADF can handle without reading/creating schema and can create CSV files like dbx.

we already know the answer, but wanted to ask here.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Microsoft 365 and Office | SharePoint | For business | Windows
{count} votes

Answer accepted by question author
  1. Nandan Hegde 36,716 Reputation points MVP Volunteer Moderator
    2024-09-24T03:39:35.4+00:00

    Based on my understanding the current SPList connector is only for SP online and not for sharepoint hosted on On Prem.

    So you would anyhow have to write your own custom logic to extract data from on Prem SPlists.

    Also Service principals are present in your Entra ID (cloud AD) and since your SPlist is hosted on On-Prem, the Service principals cannot be reveres synced into on Prem AD hence you cannot grant SP access on On-Prem SP


1 additional answer

Sort by: Most helpful
  1. hossein jalilian 13,280 Reputation points Volunteer Moderator
    2024-09-23T17:00:39.2233333+00:00

    Thanks for posting your question in the Microsoft Q&A forum.

    • ADF has a built-in SharePoint Online List connector that can read data from SharePoint lists, it supports both SharePoint Online and SharePoint Serve.
    • You can create multiple datasets, one for each SharePoint list, alternatively, use parameters in your dataset to dynamically point to different sites and lists.
    • ADF typically requires schema definition for structured data operations. however, you can use dynamic schemas in some scenarios, especially with Mapping Data Flows.

    Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful


Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.