The sharepoint list is empty when import from Azure Data factory, but I can only see specific coloumns and import them, not the full list

Jan Boldt 11 Reputation points
2022-05-15T05:52:35.15+00:00

I have followed the guideline to import a sharepoint list using ADF:

https://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list?tabs=data-factory

I have created the Linked service. When I need to define the source in the pipeline, then when selecting the list, then no data is shown in the PreviewData. I can select a column which is also shown and see the data. I do not know what it is that I have done wrong, is there some setting on the list that needs to be specified.

201984-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
Microsoft 365 and Office SharePoint For business Windows
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Jan Boldt 11 Reputation points
    2022-05-19T13:17:47.917+00:00

    I found the mistake. I had replaced the address in the Scope="..." with the direct reference to the sharepoint site. It should be as specified as below.

    <AppPermissionRequests AllowAppOnlyPolicy="true">
    <AppPermissionRequest Scope="http://sharepoint/content/sitecollection/web" Right="Read"/>
    </AppPermissionRequests>

    2 people found this answer helpful.

  2. KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator
    2022-05-16T23:20:56.787+00:00

    Hello @Jan Boldt ,

    Thanks for the question and using MS Q&A platform.

    I tried to reproduce the issue on my end but no luck. I was able to see the data if I do a $select=* query on the selected List

    202513-image.png

    Below is my dataset configuration, please make sure to select the List name in your dataset settings and try to do a preview data from the data set and then try to use the query in Copy Data activity source settings. If you are able to see the data from dataset preview tab then you should be able to see the data using Query under Copy Activity Source preview section.

    202464-image.png

    If you still notice this issue, to work around, I would suggest to select the Table option instead of Query under Copy activity Source settings as you are trying to view the whole list data. If you want to filter specific data related to your list then use Query option.

    202474-image.png

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.