Mapping data flow in synapse missing attributes values when reading a REST data set

Paul Hernandez 541 Reputation points
2022-02-10T17:24:43.017+00:00

Hi everyone,

this is really weird, I am reading AAD groups using the graph API from a mapping data flow using a REST dataset:

173158-image.png

The projection is as expected:

173216-image.png

The "renewedDateTime" attribute sometimes has values and sometimes is completely empty in the data preview:

173254-image.png

When values are available (I don't know how is that possible), they disappear in the flatten transformation.

Any ideas what could be wrong?

The examples in the documentation cover only string attributes.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,849 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,669 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Zehui Yao_MSFT 3,791 Reputation points Microsoft Vendor
    2022-02-11T02:33:34.687+00:00

    Hello,@Paul Hernandez , the property is only updated via the renew service action.
    Here is the documentation for reference: https://learn.microsoft.com/en-us/graph/api/resources/group?view=graph-rest-1.0#properties
    173384-image.png

    If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.