Importing data with Lookup fields using Azure Data Factory Common Data Service connector, when there is no ID field in source data

Ryan Widmer 21 Reputation points
2020-11-05T18:06:04.3+00:00

I have a customer who's migrating to a Common Data Service based application and needs a weekly data sync refresh. This data sync will upsert to a table from a CSV in Blob Storage to the Common Data Service for Apps connector.

The CSV data provides data for Lookup fields in CDS by their business key, and not the ID (GUID). Example: Instead of a Guid for an Account reference in the source file, the column will simply say "AT&T". It doesn't appear that Azure Data Factory's connector will resolve this Lookup value to an ID automatically even if there's an alternate key defined.

My question is what would be the best pattern for getting this data into CDS while having to resolve lookup IDs like this? Currently I'm copying Active Accounts into Azure Data Lake Gen 2 and performing a join using a mapping data flow in order to resolve the IDs. Is this the best option?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,706 questions
{count} votes

Accepted answer
  1. MartinJaffer-MSFT 26,086 Reputation points
    2020-11-13T00:59:11.257+00:00

    So I finally heard back, RyanWidmer-4695 . You are doing the correct thing. It sounds like, at this time, the connector is not supporting alternate keys.

    Credit to @DanielP-MSFT


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.