In ADF how to avoid Empty string in Sink (copy activity NULL values in Source) Snowflake to Salesforce

Fernando Basaez Jorquera 0 Reputation points
2024-02-26T00:27:23.6733333+00:00

Hi team, I am loading data from Snowflake DB to Salesforce. Int and Double and Date columns having NULL values in Source are being inserted as empty string in Sink (blob staging) by default resulting in pipeline to fail with error “the given value of type string cannot be converted to type date of the specified target column”.

  • Please consider Salesforce connector don't allow Dataflows activities
  • I have to use staging only in Azure

Appreciate any input to resolve this. Thanks

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,199 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Vinodh247 34,666 Reputation points MVP Volunteer Moderator
    2024-02-26T05:31:34.4366667+00:00

    Hi Fernando Basaez Jorquera,

    Thanks for reaching out to Microsoft Q&A.

    Please see Sheik Maheer's answer which I think might click for your problem.

    https://learn.microsoft.com/en-us/answers/questions/1398225/in-adf-copy-activity-null-values-in-source-are-con

    Let me know if this worked for you

    Please 'Upvote'(Thumbs-up) and 'Accept' as an answer if the reply was helpful. This will benefit other community members who face the same issue.

    0 comments No comments

  2. ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator
    2024-02-28T05:41:29.7766667+00:00

    Hi Fernando Basaez Jorquera, Thank you for posting query in Microsoft Q&A Platform.

    You can consider using dataflows on stage level to replace empty strings with some dummy values in Blob and then finally load from blob to Sink. We can consider using derived column transformation to replace empty strings.

    Hope this helps. Please let me know how it goes.


    Please consider hitting Accept Answer button. Accepted answers help community as well.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.