Issue with Column Mapping in Azure Dataflow - "Column Not Found" Error

Question

Hello everyone,

I'm trying to build a simple dataflow with a Copy Data activity that reads data from an Azure SQL VM instance and syncs it to an Azure SQL database table. It’s a straightforward "source to destination" setup, with all my column names and data types exactly the same. However, when I run the flow with write behavior Upsert and set the Key column in the sink settings,, I get the following error:

"Failure happened on 'Sink' side. ErrorCode=UserErrorInvalidColumnMappingColumnNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Column name 'BuilderId' cannot be found in either source data or column mapping.,Source=Microsoft.DataTransfer.DataContracts,'"

The BuilderId column exists in both tables with the same properties, and it is also listed in the mapping. I also validate my activity with validate button and in there i am not getting any error Am I doing something wrong?

Answer 1

Hi Moiez Hussain ,

Welcome to Microsoft Q&A platform and thanks for posting your query here.

Looking at the description of your query it seems you are facing an error "UserErrorInvalidColumnMappingColumnNotFound" while trying to run copy activity to load data from Azure SQL VM instance to Azure SQL database table.

Try make sure the following points have been taken care before you debug the pipeline:

• Check if the source column name doesn't have any spaces at the end , or the column name specified in the mapping tab is not having any mismatch or any unnecessary spaces
• Make sure that you have imported the schema for source and sink datastores by clicking on Import schema button in the mapping tab.

References:

https://learn.microsoft.com/en-us/answers/questions/1807367/errorcode-usererrorinvalidcolumnmappingcolumnnotfo

https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/data-factory/connector-troubleshoot-ftp-sftp-http.md#sftp-copy-activity-failed

Hope it helps. Kindly let us know how it goes. Please accept the answer by clicking on Accept answer button. Thankyou