ErrorCode=UserErrorInvalidColumnMappingColumnNotFound

Question

ErrorCode=UserErrorInvalidColumnMappingColumnNotFound

DPotts 5

I have a staging table and target table with exactly the same schemas, only different data types e.g. nvarchar(max) / nvarchar(50).

I'm attempting to insert the data from the staging to the target using a Copy Activity.

I have removed parameterised aspects of the pipeline and hardcoded the table names and explicitly imported schema mapping.:

User's image

The error I get is:

Failure happened on 'Sink' side. ErrorCode=UserErrorInvalidColumnMappingColumnNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Column name 'FECode' cannot be found in either source data or column mapping.,Source=Microsoft.DataTransfer.DataContracts,'

Clearly, it is in both the source and sink destinations. Please could someone advise?

Amira Bedhiafi 41,376 Reputation points MVP Volunteer Moderator

2024-07-08T13:59:18.03+00:00
The 'FECode' is not found in either the source data or the column mapping you provided, you may need to :

Clear your data schema in your source dataset

Import schema in your source dataset

Clear your mapping in your copy settings

Import schemas on mapping of copy

Copy paste the column name from source file, import schema of your dataset and column name from mapping of copy are exactly same

Or since you have hardcoded the table names and schema mapping, ensure that there are no typos or incorrect mappings.

[ { "source": "FECode", "sink": "FECode" }, ... ]

Here is an example of how you might define the schema mapping in JSON:

{ "type": "TabularTranslator", "mappings": [ { "source": { "name": "FECode" }, "sink": { "name": "FECode" } }, ... ] }
DPotts 5 Reputation points

2024-07-08T14:07:02.64+00:00

Hi Amira,

The pipeline is actually metadata driven. For the purposes of testing, I reverted it back to hardcoded values for Source / Sink.

The mapping has been imported and includes no whitespace in either FECode on source or sink side.

I saw this advice on another thread and created 2 explicit datasets for each table, imported schemas on both. Utilising them for the copy activity and importing the mapping still results in an error.

I have also tried to do this via SSMS where it works:
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2024-07-11T21:27:58.1366667+00:00

Hello DPotts,

I see there is an active bug that product team is currently working on. I will update this thread once the issue is fixed.

Thank you for your patience.
DPotts 5 Reputation points

2024-07-12T07:15:58.97+00:00

Hi @Bhargava-MSFT

Ive realised that it is a bug that seems to be related to the number of columns being copied.

I had 32 columns. When removing any of the columns at random to make 31, the activity completed without error. In addition, adding a random column to take the total to 33 also resulted in the copy activity completing without error.

Happy to walkthrough my findings if it’s in anyway helpful - thank you.
Laitman, Gary 0 Reputation points

2024-08-14T14:42:44.77+00:00

Exact same issue to report here. I had 32 columns. When removing any of the columns at random to make 31, the activity completed without error. Is there any update on this bug?
Bongolethu Fumbatha 0 Reputation points

2024-12-10T14:33:16.36+00:00

sorted on my end