Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
copy data import schema need to be refershed after the deployment
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 41%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Josh
46
Reputation points
After the pipelines are deployed in Azure data factorty through Azure release pipeline , and started executing , it is showing the below error . It is in the cpoy activity that we see this error , when we import schema again and try to execute it is running successfully. Is it a know issue. Error: InvalidOperationException,Message=The given ColumnMapping does not match up with any column in the source or destination.,Source=System.Data,'
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT 29,266 Reputation points Microsoft Employee2023-04-12T20:12:04.8666667+00:00 Hello Josh, This error occurs when the column mapping in the Copy activity does not match any column in the source or destination. It might be caused by an incorrect or outdated schema in the Copy activity. Can you try the following steps:
- Re-import the schema in the Copy activity to ensure it matches the source and destination columns
- Verify that the column mappings are correct and up-to-date.
If the issue persists, consider using the Binary Copy option while creating the Copy activity. This way, Data Factory won't open the files to read the schema but will treat each file as binary and copy it to the other location I hope this helps. Please let me know if you have any further questions.
-
Bhargava-MSFT 29,266 Reputation points Microsoft Employee
2023-04-13T18:34:20.02+00:00 Hello Josh, I am checking to see if you got a chance to look into my earlier response.
-
Bhargava-MSFT 29,266 Reputation points Microsoft Employee
2023-04-14T16:26:28.77+00:00 Hello Josh, I am checking to see if you got a chance to look into my earlier response.
-
Josh 46 Reputation points
2023-04-15T12:06:01.86+00:00 i have checked at the source columns, and i have not found any changes . but still wondering what could be the reason . let me explain you the process that i have followed
- created table in data base
- created copy activity in Azure data factory and did mapping between source and destination .
- then exported the ADF ARM template and imported through release into new ADF. please let me know if we missed any step here.
-
Bhargava-MSFT 29,266 Reputation points Microsoft Employee
2023-04-19T22:46:45.2566667+00:00 Hello Josh, Thanks for the additional information. I tried to reproduce the issue using the release pipeline, but I can run the pipeline successfully in the other environment without importing the schema again. I used both source and destination as Azure SQL. Your ARM template might have an issue. I suggest filing a support ticket to investigate the issue further. If you don't have a support plan, please let me know so I can enable one-time free support request for you to work on this.
Sign in to comment