Unexpected Error in Azure Synapse Analytics

Question

Hi.

I created a pipeline to copy data from Excel to Parquet, but I got unexpected error.

The error message is :

[Copy behavior must be "Merge files" when sink is a file and source is a folder or specifies wildcard file name, wildcard folder path or file filter.]

However, I set both source and sink are a file.

It is so weird, and I am very confused.

Can someone please help me??

I look forward to your answer.

Thank you.

Answer 1

Hi @Kakehi Shunya (筧 隼弥) in your source you have mentioned wildcard folder path and file path. When we use wildcard, it means that, there can be one or more matches corresponding to the wild card mentioned. For example, in the folder path, if you mention raw* there can be many many matches like raw1, raw_final etc. So it expects us to use merge in the sink. In order to avoid this issue, you either need to mention the folder path and file path in the data set itself, not under the source tab. Or else you need to use merge in the copy behaviour.