Ingestion mapping from parquet source to Kusto using ADF copy activity failing because of mapping kind?
Hi, I have a blob storage with parquet files that I want to ingest into Kusto using copy activity in ADF V2. I have created my source dataset as parquet source. I have created my sink dataset to point to my Kusto table. I have created an ingestion mapping in Kusto for parquet and followed the documentation(example below) :
.create-or-alter table TestTable ingestion parquet mapping "MappingTest"
```[ {"Column": "id", "Properties": {"Path": "$.id"}},
{"Column": "BLE", "Properties": {"Path": "$.BLE"}},
{"Column": "schema_version", "Properties": {"Path": "$.schema_version"}},
{"Column": "timestamp", "Properties": {"Path": "$.timestamp"}}
]```
so far everything works fine and my parquet source columns are exactly the same as my Kusto table.
when I run the copy activity in ADF , it thinks that the mapping kind should be CSV and not parquet and I am not sure why. I have troubleshooted this for a while and did some research but could not find any useful information on why this error is pooping up.
error :
ErrorCode=KustoMappingReferenceHasWrongKind,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Mapping reference should be of kind 'Csv'. Mapping reference: 'MappingTest'. Kind 'Parquet'.,Source=Microsoft.DataTransfer.Runtime.KustoConnector,'
Any help would be very appreciated! Thank you!