First of all, I am new in ADF world.
Recently got a task which I am still strugling with. I am trying to parse nested json stored in Blob Storage and copy the content to a table I had built in Azure Sql DB.
I created a pipeline and mapping but when running I am getting the following error:
Operation on target CopyJsonTo Sql failed: ErrorCode=UserErrorSchemaMappingCannotInferSinkColumnType,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Data type of column 'dimension1' can't be inferred from 1st row of data, please specify its data type in mappings of copy activity or structure of DataSet.,Source=Microsoft.DataTransfer.Common,'
I guess it is because some of my data contains null values. here the json file sample:
Here are also some screenshots from my pipline configuration for source, sink and mapping
Thanks in advance. Any suggestion will be valuable to me