AVRO connecctor in ADF doesnt work

Question

Hi Expers, I have an event hub, but since ADF connector to event hub is not available, I tried the option is event hub to write data to an azure blob store. But it supports only writing this event data in AVRO format in Blob store. I tried using the native ADF connector for this AVRO file, but it is not able to read the file. I tried all the compression available, snappy deflate etc but nothing seems to work. Below is the error message I am getting. Column: SystemProperties,Location: Source,Format: Avro,The data type 'System.Collections.Generic.Dictionary`2[System.String,System.Object]' is currently not supported by Avro format. . Activity ID: dd332d01-f7c2-4737-96af-ff0801242569 Attached is the sample file I tried for testing. Avro format is not supported in the forum attachement, so saving it as txt and attaching it here.[50711-eventhubsample.txt][1] [1]: /api/attachments/50711-eventhubsample.txt?platform=QnA Thanks, Nikesh

Answer 1

Hi anonymous user,

Thanks for your patience again! I got an update from the product team that currently Azure data factory do not fully support Dictionary or Map types in Avro and this feature gap is taken as a bug by the team. They are working on it and will be implemented in future releases.

Apologies for the inconvenience. Since the data can be loaded into sink, we hope it is not a blocker for implementation using dataflow. Please suggest if there is any specific challenge due to this limitation and we will provide the alternative solution for the same.

--

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
• Want a reminder to come back and check responses? Here is how to subscribe to a notification.