AVRO connecctor in ADF doesnt work

Vadavathi, Nikesh (Cognizant) 21 Reputation points

Hi Expers, I have an event hub, but since ADF connector to event hub is not available, I tried the option is event hub to write data to an azure blob store. But it supports only writing this event data in AVRO format in Blob store. I tried using the native ADF connector for this AVRO file, but it is not able to read the file. I tried all the compression available, snappy deflate etc but nothing seems to work. Below is the error message I am getting. Column: SystemProperties,Location: Source,Format: Avro,The data type 'System.Collections.Generic.Dictionary`2[System.String,System.Object]' is currently not supported by Avro format. . Activity ID: dd332d01-f7c2-4737-96af-ff0801242569 Attached is the sample file I tried for testing. Avro format is not supported in the forum attachement, so saving it as txt and attaching it here.[50711-eventhubsample.txt][1] [1]: /api/attachments/50711-eventhubsample.txt?platform=QnA Thanks, Nikesh

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,672 questions
{count} votes

Accepted answer
  1. HarithaMaddi-MSFT 10,081 Reputation points

    Hi anonymous user,

    Thanks for your patience again! I got an update from the product team that currently Azure data factory do not fully support Dictionary or Map types in Avro and this feature gap is taken as a bug by the team. They are working on it and will be implemented in future releases.

    Apologies for the inconvenience. Since the data can be loaded into sink, we hope it is not a blocker for implementation using dataflow. Please suggest if there is any specific challenge due to this limitation and we will provide the alternative solution for the same.


    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

0 additional answers

Sort by: Most helpful