Azure Machine Learning - Access uri_folder dataset (ML v2) from notebook (not job)

Question

Hi all,

I've registered in Azure Machine Learning a Data Lake Gen2 datastore that point to a container with a hierarchy of folders that contain avro files and on top of it I registered a folder_uri dataset (ML v2).

Now I want to access to these folders from a notebook, convert them in a pandas dataframe in order to do some data exploration.

I search on the documentation, and I only found examples that run job and using this type of dataset as input, but I need to be able to explore it using notebook.

Is it possible? How can I do it?

Thanks

Answer 1

@G Cocci Thanks for the question. Currently it's not supported to access the avro files. Here is the document for accessing the datastore using folder_uri dataset.
https://learn.microsoft.com/en-us/azure/machine-learning/migrate-to-v2-resource-datastore

Mapping Data Flow supports AVRO as a source type https://learn.microsoft.com/en-us/azure/data-factory/data-flow-source#supported-sources