Catalog Parquet files with Pandas

Question

Is it possible to identify the schema on the parquet files which were writed with pandas?

Answer 1

Hello @Caio Tomy Ono Kaminari ,

Thanks for the question and using MS Q&A platform.

The following file types are supported for scanning, for schema extraction and classification where applicable:

Purview scanner only supports schema extraction for the structured file types (AVRO, ORC, PARQUET, CSV, JSON, PSV, SSV, TSV, TXT, XML, GZIP)

Note: For AVRO, ORC, and PARQUET file types, Purview scanner does not support schema extraction for files that contain complex data types (for example, MAP, LIST, STRUCT).

For more details, refer to Supported data sources and file types in Azure Purview.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators