How to see the file size of all type of data assets in Purview

Question

How to see the file size of all type of data assets in Purview

Dhanoordaran V 170

I can able to see the file size for csv files inside the "properties" tab of data asset.

But I'm unable to see the size for most of the file types of "parquet" format and files from Synapse analytics.

Is there a way to get that detail directly or via api ?, please explain

Accepted answer

0 additional answers

Your answer

Answer 1

Venkat Reddy Navari 1,780 Microsoft External Staff Moderator

Hi @Dhanoordaran V
You're correct that Microsoft Purview shows file sizes for some file types (like CSV) under the Properties tab, but support for other formats—such as Parquet and certain Synapse Analytics assets—can be inconsistent depending on the source system and integration.

Here are some key points to consider

Parquet Files: For Parquet files stored in Azure Data Lake Storage (ADLS), file size metadata may not always be extracted by default. Ensure that the scan rule set for your data source includes the "Extract file-level metadata" option (enabled in advanced settings during scan configuration).
Synapse Analytics: For Synapse SQL or dedicated pools, the Purview integration might not extract individual file sizes unless those are part of linked datasets (e.g., external tables over ADLS). Currently, file size metadata is more reliably extracted from storage-backed data sources rather than query-based systems.
Using the Purview REST API: You can use the Purview Search API to query for assets and their metadata. However, file size is returned only if it was captured during the scan. Look for attributes like qualifiedName, name, and fileSize.

Example API filter:

{
  "keywords": "parquet",
  "filter": {
    "and": [
      {
        "attributeName": "fileSize",
        "operator": "isNotNull"
      }
    ]
  }
}

I hope this information helps. Please do let us know if you have any further queries.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.

Dhanoordaran V 170 Reputation points

2025-04-17T16:01:04.8766667+00:00

Thanks @Venkat Reddy Navari for the inputs
Dhanoordaran V 170 Reputation points

2025-04-18T08:43:29.0633333+00:00

HI @Venkat Reddy Navari , can you please explain in detail for fetching the file sizes for Synapse Analytic files which creates views by querying ADLS as input (not external tables).
Venkat Reddy Navari 1,780 Reputation points Microsoft External Staff Moderator

2025-04-18T09:39:05.78+00:00
@Dhanoordaran V When using views in Synapse Analytics that query data directly from ADLS (e.g., via OPENROWSET) without creating external tables, the file size information for the underlying files is not captured by Microsoft Purview. Here's why and what you can do:

Why file sizes aren’t shown in this case:

Views in Synapse are logical objects—they don’t store or expose physical metadata like file size.

Microsoft Purview scans Synapse views as SQL objects and does not trace them back to the physical files in ADLS.

As a result, file-level properties (like size) are not extracted when scanning these views.

How to get file size information:

Option 1: Scan the ADLS Storage Directly

To get file sizes, scan the ADLS account that stores the Parquet/CSV files:

In Purview, go to Sources > Azure Data Lake Storage.

Configure a new scan, and in advanced settings, make sure “extract file-level metadata” is enabled.

After the scan completes, search for the files in Purview — file size will appear under the Properties tab.

Option 2: Use Azure CLI / SDK / REST API

If you prefer automation or scripting:

az storage blob list \ --account-name <your-storage-account> \ --container-name <your-container-name> \ --output table \ --query "[]. {name:name, size:properties.contentLength}"

This will return file names and their sizes directly from ADLS.

I hope this information helps. Please do let us know if you have any further queries.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.
Dhanoordaran V 170 Reputation points

2025-04-18T09:44:36.47+00:00

Thanks a lot @Venkat Reddy Navari for the detailed answer
Venkat Reddy Navari 1,780 Reputation points Microsoft External Staff Moderator

2025-04-18T10:11:16.33+00:00

Dhanoordaran V Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Share via

How to see the file size of all type of data assets in Purview

0 additional answers

Your answer