"GetPathStatus" - about 2.5 Billion requests a month "ListFileSystemDir" - about 0.8 Billion requests a month

Hayder Aziz 0 Reputation points

We are running a datalake using ADSL v2. Its just a BLOB store, and we run our Hive on top of it.

However despite having just around 50K queries a month... we're getting

2.5 Billion "GetPathStatus"
0.8 Billion "ListFileSystemDir"

per month.

that seems extremely over the top?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,129 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
1,961 questions
{count} votes