1,563 questions with Azure Data Lake Storage tags

Sort by: Updated
1 answer

Azure Data Lake Analytics Retirement - Frequently Asked Questions

On 29 February 2024, we will retire Azure Data Lake Analytics and this service will no longer be available. Before that date, please migrate your services that were deployed using Azure Data Lake Analytics to another Azure data processing product of…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Data Lake Analytics
asked 2022-03-17T19:20:07.157+00:00
Michael Rys [MSFT] 11 Reputation points Microsoft Employee
commented 2025-04-16T06:56:19.18+00:00
Karan Kumar Bakhri 0 Reputation points
2 answers

Datalake data

Hi Friends, I want to understand exactly how data compression takes place in Data Lake behind the hood.What kind of algorithms techniques  if there are any applied within datalake ? Or do we need to take care of data compression needs by ourselves.Please…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-04-09T10:56:21.1866667+00:00
azure_learner 615 Reputation points
commented 2025-04-14T08:32:52.9433333+00:00
Vinod Kumar Reddy Chilupuri 4,185 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

I would like to know if connector is available for SAP BPC?

Hi Experts, I am working on solution development to ingest data from different SAP systems to ADLS Gen 2. I have selected ADF for the integration and could see ADF connectors available for SAP BW, HANA, C2C etc. However, I don't find any information…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
578 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,662 questions
SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,705 questions
asked 2023-12-18T13:44:07.4133333+00:00
Sivaramakrishnan S 20 Reputation points
commented 2025-04-09T08:08:05.3266667+00:00
Gowtham Selvaraj 0 Reputation points
1 answer One of the answers was accepted by the question author.

Unable to rename a directory named space character using ADLS Gen2 REST API

The rename operation fails when the source directory contains a space in its name. I've been trying to understand why this happens. In my Golang code, I have multiple test cases, and the rename operation consistently fails when the directory name…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-04-03T17:20:30.6833333+00:00
Juan Carlos Fernández Umaña 25 Reputation points
commented 2025-04-07T13:39:58.6666667+00:00
Juan Carlos Fernández Umaña 25 Reputation points
1 answer One of the answers was accepted by the question author.

Extract Refresh Failed: Databricks OAuth credentials expire in Tableau if a change is not made

Every 7 days or so, my Tableau Developers get this issue below, the current quick fix is for them to re-enter the Databricks credentials for the OAuth Clients Registry. Is there a setting that is causing this issue on the Databricks side?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-03-31T19:21:58.1633333+00:00
Tyler Mann 20 Reputation points
accepted 2025-04-02T20:27:00.2633333+00:00
Tyler Mann 20 Reputation points
1 answer

Azure Event Grid Metadata Output change for Fivetran

I use Fivetran to lift data from on-prem servers to Azure Data Lake. After that happens, I use Azure Event Grid to send that event to a logic app. The logic app then triggers a Databricks job when the event is received. When I first started using…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-03-12T14:15:06.7933333+00:00
Mathious Willie 20 Reputation points
commented 2025-03-17T16:32:43.0333333+00:00
Keshavulu Dasari 4,840 Reputation points Microsoft External Staff Moderator
1 answer

How to restrict and alert the user when they upload a file size of greater than xx MB's on ADLS Gen2 account

Hello Team I'm working on couple of requests: I wanted to restrict and alert the user when they are trying to upload a file of given threshold size. (Say > 50MB) I wanted to restrict and alert the user when they are trying to upload a file of…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-03-11T13:36:15.9166667+00:00
manigandan 0 Reputation points
commented 2025-03-13T15:03:29.74+00:00
Vinod Kumar Reddy Chilupuri 4,185 Reputation points Microsoft External Staff Moderator
2 answers

Copying files to azure data lake

Failure happened on 'Sink' side. ErrorCode=AdlsGen2OperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Operation returned an invalid status code 'PreconditionFailed'. Account:…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-03-05T12:35:30.05+00:00
Tamilarasu Raja @ 4i Apps 0 Reputation points
commented 2025-03-07T08:00:47.3866667+00:00
Hari Babu Vattepally 3,345 Reputation points Microsoft External Staff Moderator
1 answer

R/W Access to single ADLS Gen2 Container

Is it possible to grant access to a group of users to read/write into single container on ADLS Gen2 without granting read access to other containers on the same storage? We need users to upload some .csv files to storage. We use that storage (other…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-03-04T18:53:28.9866667+00:00
Dejan Sunderic 0 Reputation points
commented 2025-03-05T16:42:13.28+00:00
Keshavulu Dasari 4,840 Reputation points Microsoft External Staff Moderator
0 answers

Unable to create a directory named space character using ADLS Gen2 REST API

I am unable to create a directory in "Azure Data Lake Storage Gen2" that is named as just a single space character, despite reviewing the documentation and there being no indication this is a disallowed name. My primary access to "Azure…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-01-16T15:07:47.1866667+00:00
Phil R 10 Reputation points
commented 2025-03-05T16:37:21.8+00:00
Keshavulu Dasari 4,840 Reputation points Microsoft External Staff Moderator
2 answers

I want to restrict azure ADLS SFTP access to directory level.

I want to created sftp for 5 user and want to maintain all the sftp folder in one container.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Storage
Azure Storage
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,543 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,203 questions
asked 2025-02-13T13:50:41.1066667+00:00
Thaya 0 Reputation points
edited a comment 2025-02-27T11:06:01.8766667+00:00
Venkatesan S 2,820 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Azure ADLS Gen2

Hi All, I need to know is it possible to replicate data from On-Premises SQL SERVER 2022 to ADLS Gen2 Storage directly. If possible, please provide me some links or give some guidance. Not to use: CDC, Triggers, Third Party tools for ETL Note: I need…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-02-27T05:39:51.6866667+00:00
Vignesh K 20 Reputation points
accepted 2025-02-27T08:46:01.1433333+00:00
Vignesh K 20 Reputation points
1 answer One of the answers was accepted by the question author.

Change Data Storage Region in Fabric

We our Fabric instance hosted in North Europe however the data storage is in South Africa North. I would like to change the storage region from South Africa North to North Europe. This will enable us to create external volumes in Snowflake so that we can…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
asked 2025-02-24T09:17:27.9666667+00:00
Lunga Mxhalisa 20 Reputation points
accepted 2025-02-25T09:24:05.52+00:00
Lunga Mxhalisa 20 Reputation points
1 answer

how to refresh the files from the storage account mounted using the path mapping

I have mounted the Azure data lake storage containers in python azure webapp as path mapping. When reading the files, the files are not up to date. The files on the mounted path are visible immediately after the initial creation, but next changes are…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
8,984 questions
Azure Static Web Apps
Azure Static Web Apps
An Azure service that provides streamlined full-stack web app development.
1,181 questions
asked 2023-10-03T13:14:23.7233333+00:00
Aruna Ganguri 5 Reputation points
commented 2025-02-25T09:07:35.95+00:00
Nagaraj, Pramod 0 Reputation points
1 answer

How to control access to a folder in ADLS gen2 container while Storage account IAMs are in action

Hi, I have a synapse pipeline that saves an output file in a folder (ex: salary) in an ADLS container (ex: employee). Now Mr. X wants the data saved in the folder to be accessible only to him but storage account level IAMs have already given access to…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-02-03T19:28:59.77+00:00
SP 5 Reputation points
edited the question 2025-02-25T07:38:18.38+00:00
Givary-MSFT 35,626 Reputation points Microsoft Employee Moderator
1 answer

How to know which Capacity is right for our company while using PowerBI Embedded?

Hello there, We are trying to set up PowerBI Embedded on our application. We're using Data Factory (getting data from MongoDB) to get the data, when running it, we get: "This is a free trial version, to remove this label a capacity must be…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,662 questions
asked 2023-07-20T18:35:47.1733333+00:00
Anonymous
commented 2025-02-24T01:31:02.17+00:00
Santosh Hiremath 0 Reputation points
1 answer

I need to verify my storage account's total capacity limit and check if I am reaching my quota. How can I confirm the maximum storage allocation and expand it if necessary?

I need to verify my storage account's total capacity limit and check if I am reaching my quota. How can I confirm the maximum storage allocation and expand it if necessary?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Storage Explorer
Azure Storage Explorer
An Azure tool that is used to manage cloud storage resources on Windows, macOS, and Linux.
292 questions
Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
9,070 questions
Azure Storage
Azure Storage
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,543 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,203 questions
asked 2025-02-18T21:06:50.03+00:00
Lars Seagren 0 Reputation points
commented 2025-02-21T19:23:18.0666667+00:00
Syed Aaqid Ali 580 Reputation points Microsoft External Staff Volunteer Moderator
2 answers One of the answers was accepted by the question author.

How can i create a linked service in ADF for Sharepoint online?

I want to extract files from sharepoint to ADL by only using ADF. I followed few steps Step1: Azure Active Directory -> Registered new app -> created new secret key I have the Tenant ID, ClientID(App ID), Secret Key Step2: Sharepoint online ->…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,662 questions
Microsoft 365 and Office | SharePoint | For business | Windows
asked 2024-04-27T21:58:38.2233333+00:00
Siddartha Reddy Jammula 20 Reputation points
answered 2025-02-19T14:22:07.2933333+00:00
Luis Javier Quecedo Iglesias 0 Reputation points
2 answers

Data Share support ADLS Gen2 with private endpoint

Do data share support ADLS Gen2 that is deployed with Private Endpoint?

Azure Data Share
Azure Data Share
An Azure service that is used to share data from multiple sources with other organizations.
66 questions
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Private Link
Azure Private Link
An Azure service that provides private connectivity from a virtual network to Azure platform as a service, customer-owned, or Microsoft partner services.
551 questions
asked 2020-09-30T16:38:02.05+00:00
Alvin Tai 1 Reputation point Microsoft Employee
commented 2025-02-19T07:58:09.8333333+00:00
Raymond Smith 0 Reputation points
1 answer

Pyspark dataframe is taking too long to save on ADLS from Databricks.

I'm running a notebook on Azure databricks using a multinode cluster with 1 driver and 1-8 workers(each with 16 cores and 56 gb ram). Reading the source data from Azure ADLS which has 30K records. Notebook is consist of few transformation steps, also…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,549 questions
asked 2022-11-29T10:09:42.24+00:00
Pratik Roy 1 Reputation point
commented 2025-02-18T04:26:33.81+00:00
Madhur Tyagi 0 Reputation points