How to delete specific data from files stored in Azure Data Lake
I'm migrating data sets to be stored in ADLS. After certain period I want to delete data within this data set that is more than 3yrs old. How can I do that? I do not want to delete the file, but specific data within the files.
Data Factory V2 Storage Account not Refreshing - Because it thinks its blob Storage
I have created a Storage Account set to be Azure Data Lake V2 by setting the hierarchical namepace. And I used Azure Storage Explorer to add some files into the blob Container (Which is an Azure datalake gen2) I'm now creating a Data Lake V2 Linked…
I'm trying to source data in a comma-delimited file from an Azure Gen2 Storage account using Flexible File Source task. The connection succeeds but Preview of data is blank.
I'm trying to pull data from ADLS Gen2 using the SSIS Flexible File Source task. I'm getting blank results when trying to view the data in the Columns tab of the dialog.
![](https://techprofile.blob.core.windows.net/images/iBVLlv5_AwAAAAAAAAAAAA.png?8D8491)
Error occurs at source transformation when trying to source csv file from folder in data lake storage gen2 while debugging the pipeline
While using mapping data flow activity, In source transformation I am trying to read a csv file from a folder in Azure data lake gen2. I am able to preview the data in "Data Preview" in source transformation but when trying to debug the…
Write Access for Azure Data Lake Gen 2 Container
Hi, I have an Azure Data Lake Gen 2 Storage Account. I have created multiple containers inside it say A , B & C. Now , I want to control access for files & folders for respective containers. I have tried giving the following access - …
![](https://techprofile.blob.core.windows.net/images/VfQFAmOikEWfBHko2XlWTA.png?8D7F33)
Can't access txt file with json format from Data Lake Gen2 inside a Data Flow
I have stored a txt file with json format (coming from a MongoDB) in my Data Lake Storage Gen2 and inside my Data Flow I would like to access that file, convert it into a column structure, transform the data and shift it to my Azure SQL DB. Currently I…
Common data service is not able to connect to Azure data lake store Gen 2 when "Selected Networks" is configured in firewall.
Issue: Common data service is not able to connect to Azure data lake store Gen 2 when "Selected Networks" is configured in firewall. Description: Both environment and storage account are in west europe region. However, the reason connection…
Data labeling and classification solution in ADLS gen2
Hi, I need to classify and the label with the classification the data stored in Data Lake Storage e.g. assign Sensitive label on some folder/file and then have a way to present in some report, provide retention based on the classification etc. One…
USQL Datalake Question
Is there anyway to backup the partition files of usql table? Or the only way is to import the data to csv file.
Import incremental data from Azure Data Lake
Good afternoon, I have the following scenario !! I have a table in SQL that always receives changes daily, and I need to send this data to Azure data lake So, today I take this data and send it in the datalake file: Historicos.csv …
Unable to load data into Azure Synapse from ADLS Gen 2 .csv file
Hi @ChiragMishraMSFT-1092 Upon trying to load the data from ADLS(csv files) into Azure DW, am encountering a error in loading the data in DW. Here is the error message: "message": "Failure happened on 'Sink' side.…
Express route and Azure Data Lake gen 2
Hi, I am doing some testing around accessing Azure Data Lake Gen 2 from an On Premise hadhoop I need to access the service via Express Route What is the recommended setup if anyone has been through a configuration? thanks
How do I create an exploratory zone on top of my Azure Data Lake
Hi, My sincere apologies if this question would have been already answered. However, I searched hard but couldn't find the relevant information. Here lies my question: I have a Data Lake setup in Azure already. Further on, I have a requirement…
Write json document to azure table
Hi, I am using below code to write json document in a Azure Data Lake Gen2 container into a SQL Server table. Code: df =…
![](https://techprofile.blob.core.windows.net/images/VfQFAmOikEWfBHko2XlWTA.png?8D7F33)
ADL Gen2 rename using Path REST API failure with SAS token
Hi, I am currently trying to rename a file within a container using the https://learn.microsoft.com/en-us/rest/api/storageservices/datalakestoragegen2/path/create API and an account-level SAS token. The SAS token was generated from the Azure portal…
What is the recommended approach if we had to load data from an Azure Data Lake Gen 2 to Oracle Exadata?
What is the recommended approach if we had to load data from an Azure Data Lake Gen 2 to Oracle Exadata?
How to Transform files in subfolders with one script in databricks
i have a adls gen2 folder with sub folders with parquet files in each folder. My requirement is to transform all parquet files in sub folders and load into another folder in adls gen 2 with same folder structure with one script. is it possible to do or…
ADLS Gen2 Upload issue within IBM Java 8 in AIX machine
Hi Team, We have deployed a web application in AIX machine with IBM Java 8. In this web application, we are invoking ADLS Gen2 Rest API to upload and download the files. We are getting the following error, when we try to upload the files to ADLS Gen2…
Ad integration pass through for HDInsight
HI, I know HDInsight with ESP feature enables AD integration while connecting to cluster. Also teh access to underlying Hive tables can be controlled using Apache Ranger. But i would like to know if the access permission on storage account or datalake…
How to set ACL to folder and all its children recursively?
I'm using the following code to set a ACL to a folder and its children in Azure Storage Account StorageV2. We have more than 2 million files and this takes too long. I could't find any recursive parameter or a best aproach. Is this the best option to…