Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,335 questions
1 answer
i have same issue with gen2 with multiple sub folders and inside sub folders having time stap based folders, so i need to move those sub folders files to another folder
Hello, Here the example for hierarchy of the gen2 , and my previous question also related to this , i need to move the files this hierarchy to another folder and second one is delete grater than 60 days files needs to delete with same hierarchy …
asked 2022-06-08T04:31:03.013+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 69%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAR%3C/text%3E%3C/svg%3E)
anji reddy
1
Reputation point
commented 2022-06-27T04:43:50.4+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
Cannot create data lake analytics service
Hi, I am a student and I am using the azure for student service. But the time I have tried to create the data lake analytics it pops up "Oops! Could not create the marketplace item This marketplace item is not available." Also I have created…
asked 2022-05-28T02:51:28.47+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 91%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWC%3C/text%3E%3C/svg%3E)
Weihao Cai
1
Reputation point
commented 2022-06-06T05:51:06.637+00:00
PRADEEPCHEEKATLA-MSFT
76,586
Reputation points Microsoft Employee
1 answer
Azure Solution for Streaming Logs - SIEM
Hello, I am planning to use Azure sentinel for my on-premises and cloud workloads/devices. Like any other SIEM solution, Sentinel requires you to have a log collector where all the devices(Syslog,CEF) can send the logs and than they are transported…
asked 2022-05-04T08:24:44.13+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 12%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENK%3C/text%3E%3C/svg%3E)
Nouman Khan
21
Reputation points
commented 2022-06-03T09:55:39.297+00:00
Nouman Khan
21
Reputation points
0 answers
azure datalake
Hi, Could you help me, I am currently getting the following error: HTTP/1.1 401 Server failed to authenticate the request. Please refer to the information in the www-authenticate header. this when trying to perform an upload to azure datalake of more…
asked 2022-04-07T14:24:52.607+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 18%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJA%3C/text%3E%3C/svg%3E)
José Armando Díaz Torres
1
Reputation point
commented 2022-05-02T23:38:49.91+00:00
José Armando Díaz Torres
1
Reputation point
1 answer
Snowflake merge Query
Hello Team, I have table 'BATCHTABLE' which is empty table. I want to perform merge on BATCHTABLE. I want to insert a new record when there is no duplicate record and want to update when there is duplicate record. I verify duplicate record based on…
asked 2022-04-13T11:21:54.763+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 37%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKK%3C/text%3E%3C/svg%3E)
Kishore Kumar Adari
21
Reputation points
commented 2022-04-27T19:20:08.617+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
2 answers
Data Lake Analytics account creation conflict
I am trying to create Azure Data Lake Analytics account on Azure portal. I have a student subscription with 100$ credit. After creating the resource group and Data Lake storage gen1, as shown below: I try to create a new Data Lake Analytics…
asked 2022-03-25T16:22:53.12+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 81%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAE%3C/text%3E%3C/svg%3E)
Amr Elsherbiny
1
Reputation point
answered 2022-04-01T04:31:13.977+00:00
PRADEEPCHEEKATLA-MSFT
76,586
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Conditional Running Total sql
Hello there, Below is my source dataset Date Rejection Days 1/1/2018 0 10 2/1/2018 0 10 3/1/2018 0 10 4/1/2018 1 10 5/1/2018 0 10 6/1/2018 0 10 7/1/2018 2 10 …
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 86%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
1 answer
Fetch multiple files from a specified folder (at once) from Azure Data Lake Gen2 (Preference1-API call, Prefercence2-Alternate options)
We have a requirement to fetch multiple files in a specified folder from Azure Data Lake Gen2. We have tried options specified in this article "https://learn.microsoft.com/en-us/rest/api/storageservices/datalakestoragegen2/path/read" …
asked 2022-03-04T12:38:30.52+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 53%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAP%3C/text%3E%3C/svg%3E)
Amala Paulose
1
Reputation point
commented 2022-03-23T08:00:07.87+00:00
AnnuKumari-MSFT
30,361
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
is azure data lake analytics supports onlu storage Gen1
is azure data lake analytics account only support data lake storage Gen1? Can blob storage be use for data analytics account? data analytics account locations are very limited. if storage account is in different location than analytics account, will…
asked 2020-06-09T14:50:27.063+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 42%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Seuli Das Majumder
101
Reputation points
commented 2022-03-17T19:58:39.99+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 6%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMR%3C/text%3E%3C/svg%3E)
Michael Rys [MSFT]
11
Reputation points Microsoft Employee
1 answer
data lake and schemas
Since data lakes store data in its raw form from the original data source how do you manage providing data to users to create reports when they're accustomed to snowflake and star schemas?
asked 2022-02-03T00:41:32.57+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 70%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETT%3C/text%3E%3C/svg%3E)
Thirston Third
21
Reputation points
commented 2022-03-04T06:28:18.597+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Expose ADLS data through API for external vendors.
Hi All, any pointers where I can use REST API to expose my ADLS(parquet format) data to external vendors? If there is any out of box component on the Azure or any marketplace item, that would be great. Thank you!
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 28.000000000000004%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
1 answer
Data landing zone pattern
Hi, Below Azure reference architecture talks about how data landing zones can be used to implement a data mesh. https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/scenarios/data-management/eslz-scale In the above reference…
asked 2022-01-04T20:58:24.707+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 41%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
saurabh
331
Reputation points
commented 2022-01-21T06:42:28.607+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
cannot create data lake analytics account
We are not able to create data lake analytics account since data lake gen 1 creation is not available for new customers and data lake anaytics does not support gen data lake. Any alternative solution exist for creating data lake analytics account?
asked 2022-01-16T16:34:21.11+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 56.00000000000001%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVC%3C/text%3E%3C/svg%3E)
vinita chaturvedi
1
Reputation point
commented 2022-01-20T15:49:27.71+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 63%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
svijay-MSFT
5,201
Reputation points Microsoft Employee
1 answer
Azure data factory: Error Submitting Job to ADLA. Details: Maximum request length exceeded.
We created a scope activity in azure data factory and used dynamic parameters to transfer parameters to scope script. The activity finally failed and the error message is Error Submitting Job to ADLA. Details: Maximum request length exceeded. The…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 93%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJO%3C/text%3E%3C/svg%3E)
2 answers
One of the answers was accepted by the question author.
What is the difference between Azure Synapse Analytics and Azue Data Lake Analytics
Hi Guys, I am currently preparing my Exam for AZ-900 Certification. One Question in a training was: Which service is an on-demand analytics job service that helps you to write queries to transform your data and extract valuable insights? My answer…
asked 2021-12-14T10:47:46.567+00:00
Ucar Cihan
46
Reputation points
commented 2021-12-20T08:21:06.887+00:00
Ucar Cihan
46
Reputation points
0 answers
We can not access the link to the share point document related to O365 in the hospital. it is blocked by our firewall. Can you give me the link that should be allowed to access this link?
We can not access the link to the share point document related to O365 in the hospital. it is blocked by our firewall. Can you give me the link that should be allowed to access this link? …
asked 2021-12-10T05:41:35.763+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 97%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELS%3C/text%3E%3C/svg%3E)
Lakmal Sanjeewa
1
Reputation point
commented 2021-12-16T01:05:13.67+00:00
svijay-MSFT
5,201
Reputation points Microsoft Employee
0 answers
Pick only the latest files everymonth where files are posted on daily basis.
Hello Forum , Can someone help me on the below issue. I have my source as SFTP where two files are posted on everyday however they are not posting the files on weekend as shown in the below format. CMF_20211206.txt DFS_20211206.txt …
asked 2021-12-07T19:17:51.047+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 73%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
Srikanth Gandam (z)
6
Reputation points
commented 2021-12-07T19:21:50.41+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 32%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMT%3C/text%3E%3C/svg%3E)
Michael Taylor
47,716
Reputation points
1 answer
Impossible to create Datalake Analytics
Hi, there is a problem to create a "Data Lake Analytics". Within the portal, select "Data Lake Analytics", then "New Data Lake Analytics account". Type in the values, click "Review + Create". Then it starts to…
asked 2021-11-28T18:06:13.607+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 28.999999999999996%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJL%3C/text%3E%3C/svg%3E)
Johannes Lorenz
21
Reputation points
commented 2021-12-02T11:13:42.11+00:00
PRADEEPCHEEKATLA-MSFT
76,586
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
50 million records - use case is blob json - to blob json - Need audit help
Hi All, We have a requirement given below. Please help us with technical details ASAP. Diagram of our flow already attached Read multiple json files and convert files to output json format of draft 4 schema given in databricks. Transform…
asked 2021-11-11T07:11:56.13+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 39%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBS%3C/text%3E%3C/svg%3E)
Birajdar, Sujata
61
Reputation points
accepted 2021-11-15T04:01:15.66+00:00
Birajdar, Sujata
61
Reputation points
1 answer
RBAC for Power BI accessing data held in the Azure Data Lake Gen2
Is it possible to enforce RBAC for Power BI accessing Azure Data Lake Storage Gen2? Ideally we would like to enforce table level, row level and column level RBAC to data held within our Azure Data Lake Storage Gen2. I have researched and found some…
asked 2021-10-05T09:51:33.213+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 21%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Matthew Scott
1
Reputation point
commented 2021-10-12T09:27:31.49+00:00
Matthew Scott
1
Reputation point