Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,338 questions
1 answer
One of the answers was accepted by the question author.
ADLA only supports Gen 1 storage, but creating new Gen 1 storage is not possible
This is confusing to me. When I try to create a ADLA, it requires an Azure Data Lake Storage Gen 1. Then when I try to create an Azure Data Lake Storage Gen 1, I get the message it is only possible to create Gen 2. Also there does not seem to…
asked 2021-10-05T18:49:55.847+00:00
Erfan Nariman
436
Reputation points
accepted 2021-10-06T08:09:17.47+00:00
Erfan Nariman
436
Reputation points
1 answer
One of the answers was accepted by the question author.
Query data in .csv file in Azure Data lake and insert queried data in Azure SQL using Azure Data lake
Data is in .csv file in Azure Data lake containers. We want to query the data in these files and insert the queried data directly in Azure SQL using Azure Data factory. Don't want to copy all the data from .csv as is to Azure SQL some temporary table…
asked 2021-09-27T06:39:29.657+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(316.8, 65%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVB%3C/text%3E%3C/svg%3E)
Vish Bhanage
41
Reputation points
commented 2021-09-29T07:11:58.36+00:00
Vish Bhanage
41
Reputation points
1 answer
unable to create datalake analytics account and throwing providelocation is not found in azure portal
I try to create datalake anyaltics account. But error is coming. please find the below screenshot. I tried using azure datalake storage gen1 option and throwing below error. I tried creating with out selecting option datalake…
asked 2021-08-18T11:00:36.18+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 73%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETD%3C/text%3E%3C/svg%3E)
Tangirala DineshReddy
21
Reputation points
commented 2021-09-27T17:30:25.187+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,422
Reputation points Microsoft Employee
1 answer
Can we not use azure data lake analytics with azure data lake storage gen 2?
Can we not use azure data lake analytics with azure data lake storage gen 2?
asked 2021-09-21T17:02:53.037+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 34%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERD%3C/text%3E%3C/svg%3E)
Ramanathan Dakshina Murthy
21
Reputation points
commented 2021-09-27T10:03:12.517+00:00
PRADEEPCHEEKATLA-MSFT
76,921
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Data Lake analytics resource can't be created
Hi, I can't create a data lake analytics resource in my azure portal. I have consumption plan only. but even then I can't create it. It says "The provided location is not available for resource type 'Microsoft.DataLakeStore/accounts'. Please…
asked 2021-09-20T16:31:16.227+00:00
Ramanathan Dakshina Murthy
21
Reputation points
accepted 2021-09-22T03:03:52.5+00:00
Ramanathan Dakshina Murthy
21
Reputation points
1 answer
Cannot create Azure Data Lake Analytics Instance
I am trying to set up a data lake analytics instance and when I click review+create, it quickly flickers the red selection dot to review+create but then doesn't select it. When I select review+create without the button and then click create, nothing…
asked 2020-07-01T19:08:27.933+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 88%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENF%3C/text%3E%3C/svg%3E)
Nathan Fisher
1
Reputation point
commented 2021-09-21T09:33:39.013+00:00
PRADEEPCHEEKATLA-MSFT
76,921
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Get log analytics data in a seperate table and as an alert
I want to be able to get alerts about failed pipeline runs as an alert and in a separate table outside. What I currently get with azure alert is the name of my data factory and a link to the pipeline but I would like to know the name and error message of…
asked 2021-09-17T14:57:23.823+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(310.4, 72%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Adeleke Abimbola
231
Reputation points
accepted 2021-09-21T07:09:23.667+00:00
Adeleke Abimbola
231
Reputation points
2 answers
API-version wrong when creating linked service for Data Lake Analytics
Hey, I got this error when trying to create a linked service for Azure Data Lake Analytics on Data Factory: Failed to connect to ADLA account 'xxx' with error 'The resource type 'accounts' could not be found in the namespace…
asked 2020-06-05T12:38:11.013+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 81%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EK%3C/text%3E%3C/svg%3E)
Katrina
1
Reputation point
commented 2021-09-05T10:04:32.843+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 5%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
Ahmad Ghannam
1
Reputation point
1 answer
Enterprise Data Lake for multiple legacy systems
(Guidance level questions, mostly) Suppose you have a government agency responsible for motor vehicle and driver license registration (much like DMV in the US). They have separate legacy systems for vehicle registration and driver license registration…
asked 2021-08-24T09:04:37.347+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 89%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Arishtat67
1
Reputation point
commented 2021-09-02T06:57:08.923+00:00
Arishtat67
1
Reputation point
1 answer
Will ADLA have any functionality whatsoever after gen1 retirement?
I understand that ADLS gen2 will not be supporting ADLA. What is not clear to me is whether existing ADLA accounts will continue to function in any capacity at all after the gen1 retirement. Thanks.
asked 2021-02-22T23:32:42.803+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 17%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETP%3C/text%3E%3C/svg%3E)
Thomas Price
1
Reputation point
commented 2021-09-01T03:16:51.213+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 97%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELL%3C/text%3E%3C/svg%3E)
Ling Luo
1
Reputation point Microsoft Employee
0 answers
Failure happened on 'Sink' side. ErrorCode=UserErrorRfcFunctionInvokeFailed
Hello Experts below error we are facing while extract data from Open Hub table to Azure data lake. Note: My OHD table has 192 columns in it , is there any no columns restriction while pushing data to Azure, if yes , please let us know how to fix this…
asked 2021-08-17T06:52:05.543+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 72%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJN%3C/text%3E%3C/svg%3E)
Jagadeesh Naidu Renducherla
1
Reputation point
commented 2021-08-28T00:39:05.683+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 44%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Saurabh Sharma
23,671
Reputation points Microsoft Employee
1 answer
How to get Job Input and Output file name/path by adla sdk
I wonder if it is possible to get a Job’s input and output file name/path by ADLA(Azure Data Lake Analytics) by ADLA SDK(already know jobid). If there is any method within ADLA SDK can do it?
asked 2021-08-10T08:48:08.7+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYF%3C/text%3E%3C/svg%3E)
Yinan Feng
1
Reputation point
commented 2021-08-19T20:32:12.61+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,021
Reputation points
0 answers
How to know Which Job On Azure Data Analytics Read/Write Which File in Storage Account by Diagnostic Log
Hello, I am using Azure Data Lake Analytics to perform job of reading/writing files in Storage Account(gen 2). I enable the diagnostic log for both Azure Data Lake Analytics and Storage Account. I am trying to analyze the diagnostic logs of…
asked 2021-07-20T09:38:16.147+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 45%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIF%3C/text%3E%3C/svg%3E)
Ivy Feng
16
Reputation points
commented 2021-08-16T10:50:06.647+00:00
KranthiPakala-MSFT
46,422
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Azure Data Factory - cannot access share folder
Hi, I want to set up a monitoring job on ADF using Scope, but the job failed with error saying no access to the share folder shares/searchDM/distrib, my job highly relies on this folder because I need to use the SLAPI view and data, could someone help…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 28.999999999999996%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJZ%3C/text%3E%3C/svg%3E)
2 answers
One of the answers was accepted by the question author.
Impala Table alternative on Azure
Hi Team, I have a one-premise data pipeline, where we have cleaned data stored, On top of it we are creating IMPALA tables that connect to the tableau server so that when end-users change any filters or request any data from a table, Impala table can…
asked 2021-04-15T08:46:48.39+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 55.00000000000001%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIM%3C/text%3E%3C/svg%3E)
Imran Mondal
246
Reputation points
answered 2021-05-27T02:14:09.567+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 17%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EK%3C/text%3E%3C/svg%3E)
KD
1
Reputation point
1 answer
One of the answers was accepted by the question author.
Errors for running U-SQL Data Lake Analytics job with storage account as data soruce (MAG)
Hi, I am following the steps here to compute author h index from the Microsoft Academic Graph: tutorial-usql-hindex. I already have a version of the data in my Azure Storage Account and I set up a Data Lake Analytics Account. I also added my Azure…
asked 2021-03-27T04:55:40.85+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 42%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
Azam Mohsin
21
Reputation points
accepted 2021-04-12T23:44:45.977+00:00
Azam Mohsin
21
Reputation points
2 answers
One of the answers was accepted by the question author.
How to use Datetime offset in U-SQL?
Hello All, i am trying to get current system time as DECLARE @now Datetime= DateTime.Now(); Here I am getting PST time but i want to display EST time. So how can I achieve this?
asked 2021-03-24T14:35:32.163+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 52%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESC%3C/text%3E%3C/svg%3E)
Subhodeep Chakraborty
21
Reputation points
commented 2021-03-26T14:03:22.45+00:00
Subhodeep Chakraborty
21
Reputation points
1 answer
Querying Parquet file from ADL 2.0
HI - I need some design recommendations for my requirement. I have list of parquet files stored in Data lake. I need to execute some SQL statements against them , ex. select max(amount), count() and return the results so that i can write back them to…
asked 2021-03-01T09:37:43.37+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 2%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERE%3C/text%3E%3C/svg%3E)
rajendar erabathini
606
Reputation points
answered 2021-03-04T21:28:22.39+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 44%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Samara Soucy - MSFT
5,051
Reputation points
0 answers
Data Lake Analytics -Output filenames
Hey, what I wanted to append the current timestamp to filename while writing in U-SQL. But when I am doing it, PT time is being appending instead of EST. Take a look- OUTPUT @test1 TO @test _destination+ "Genesys_TR/Genesys_TR_"+@now …
asked 2021-02-11T12:13:00.473+00:00
Subhodeep Chakraborty
21
Reputation points
commented 2021-02-19T19:06:17.193+00:00
Saurabh Sharma
23,671
Reputation points Microsoft Employee
2 answers
Datatype in Pipneline
Hello Team, I have added few columns in the source in copy activity in pipeline and in Mapping section i have mapped it to target Table. while running i am getting error : Code": 27001, "Message":…
asked 2021-02-12T19:44:07.987+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 69%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rohit Kulkarni
6
Reputation points
commented 2021-02-17T02:45:17.997+00:00
KranthiPakala-MSFT
46,422
Reputation points Microsoft Employee