Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,347 questions
4 answers
How to get data from analytics to Cosmos?
Simple: How can I make my Azure Data Lake Analytics job output to CosmosDB (Mongo API)? Apparently it can only output to a file...
asked 2020-11-09T15:41:44.153+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 80%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELF%3C/text%3E%3C/svg%3E)
Leonardo Ferreira
26
Reputation points
answered 2020-12-29T21:22:15.06+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 76%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EML%3C/text%3E%3C/svg%3E)
Marcello Leijer
1
Reputation point
1 answer
How to query a 3rd party Azure Data Lake (2nd Gen) via Shared Access Siganture (SAS URL) in Azure Synapse?
I have been granted read only access to a Vendor's azure data lake and given a SAS connect string. How can I query this data via Azure Synapse and store the results in my own data lake? fyi- The vendor's data is stored in JSON file format in this…
asked 2020-12-13T19:43:57.3+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 56.00000000000001%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ5%3C/text%3E%3C/svg%3E)
JasonW-5564
161
Reputation points
commented 2020-12-29T11:20:21.937+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 9%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HarithaMaddi-MSFT
10,126
Reputation points
0 answers
Cannot programatically Create jobs in Data Lake
I'm trying to create jobs pragmatically using C# from Visual Studio. I've created a AAD app given API Permissions for Azure Data Lake,Azure Data Catalog. Also added the AAD into Azure Data Lake Access Control. I got the samples from…
asked 2020-11-25T05:53:46.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 94%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Sibi Kumar (INFOSYS LIMITED)
1
Reputation point Microsoft Vendor
commented 2020-11-26T12:06:56.127+00:00
PRADEEPCHEEKATLA-MSFT
77,426
Reputation points Microsoft Employee
1 answer
Linked Service with ADF Connection Failing
I am attempting to connect by Azure Data Lake Analytics account with Azure Data Factory via a Linked Service. I have added the required information in the Edit linked service blade, created an app and a secret for the Service Principal ID and key, set…
asked 2020-11-02T17:23:19.58+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 73%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESC%3C/text%3E%3C/svg%3E)
Supply Chain Glass
1
Reputation point
commented 2020-11-12T20:29:42.27+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 44%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Saurabh Sharma
23,751
Reputation points Microsoft Employee
1 answer
how to calculate historical usage of resources in azure
Hi guys, Hope you all are doing well. I need a help in calculating historical usage of azure resources like increase in data in adls with respect to time, processing time of databricks cluster, adf, syanapse resources for last 30 days in azure…
asked 2020-10-26T04:46:20.047+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 21%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
Ashima Gupta
66
Reputation points
commented 2020-11-05T06:52:19.497+00:00
Ashima Gupta
66
Reputation points
1 answer
One of the answers was accepted by the question author.
How to delete specific data from files stored in Azure Data Lake
I'm migrating data sets to be stored in ADLS. After certain period I want to delete data within this data set that is more than 3yrs old. How can I do that? I do not want to delete the file, but specific data within the files.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 69%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
U-SQL support to Gen2
Hi, Would I be able to connect to Gen 2 storage using U-SQL? If so can you share documentation.
asked 2020-09-10T20:50:16.277+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 99%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJS%3C/text%3E%3C/svg%3E)
Jeeva Siva
21
Reputation points
accepted 2020-09-11T12:22:12.247+00:00
Jeeva Siva
21
Reputation points
2 answers
One of the answers was accepted by the question author.
Alter U-SQL Procedure
I have an existing stored procedure in U-SQL database and need to update additional log to it. But i cannot seem to update it, How can i update the procedure
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 57.00000000000001%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
1 answer
Upgrade Access Tier via Azure CLI or Python Code for Stoarge Account Gen2
We Want to update the access tiers in the ADLS Gen2 for Multiple paths and want to use Azure CLI or Python Code as per our requirement. According to Microsoft Documentation, We see only Portal and Power shell code to do it. Can anyone let us know if…
asked 2020-07-30T04:31:17.177+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 44%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKA%3C/text%3E%3C/svg%3E)
Kurmindla, Anusha
1
Reputation point
commented 2020-08-06T11:03:10.203+00:00
Sumarigo-MSFT
43,801
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Invalid api-version exception when submitting job to Data Lake Analytics using Azure .NET SDK
Hi, I got below exception when I tried to submit a job to Azure Data Lake Analytics using .NET SDK Code : adlaJobClient.Job.Create("ADLA Account Name", jobId, parameters) Exception : Microsoft.Rest.Azure.CloudException: 'api-version…
asked 2020-07-12T18:44:54.887+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 41%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Sravanthi598
21
Reputation points Microsoft Employee
accepted 2020-07-14T04:49:46.417+00:00
Sravanthi598
21
Reputation points Microsoft Employee
0 answers
java.io.IOException: Stream is closed! Error in HDInsight with ADLS Gen 2
I am currently using Hail for the pyspark library to perform varying operations on Genomic data in ADLS Gen 2 with an HDInsight 4.0, Spark 2.4 cluster. I have been in touch with the development team regarding this error I have been getting when running a…
asked 2020-06-29T14:55:04.947+00:00
EagleByte
1
Reputation point
commented 2020-07-10T17:49:55.523+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,381
Reputation points Microsoft Employee
1 answer
U-SQL + Python PDF file parsing.in Azure Data Lake Analytics
I need to extract data from pdf files and store values to Table, Using Data lake Analytics. Can anyone help me with some examples or procedure on how to achieve this scenario..
asked 2020-05-26T12:20:19.85+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 38%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIS%3C/text%3E%3C/svg%3E)
Ibrahim S Iqbal
1
Reputation point
commented 2020-06-18T07:06:27.943+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 76%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECM%3C/text%3E%3C/svg%3E)
ChiragMishra-MSFT
951
Reputation points
1 answer
One of the answers was accepted by the question author.
Will ADLA support ADLS v2?
Hello ADLA folks, Is ADLA planning to support ADLS v2? If so, can anyone provide an approximate date of when this will be available. Some background: We have a client who uses ADLS v2 and would prefer to use ADLA for their analytics needs. However…
asked 2020-05-14T07:25:36.397+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 57.99999999999999%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERH%3C/text%3E%3C/svg%3E)
Ramya Harinarthini_MSFT
5,306
Reputation points Microsoft Employee
accepted 2020-05-14T07:28:01.547+00:00
Ramya Harinarthini_MSFT
5,306
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to determine datetime when U-SQL Database object was compiled?
I have a few U-SQL databases that I've created in ADLA, and in each database I have compiled objects (stored procedures, table functions, views, etc.). I want to see WHEN each item was last compiled similar to how I might query sys.objects in SQL…
asked 2020-05-14T07:14:34.193+00:00
Ramya Harinarthini_MSFT
5,306
Reputation points Microsoft Employee
accepted 2020-05-14T07:19:15.293+00:00
Ramya Harinarthini_MSFT
5,306
Reputation points Microsoft Employee