Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,350 questions
0 answers
Source SQL Table Have 1 column with tab spaces, unable to copy data to ADLS it shows below.
Source is SQL: One of the table contains column as below: Basic document flow "Hi Team We are separated by our margins. Because of margin collapsing, we are separated by the width of one of our margins, not both. Charles…
asked 2022-02-04T11:59:01.733+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 42%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
shanucnu8888
1
Reputation point
commented 2022-02-14T22:57:12.88+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,422
Reputation points Microsoft Employee
2 answers
The requested name is valid, but no data of the requested type was found error when renaming datalake file in C#
HI I am facing below issue when renaming a file in azure data lake using C# .net core 3.1 can any one show me a solution error The requested name is valid, but no data of the requested type was found. here is the sample code …
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,350 questions
C#
C#
An object-oriented and type-safe programming language that has its roots in the C family of languages and includes support for component-oriented programming.
10,286 questions
asked 2022-01-23T13:33:49.367+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 86%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Santhosh Kumar S
1
Reputation point
answered 2022-02-12T03:07:20.697+00:00
Santhosh Kumar S
1
Reputation point
3 answers
Need workaround to make event trigger on Datalake ADLS Gen1
I need to find out a workaround solution to trigger my ADF V2 pipeline when files are placed in data lake ADLS Gen1. So anyone tell me an alternative approach to make a workable solution. Any reference solutions or links are appreciated.
asked 2020-07-23T10:35:07.917+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 78%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Simhadri Saripalli
1
Reputation point
answered 2022-02-11T03:11:00.477+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 11%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECA%3C/text%3E%3C/svg%3E)
Chand, Anupam SBOBNG-ITA/RX
451
Reputation points
2 answers
One of the answers was accepted by the question author.
Multiple Storage Accounts for a Data lake
All, We are thinking of implementing the Zones using Storage Accounts. Which means, each of the 3 Zones (RAW, Staged, Curated) will have one Storage Account each. Are there any best practice document? Is it normal to have more than one Storage…
asked 2022-02-08T02:56:18.287+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 24%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGR%3C/text%3E%3C/svg%3E)
Gopinath Rajee
646
Reputation points
accepted 2022-02-10T09:01:19.83+00:00
Gopinath Rajee
646
Reputation points
1 answer
One of the answers was accepted by the question author.
Returning result from azure databricks to azure datafacotry
I am new to using Azure Databricks and ADF. I have a table in azure databricks. I would like to run a select query on this table and return the result of my select query to ADF. When I searched on how this can be done, I see we can use…
asked 2022-02-08T00:48:57.58+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 43%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKG%3C/text%3E%3C/svg%3E)
Karpagam Gurumurthy
41
Reputation points
accepted 2022-02-09T00:04:15.157+00:00
Karpagam Gurumurthy
41
Reputation points
1 answer
Text Qualifier in ADF BLOB Source
Hi my blob file CSV has comma as row separator , In SSIS I specify text qualifier as " However in ADF source I cant find where can i define text qualifier File is like COLA, COLB 1222, 66666 1333,"Value with comma,…
asked 2022-02-02T06:13:55.953+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 44%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Mav
81
Reputation points
commented 2022-02-08T18:01:45.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,381
Reputation points Microsoft Employee
3 answers
One of the answers was accepted by the question author.
Latest file extraction (Azure Data factory)
Hi Team, I want to extract latest file from Azure data lake store based on last modified date and want to process in another folder.Could you please someone let me know what needs to be done here if anyone has idea or implemented the same. for…
asked 2020-10-23T10:27:06.567+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 98%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPC%3C/text%3E%3C/svg%3E)
pankaj chaturvedi
86
Reputation points
commented 2022-02-08T16:06:32.427+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 27%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJK%3C/text%3E%3C/svg%3E)
John Killeen
1
Reputation point
1 answer
SFTP Enabled Azure Storage: How to assign a static public IP?
How can we assign a static public IP to the SFTP enabled storage? We currently connect using a the blob storage name, but we have clients that need to allow/add the public IP to their firewall. Thanks.
asked 2022-02-03T00:41:55.197+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 35%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Mike P
21
Reputation points
commented 2022-02-07T17:36:17.297+00:00
Sumarigo-MSFT
43,801
Reputation points Microsoft Employee
1 answer
SFTP Enabled Storage: How to sync files/data with an on-premise storage?
How to sync files/data with an on-premise storage? I've looked into Azure File Sync. However, it requires an Azure file share and NFS cannot be enabled in a SFTP storage. Please advise. Thanks
asked 2022-02-03T00:45:27.57+00:00
Mike P
21
Reputation points
commented 2022-02-07T17:31:41.5+00:00
Sumarigo-MSFT
43,801
Reputation points Microsoft Employee
1 answer
How do I get the base url for my sharepoint spreadsheet while I do a copy activity to adls
I'm copying a file from sharepoint to ADLS. When I have the source as HTTP->Excel, how can I find proper base url? I've tried couple of combinations however, I have been getting this error, Is this because my base url setting…
asked 2022-01-25T16:07:40.8+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 54%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
Pravash
21
Reputation points
commented 2022-02-07T16:55:40.193+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
0 answers
Bulk Insert from BLOB container with hierarchical namespace enabled into Azure SQL
I have an Azure Storage account setup in the SFTP preview so I can ftp files into up there. The plan was to then use that Azure blob container as an External Data Source in Azure SQL so I can process the CSVs with bulk loading on there in SQL using…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 27%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
2 answers
One of the answers was accepted by the question author.
How to autmatically copy the files to another folder in same storage account ?
Hello, We have a data lake with folders "Landing Zone" and "Target Zone". Whenever a new blob is added in "Landing Zone". we want that blob to be copied into "Target Zone" automatically. We know we can do that…
asked 2022-01-25T07:02:50.37+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 23%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
anil kumar
1,641
Reputation points
commented 2022-02-05T11:34:05.257+00:00
anil kumar
1,641
Reputation points
0 answers
using HTTP in ADF Copydata to fetch JSON File
Hi I am trying to call an API that returns JSON reponse. In COPY DATA Task I have defined an HTTP source , at linked service level in AUTH HEADERS I am passing subscription key and passing token in the URL. When I preview source data, I can see…
2 answers
ADF Copy Data JSON Source dynamic schema mapping
Hi I am working on ADF Copy data activity. HTTP Dataset is returning a JSON with the following sample JSON output { "totalRowCount": 1, "data": [ { "ProductCode": "P - 1", …
asked 2022-01-27T08:33:23.507+00:00
Mav
81
Reputation points
commented 2022-02-04T09:16:26.703+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 63%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
svijay-MSFT
5,201
Reputation points Microsoft Employee
1 answer
Can't connect to Microsoft Search Graph Connector - ADLS Gen2
We are trying to add a new “ADLS Gen2” Connector in Microsoft Search and we are receiving this error below when testing the connection. We are sure that we provided the correct Connection String from access keys within our storage account in Azure. We’ve…
asked 2021-07-01T04:59:47.21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 38%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AJGT
21
Reputation points
commented 2022-02-04T07:54:25.953+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 6%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESO%3C/text%3E%3C/svg%3E)
Slawomir Onyszkiewicz
21
Reputation points
1 answer
One of the answers was accepted by the question author.
Data Lake Design Pattern
Hi , In the below documentation on "Overview of Azure Data Lake Storage for the data management and analytics scenario", its mentioned that one should have one resource group for 3 ADLS accounts. Is it implied that as part of the…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 41%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Expose ADLS data through API for external vendors.
Hi All, any pointers where I can use REST API to expose my ADLS(parquet format) data to external vendors? If there is any out of box component on the Azure or any marketplace item, that would be great. Thank you!
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 28.000000000000004%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
where the processing units are located for Azure Data Lake Storage query acceleration?
Hi there, I have a question regarding the query acceleration processors. You can enable the feature query acceleration for to use filtering data for Azure Data Lake Storage Gen2 as this is will be on subscription based so when client application…
asked 2022-01-17T06:57:20.213+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 0%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHB%3C/text%3E%3C/svg%3E)
Hiren Bakhai
21
Reputation points
accepted 2022-02-03T21:12:41.51+00:00
Hiren Bakhai
21
Reputation points
1 answer
One of the answers was accepted by the question author.
Create External Table in Azure SQL DATABASE from ADLS Parquet files
Hello, Is it possible to create an external table in Azure SQL (not Synapse) based on the parquet file that is located on ADLS Gen2?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 31%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
1 answer
Iterative Write Operation
All, Would a rename directory (Iterative Write Operation) on a directory containing 200 files be considered one single operation or would it be considered 200 operations because there are 200 files? Thanks, grajee
asked 2022-01-31T01:47:34.337+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 51%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EG%3C/text%3E%3C/svg%3E)
grajee
341
Reputation points
commented 2022-02-03T07:51:36.073+00:00
KranthiPakala-MSFT
46,422
Reputation points Microsoft Employee