Azure data lake storage Gen2 error external location not found

Larry Feng 21 Reputation points
2020-07-17T21:04:55.303+00:00

I used COPY INTO statement to copy csv file in ADLS Gen2 to Synapse table successfully with share access signature as credential. However, when I try to copy snappy.parquet file in the same storage account (different container) into a table in the same data warehouse, got error: "Not able to validate external location because The remote server returned an error: (404) Not Found.".
my code is:

CREATE EXTERNAL FILE FORMAT pqt
WITH (
FORMAT_TYPE = PARQUET
,DATA_COMPRESSION = 'org.apache.hadoop.io.compress.SnappyCodec'
);
COPY INTO [dbo].table
FROM 'https://mystorage.dfs.core.windows.net/../*.parquet'
WITH
(
FILE_FORMAT =pqt
,CREDENTIAL=(IDENTITY= 'Shared Access Signature', SECRET='sas token') )
Do you know how to solve this issue?

Thanks

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,337 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,358 questions
0 comments No comments
{count} votes

Accepted answer
  1. HarithaMaddi-MSFT 10,126 Reputation points
    2020-07-20T11:49:09.663+00:00

    Hi @leonfeng-5667,

    Welcome to Microsoft Q&A Platform.

    Thanks for posting the question. Yes, I reproduced and faced the same issue. Though it is Gen2 storage account, modifying this https://mystorage.dfs.core.windows.net/../*.parquet' to https://mystorage.blob.core.windows.net/../*.parquet' in COPY INTO statement is working for Parquet file.

    I will work with Product team to understand the issue and will share more details with you.

    Hope this helps.

    Do click on "Accept Answer" and Upvote on the post that helps you, this can be beneficial to other community members.


2 additional answers

Sort by: Most helpful
  1. Anonymous
    2020-07-20T14:25:06.547+00:00

    files.autoSave


  2. Girijesh Pandey 1 Reputation point
    2020-07-29T14:43:14.813+00:00

    Dear @Anonymous ,

    Thanks for this question, i understand your question well and this is great case to test the coverage of the product.
    It seems to me, this is yet not launched in Azure space, however let's wait to hear from Microsoft internal product team.

    Regards,
    Girijesh

    0 comments No comments