Azure synapse: Copy data activity completed successfully but no files were created in ADLS Gen2

Pravin007 1 Reputation point
2022-04-28T13:35:37.493+00:00

Hi,

I have a pipeline that copies data from different data sources to ADLS. We run the pipeline (copy activity) and it executes successfully and in copy activity output its shows "file written 1" but when we check that file on ADLS, there is no file.

Do you know how to solve it?

Thanks in advance!

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,424 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,668 questions
{count} votes

3 answers

Sort by: Most helpful
  1. jhanns syr 1 Reputation point
    2023-04-10T19:35:49.1233333+00:00

    edge or ASA, copy data makes it exasperating to copy one DLG2 path\dataFile to another DLG2 path\dataFile DLG2.
    i have a fully functioning ASA Pipeline that should do this without issue. what i get is the source file rewritten in place, and the ASA copy data activity claiming success. but there is no success. there is no copy of the data file in the sink path as intended. source path, source file, sink path, sink file are all colocated on same ASA DLG2 data store. the only difference is source path and the sink path. they are distinctly different paths. this should not be. help from MS is requested.


  2. jhanns syr 1 Reputation point
    2023-04-10T20:30:54.0966667+00:00

    believe it or not specifying one ASA 'dataset' for source and a second distinct ASA 'dataset' for sink got me past this. spooky

    0 comments No comments

  3. jhanns syr 1 Reputation point
    2023-04-10T20:32:30.4266667+00:00

    Answer must be at least 10 characters. use separate ASA datasets for source, sink. that worked for me. spooky

    0 comments No comments