USQL Datalake Question

DSM 1 Reputation point
2020-08-05T06:13:06.693+00:00

Is there anyway to backup the partition files of usql table? Or the only way is to import the data to csv file.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,480 questions
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,091 Reputation points
    2020-08-07T22:51:54.997+00:00

    @DSM
    I created a table with partitions by using these examples with Data Lake Analytics in the portal.

    Then in the portal I used the Data Explorer to locate and download the partition files. They are located under:
    Root > Catalog > Database > {UID} > Schema > {UID} > Table > {UID}

    The UID's are not easy to read, but I did find a correlation.

    When I looked up the details of the query run which inserted the data , I found the corresponding file location.
    Specifically,
    Root > System > Jobservice > Jobs > USQL > {year} > {month} > {day} >{UID} > SystemInternalInfo.xml
    Then I searched for "write", and found the filepath it wrote to.
    The path starts with
    adl://{name}.azuredatalakestore.net/catalog/...


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.