Share via

USQL Datalake Question

DSM 1 Reputation point
2020-08-05T06:13:06.693+00:00

Is there anyway to backup the partition files of usql table? Or the only way is to import the data to csv file.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,389 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. MartinJaffer-MSFT 26,041 Reputation points
    2020-08-07T22:51:54.997+00:00

    @DSM
    I created a table with partitions by using these examples with Data Lake Analytics in the portal.

    Then in the portal I used the Data Explorer to locate and download the partition files. They are located under:
    Root > Catalog > Database > {UID} > Schema > {UID} > Table > {UID}

    The UID's are not easy to read, but I did find a correlation.

    When I looked up the details of the query run which inserted the data , I found the corresponding file location.
    Specifically,
    Root > System > Jobservice > Jobs > USQL > {year} > {month} > {day} >{UID} > SystemInternalInfo.xml
    Then I searched for "write", and found the filepath it wrote to.
    The path starts with
    adl://{name}.azuredatalakestore.net/catalog/...