copy .bak file to datalake using datafactory

Laxmi Kakarlapudi 21 Reputation points
2021-10-21T23:12:02.94+00:00

Hello everyone,

I have a scenario, where I use azure webactivity to get url to download .bak file. One of our source providers provide sql data as a .bak file. I am using webactivity using api key to get url. Once I get the url how to copy data to datalake. Since it is .bak file will adf restore the data?

Here are the details of the pipeline.

  1. azure webactivity. Use api key and get method I acquire url.
  2. how to use this url to copy data to datalake?

second step I know how
to manually download .bak file and restore it sql server. Same concept how can I apply to restore data into datalake.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,101 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,602 Reputation points Microsoft Employee
    2021-10-22T16:45:50.61+00:00

    Hi @Laxmi Kakarlapudi ,

    Thanks for using Microsoft Q&A forum and posting your query.

    You can follow this article published by community volunteer : Downloading a CSV File from an API Using Azure Data Factory

    In the above article they are downloading the CSV file but for you to download a .bak file you will have to create a binary dataset and use it in HTTP connector in your copy activity source and in the sink also you will have to use a binary dataset.

    Please note: When using Binary dataset, the service does not parse file content but treat it as-is. When using Binary dataset in copy activity, you can only copy from Binary dataset to Binary dataset.

    Hope this info helps. Do let us know how it goes.

    ----------

    • Please don't forget to click on 130616-image.png and upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.