Data Factory and urls as source

Victor Prasad 41 Reputation points
2022-04-08T17:22:49.547+00:00

Hello,

This is a noob'ish question.

I use DF to copy files from a shared network folder to an and Azure Blob.

Now I am being asked to copy and image from a url to a Blob container

Can I use a source public site, like https://<somesite.com>/Picuture.png
and have it copy to the blob via DF?

(Permission has been granted by the source site owners for my use)

Thanks,

V

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,535 questions
{count} votes

Accepted answer
  1. HimanshuSinha-msft 19,376 Reputation points Microsoft Employee
    2022-04-11T21:56:01.52+00:00

    Hello @Victor Prasad ,
    Thanks for the question and using MS Q&A platform.
    As we understand the ask here is copy images to a blob container , please do let us know if its not accurate.
    You can use the copy activity with the biinary formay and that shoule do the trick .
    https://learn.microsoft.com/en-us/azure/data-factory/format-binary

    This is what I tried which worked for me .

    I tried to copy the image : https://images.unsplash.com/photo-1591154669695-5f2a8d20c089?ixlib=rb-1.2.1&ixid=MnwxMjA3fDB8MHxzZWFyY2h8M3x8dXJsfGVufDB8fDB8fA%3D%3D&auto=format&fit=crop&w=500&q=60

    Steps

    1. Created a new ADF pripiline and used a copy activity .
    2. Created a new http Linked servive pointing to https://images.unsplash.com .
      192043-image.png
    3. On the Source side , please create a new dataset of Type HTTP and format as Binary .
      192010-image.png
      192015-image.png
    4. On the sink side please create a linked service for blob and create a sink dataset with the format as binary .
    5. Thats It I was able to copy the image to a blob .This is waht you should see on the blob container .
      192044-image.png

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

0 additional answers

Sort by: Most helpful