pull csv file data from http

Question

Hello,
I would like to have a ADF pipeline to go to http site and pull data from the csv file which is inside the site and put the data into the database.
Probably I can use copy activity but not sure how to read data inside the csv when it is in http.
How can I do this

Thank you

Answer 1

Hello @arkiboys

I tried the HTTP url to pull some CSV data and sink the SQL DB table, i hope this helps with your initial query!

Source: Shows the HTTP endpoint dataset inside the Copy Activity.

SINK

Mapping:

HTTP connection inside the Copy Activity:

Example: the HTTP endpoint looks something like below, from which we pull the CSV data.

https://communityspacestorage.blob.core.windows.net/inbound/Salesheader.csv?sp=r&st22:35:52Z&se=2023-08-2Z&spr=https&sv=2022-11-02&sr=b&sig=FUEM%3D

Please let us know if you need further help in this matter and we would be glad to help you further!

If the response is helpful, please click "Accept Answer" and upvote it. So that we can close this thread.