How to copy HTTP zip file to azure blob

Question

I am running into issue while copying data from http link to azure blob.

HTTP zip file : http://en.www.inegi.org.mx/contenidos/programas/pibo/2013/datosabiertos/eopibt_trimestral_csv.zip

I am able to view the data in the dataset, but getting below mentioned error when running the pipeline.

Operation on target Copy data1 failed: Failure happened on 'Sink' side. ErrorCode=HttpFileFailedToRead,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to read data from http server. Check the error from http server：Unable to connect to the remote server,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 200.23.8.41:80,Source=System,'

Please suggest how to resolve this issue

Answer 1

Hi @Pandey, Aman ,

Welcome to Microsoft Q&A Platform. Thank you for posting query here.

I Copy of Zip file from below link to blob storage using Copy activity. Its working fine. You need to use HTTP Connector source dataset inside copy activity.
HTTP connector is generic to retrieve data from any HTTP endpoint, e.g. to download file.

HTTP zip file : http://en.www.inegi.org.mx/contenidos/programas/pibo/2013/datosabiertos/eopibt_trimestral_csv.zip

Please check below detailed example.

Step1: Copy activity, Source tab HTTP connector type data set. Used "ZipDeflate(.zip)" compression type as our file is .zip type

Step2: Copy activity, Sink tab Blob connector type dataset. Used "None" as compression type.

Step3: Execute pipeline and see results.

Please Note: In above example I unzipped file while loading in to blob storage. If you would like to load .zip file as is in to blob, then use compression type as "none" in both source and sink datasets.

Hope this will help. Please let us know if any further queries.

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators