UNZIP large zip file in azure machine learning

H C D 1 Reputation point
2021-02-04T09:35:52.16+00:00

I have a big zip file, I need to unzip it in order to use the files in my notebook

I used this script in my notebook :

import os
import zipfile
local_zip = 'Caltech101.zip'
zip_ref = zipfile.ZipFile(local_zip, 'r')
zip_ref.extractall('Caltech101')
zip_ref.close()

it succeeded (green v in the notebook), but only the first two folders were unzipped.
this file is only 130 MB
I also need to unzip 3 GB zip file

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,611 questions
{count} votes

1 answer

Sort by: Most helpful
  1. GiftA-MSFT 11,151 Reputation points
    2021-02-05T18:20:48.12+00:00

    Thanks for following up. Can you please try available public datasets in this dataset repository to determine if you experience the same issue? If you're able to upload other files to Azure ML Notebook and unzip them successfully, then the issue is most likely related to your file content/format.