Kernel crash trying to get a data asset from a blob storage

Question

I am working in a workspace (Azure Machine Learning) with another user (let's call him U1). We have the same compute instance (Standard_E4ds_v4) which were created by the same user (U1).

I am trying to access a data asset, a parquet files which is hosted in default workspace blob store. This file was created by U1.

This data asset got two version. The first version got a size of 12.18KB. The other version, a size of 991.44 MB.

I can access the first version, but when I fetch the other one, I get a message of Kernel crashed such as:
'The Kernel crashed while executing code in the current cell or a previous cell.'

I don't understand why my kernel crash since when the other user U1 run the exact same code, he has access to this version. We could try upgrading the type of compute instance, but I doubt this is the problem since U1 got the exact same type and can access it. Furthermore, the file size is less than 1GB. This instance type got 32GB RAM and 150GB storage (which is less than half used).

Both of us got Contributor role for this workspace. U1 also have Key Vault Administrator, but I don't see where this could have an impact on accessing files through data assets.

Answer 1

Hello @Mathieu Lussier , thanks for confirming that. There could be many reasons causing this issue. It is possible that the kernel is crashing due to memory issues when trying to load the large file. Try checking Memory Usage.

You can do by restarting the kernel and selecting a different compute instance with more memory.