Resource file gives me BlobDownloadMiscError - FileIOException

Raphael Norman-Tenazas 0 Reputation points
2024-04-11T19:44:17.07+00:00

I'm getting the following error in Batch when I submit a job. The job contains a task that runs a docker compose file. I specify several resource files as links to files in Blob storage. When I submit the job to a fresh pool, it works fine. However, sending another job (with a different name, but the same content) to the same pool, gives me this error:

FileIOException('Failed to allocate 114 bytes for file /mnt/batch/tasks/workitems/<file omitted>')

At first, I thought this might be the node running out of space. However, when I SSH into the node, and check free space, I see:

admin@<node-ip>:/mnt$ df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       124G   25G   99G  21% /
devtmpfs         56G     0   56G   0% /dev
tmpfs            56G     0   56G   0% /dev/shm
tmpfs            12G  1.1M   12G   1% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs            56G     0   56G   0% /sys/fs/cgroup
/dev/loop0       64M   64M     0 100% /snap/core20/2015
/dev/loop1       41M   41M     0 100% /snap/snapd/20290
/dev/loop2       92M   92M     0 100% /snap/lxd/24061
/dev/loop3       64M   64M     0 100% /snap/core20/2264
/dev/sdb15      105M  6.1M   99M   6% /boot/efi
/dev/loop4       41M   41M     0 100% /snap/snapd/20671
/dev/sda1       251G   84G  155G  35% /images/disk1
/dev/sdc1       724G   29M  687G   1% /mnt
tmpfs            12G     0   12G   0% /run/user/1004

/mnt has plenty of free space available. I also tested creating a large file in the same location in my SSH session, which worked fine. Why can't Batch allocate space for my resource file?

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
302 questions
{count} votes