Resource file gives me BlobDownloadMiscError - FileIOException
I'm getting the following error in Batch when I submit a job. The job contains a task that runs a docker compose file. I specify several resource files as links to files in Blob storage. When I submit the job to a fresh pool, it works fine. However, sending another job (with a different name, but the same content) to the same pool, gives me this error:
FileIOException('Failed to allocate 114 bytes for file /mnt/batch/tasks/workitems/<file omitted>')
At first, I thought this might be the node running out of space. However, when I SSH into the node, and check free space, I see:
admin@<node-ip>:/mnt$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/root 124G 25G 99G 21% /
devtmpfs 56G 0 56G 0% /dev
tmpfs 56G 0 56G 0% /dev/shm
tmpfs 12G 1.1M 12G 1% /run
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 56G 0 56G 0% /sys/fs/cgroup
/dev/loop0 64M 64M 0 100% /snap/core20/2015
/dev/loop1 41M 41M 0 100% /snap/snapd/20290
/dev/loop2 92M 92M 0 100% /snap/lxd/24061
/dev/loop3 64M 64M 0 100% /snap/core20/2264
/dev/sdb15 105M 6.1M 99M 6% /boot/efi
/dev/loop4 41M 41M 0 100% /snap/snapd/20671
/dev/sda1 251G 84G 155G 35% /images/disk1
/dev/sdc1 724G 29M 687G 1% /mnt
tmpfs 12G 0 12G 0% /run/user/1004
/mnt
has plenty of free space available. I also tested creating a large file in the same location in my SSH session, which worked fine. Why can't Batch allocate space for my resource file?