slow blob storage

Uziel Silva 71 Reputation points
2022-12-15T18:45:24.417+00:00

Hello good afternoon!

My BlockBlobStorage of the premium storage account with private link is very slow, the storage container is mounted on the linux VM with blobfuse2, and the reading/writing process is very slow. Can you help me with this?

region: South Africa North

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,119 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Uziel Silva 71 Reputation points
    2022-12-20T12:14:37.553+00:00

    Hello good day!

    I attach a simplified diagram where I use VMSS in my Web layer, a Mysql PaaS and a blob with a private link, with a mount point configured with blobfuse2.

    -If you have configured local file-caching for Blobfuse and if so, are you caching small or large files?

    • Yes, I initially configured the ephemeral disk cache in path: /mnt/resource/blobfuse2tmp, and configured it for smaller files as shown in my conf.yaml below: -`file_cache:
      path: /mnt/resource/blobfuse2tmp
      timeout-sec: 120
      max-size-mb: 4096
      no-symlinks: true

    -Have you tried using an SSD for caching for high performance?

    • SSD ephemeral disks

    I performed a "time cp -Rpv" test between the VMSS and the Blob of an ~80Mb directory with several small files, and I got a time of approximately:

    real 0m38.500s

    With this result my application is extremely slow:
    272502-diagram.png

    I will activate Blobfuse2 Health Monitor as you suggested.

    0 comments No comments

  2. Uziel Silva 71 Reputation points
    2022-12-20T12:27:00.607+00:00

    I got good performance with the following scenario:

    1- I created a Proximity Placement Groups

    2- Added VMSS in PPG

    3- I created a new VM in place of the storage, configured it as an NFS server with a Premium SSD disk, presented an NFS mount point to the VMSS and added it to the PPG

    4- Enabled accelerated networking on VMSS and VM Storage

    I did a new test "time cp -Rpv", and got very good results as below:

    real 0m8.500s
    user 0m0.284s
    sys 0m2.065s

    But I would like to use blob storage instead of VM, it seems to me that there is no way to insert storage in PPG

    With this test it seems to me a latency problem with the storage, is there a way to improve this?


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.