I have pod, which copied 800 MB file to PVC (Azure file premium), but it exactly stops @ 564 MB

Naveen naidu 5

I have a pod, which copies an 800 MB file to PVC (Azure file premium), but it exactly stops @ 564 MB, is there any limit for this, or should we modify anything else

shiva patpi 13,141 Reputation points Microsoft Employee

2023-02-17T18:39:41.1133333+00:00

Helo @naveen naidu ,

Does this repro every time ?

I just tried a simple scenario of manually copying a 1.5 GB file from the pod to azure file mount share and it was fast and the whole file got copied successfully. As per my tests it seems there is no limit.

Can you kindly check the logs of the corresponding pod csi-azurefile-node-* which is deployed on the same node as that of your application.

Also while copy is in progress , take a tcpdump and try to analyse the traffic pattern.

https://learn.microsoft.com/en-us/troubleshoot/azure/azure-kubernetes/packet-capture-pod-level

Regards,

Shiva.
Naveen naidu 5 Reputation points

2023-02-18T03:55:25.1166667+00:00

Hi Shiva,

Thanks for the update, can you please try my scenario

I have a pod with a docker entry point (it copies the application files from /tmp directory to the/var/www/html directory), I have PVC with the same name /var/www/html created using azure-file share, once the pod is initialized it copies the application files
shiva patpi 13,141 Reputation points Microsoft Employee

2023-02-18T06:53:36.91+00:00

Naveen - To implement the exact scenario, I might need your docker file and YAML file

Naveen naidu 5

apiVersion: apps/v1
kind: Deployment
metadata:
  name: nginx-deployment-3
  #namespace: new
spec:
  replicas: 1
  selector:
    matchLabels:
      app: frontend
  template: 
    metadata: 
      name: frontend 
      labels: 
        app: frontend      
    spec:
      #securityContext:
       #runAsUser: 33
       #runAsGroup: 33
       #fsGroup: 33
      containers:
         - name: magento-setup
           #command: ["/magento-setup/magento-install.sh"]
           image: naveenlinuxawsguy/mag4:11
           #image: naveenlinuxawsguy/magento-updated


           #envFrom:
           #- configMapRef:
              #name: m2-web-cm
           #image: naveenlinuxawsguy/magfeb
           #image: nabad600/magento-k8s-magento:2.4.5
           ports:
            - containerPort: 80
            - containerPort: 9000
           volumeMounts:
           - name: web
             mountPath: "/var/www/html/magento"
             subPath: "magento"
           - name: web
             mountPath: "/etc/nginx"
             subPath: nginx
           - name: web
             mountPath: "/etc/php/8.1/fpm"
             subPath: "php"
           resources:
            requests:
             memory: "512Mi"
             cpu: "500m"
            limits:
             memory: "1536Mi"
             cpu: "500m" 
      
     
 
      volumes:
        - name: web
          persistentVolumeClaim:
            claimName: magento-pvc-42
        #- name: nginx-config
          #persistentVolumeClaim:
            #claimName: magento-pvc-2
        #- name: php-config
          #persistentVolumeClaim:
            #claimName: magento-pvc-1
          
          
---      

apiVersion: v1
kind: Service
metadata:
  name: magento-service-1
  #namespace: new
  labels: 
    app: frontend  
spec:
  type: LoadBalancer
  selector:
    app: frontend
  ports:
    - name: http
      protocol: TCP
      port: 80
      targetPort: 80

Naveen naidu 5 Reputation points

2023-02-20T09:09:54.46+00:00

@shiva please implement the yaml, change the PVC only, and let me know the results
shiva patpi 13,141 Reputation points Microsoft Employee

2023-02-25T21:02:59.81+00:00
@naveen naidu , Deployed your application along with the PVC & Deployment and it's in running state & I can see that the files are getting copied to fileshare.

For which file I have to see the size ? Right now, the pod is still in running state with out any errors . So which file I need to track which is of 800 MB size ?
Naveen naidu 5 Reputation points

2023-02-27T12:54:32.07+00:00

hi Shiva, thanks for your efforts, I found out that it copies 800 MB only, but due to disk fragmentation it shows 564 MB
shiva patpi 13,141 Reputation points Microsoft Employee

2023-02-28T07:05:58.2266667+00:00
@naveen naidu It seems you found the cause of the issue. Kindly let us know if you need any additional help from our end.