data deduplication optimization job is being cencelled in few secinds

Hi，

why i started the thread ! the Server is working with same amount of RAM (8GB) from several years and from last 6 months data size is almost same. the Dedup was working perfectly fine but from last 30-40 days it is failing. so i am trying to figure out if it is a Memory leak issue.

According to the error message and theoretically, it should be no enough memory issue. And although it could work before, after some performance of add, delete, modify, open, close of the files, the situation will be changed.

While, it is understandable that you suspect there is a memory leak, the easiest way to monitor if there's a memory leak is to check if the total memory is getting less. If you want to get a definite answer about memory leak, it's recommended to open a case with MS to troubleshoot the memory leak.

Below is the link to open case with MS:

https://support.microsoft.com/en-us/gp/customer-service-phone-numbers

Thanks for your time!
Best Regards,
Anne

-----------------------------

If the Answer is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

Hi Anne,

the recommended memory allocation is 25 to 50% of the total RAM for Dedup operation, i tried to increase it to 90% but result was same.

before the Dedup job start, the system is using approximate 30% and after the job run it reaches 95% in few minutes and job fails.

i can understand the RAM is not enough as MS documentation says that system need 1GB of RAM for each 1TB of data to dedup. in this calculation i need 12 GB of free RAM..

why i started the thread ! the Server is working with same amount of RAM (8GB) from several years and from last 6 months data size is almost same. the Dedup was working perfectly fine but from last 30-40 days it is failing. so i am trying to figure out if it is a Memory leak issue.

Hi,

1. Please check if the volume we want to optimize has free space.
2. Please check if the RAM is enough for the job. By default a server will limit the RAM used by the optimization job to 50% of total RAM in the server. So if the above server had just 4 GB RAM, then only 2 GB would be available for the optimization job. You can manually override this:

Start-Dedupjob <volume> -Type Optmization -Memory <50 to 80>

Usually, 1-2 GB RAM is used per 1 TB of data per volume. For example:

Volume Volume size Memory used
Volume 1 1 TB 1-2 GB
Volume 2 1 TB 1-2 GB
Volume 3 2 TB 2-4 GB
Total for all volumes 1+1+2 * 1GB up to 2GB 4 – 8 GB RAM

https://aidanfinn.com/?p=15866

(Please note: Information posted in the given link is hosted by a third party. Microsoft does not guarantee the accuracy and effectiveness of information.)

Thanks for your time!
Best Regards,
Anne

-----------------------------

If the Answer is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.