Periodical Memory issues when partially processing SSAS-tabular model

WG 51 Reputation points
2021-11-16T16:05:31.557+00:00

Hello,

We are having some problems every now and then with the daily processing of one of our SSAS tabular models, more exactly we are getting the following error sometimes:

Memory error: Memory Allocation failure . Try simplifying or reducing the number of queries. The process operation ended because the number of errors encountered during processing reached the defined limit of allowable errors for the operation. The current operation was cancelled because another operation in the transaction failed. Execution of DDL failed.

Some more information about the setup where it fails:

  • We have an SQL instance and an SSAS instance on the same server (both SQL 2019), which has a total of 80GB RAM
  • The SQL instance has a maximum server memory limit of 16GB
  • The SSAS instance has following memory settings configured:
    149886-picture1.png

Some more information about our SSAS-model:

  • It’s a Tabular model with compatibility level 1103 (we know this is an older version, but currently we can’t upgrade yet, we have this model installed with several customers, and not all of them have upgraded their servers yet and we want to avoid having to maintain several versions of the same model)
  • On disk its around 20GB
  • We process the model once a day, during the night:
    • Monday to Saturday we do a “partial processing” where we only refresh the partitions that contain the most recent data (we have split partitions per year)
      • We do this by building a dynamic XMLA script that we then execute through an SSIS “Analysis Services Execute DDL task”
    • Sunday we do a “full processing” where we refresh the whole model
      • We do this by using an SSIS “Analysis Services Processing Task”.

The fact we are getting the above error is a bit weird to us, considering:

  • We think the server / SSAS instance should have enough memory looking at the numbers
  • The processing does succeed without problems most of the time, so it doesn’t look like a structural issue
  • When it fails, its during a “partial processing”, and not during the “full processing” job, which is strange, since we would expect that the “full processing” job generates a bigger impact on the resources.

Judging by the error message, we think the problem has to do with the “Analysis Services Execute DDL task”, and that there are maybe too many partitions being processed at once (we did set the “maxparallel” parameter on 0, so the server can decide how many It can handle).

We have been thinking about trying to split the xmla script up into smaller scripts with less partitions each and then execute those in separate “Analysis Services Execute DDL tasks”, in the hope that we can avoid the above error, but maybe someone here has a better suggestion/explanation why this error concurs sometimes, and how to avoid it?

SQL Server Analysis Services
SQL Server Analysis Services
A Microsoft online analytical data engine used in decision support and business analytics, providing the analytical data for business reports and client applications such as Power BI, Excel, Reporting Services reports, and other data visualization tools.
1,344 questions
{count} votes

Accepted answer
  1. CarrinWu-MSFT 6,891 Reputation points
    2021-11-17T05:45:45.27+00:00

    Hi @WG ,

    Welcome to Microsoft Q&A!

    Please refer to this similar thread, see below:

    They suggested to increase the memory of the server to resolve this issues.

    Or

    Change the design of Tabular Model Cube to use less data.

    In addition, if you are using SQL Server Standard edition, the Maximum memory utilized per tabular instance of Analysis Services is 16GB. For more information, please refer to Scale Limits.

    Best regards,
    Carrin


    If the answer is the right solution, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.