Out-of-memory error webservice deployed with Azure ML Studio

Marco Mattioli 21 Reputation points
2020-06-22T12:02:14.117+00:00

I have a webservice which exposes a predictive model. It has been deployed with Auzure ML Studio. Since the last model re-training and webservice deployment, in circa 1% of the cases in production, I get the following out-of-memory (possibly correlated) errors:

1) "The model consumed more memory than was appropriated for it. Maximum allowed memory for the model is 2560 MB. Please check your model for issues."
2) "The following error occurred during evaluation of R script: R_tryEval: return error: Error: cannot allocate vector of size 57.6 Mb"

Please note that these errors occur exclusively while trying to consume the webservice, and not while model training, evaluation and deployment.

Also, consuming the webservice in batch mode, as suggested here, is not a viable option for our business use case.

Is there a way to increase the memory limit for Azure webservices?

Thank you

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,708 questions
0 comments No comments
{count} votes

Accepted answer
  1. GiftA-MSFT 11,161 Reputation points
    2020-06-23T12:55:13.067+00:00

    Thanks for reaching out. Currently, there's no way to increase memory limit in Classic Studio. We encourage customers to try Azure Machine Learning designer (preview), which provides similar drag and drop ML modules plus scalability, version control, and enterprise security. Furthermore, with Designer, the endpoints are deployed to AKS where no limit other than cluster resource is imposed.

    0 comments No comments

0 additional answers

Sort by: Most helpful