Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Deploying Azure Data Factory error (The number of template input parameters limit exceeded. Limit: '256') using DevOps pipeline
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 44%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFV%3C/text%3E%3C/svg%3E)
Ferran Vidal
1
Reputation point
Hello experts,
I'm doing a deploy of Azure Data Factory using a DevOps pipeline but I've reached the maxiumum of parameters, 256 and I'm gotting an error each time. I've read a lot of forums and docs and seems that the solution is to use "Linked Templates". So, I've tried to use this "Linked templates" that ADF automatically generate (ArmTemplate_n.json + ArmTemplate_master.json) but I got the same error of "too much parameters". Actually, the parameters file inside Linked templates (ArmTemplateParameters_master.json) folder have also 256 parameters. So, the error is coherent. I don't understand why the "parameters" are not splitted like there are the templates. There is a way to split also the parameters files? How should we do that?
Another question is, should we avoid to use so many parameters? Its not efficient? From my perspective is useful and I feel comfortable with it.
Thanks in advanced,
Wich is the best option to make this deploy work?
Azure Data Factory
{count} votes
-
ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator2021-07-20T12:58:58.01+00:00 Hi @Ferran Vidal ,
Welcome to Microsoft Q&A Platform. Thank you for posting your query here.
Parameters limit 256 is limitation on the product. There are work arounds to avoid that, it seems you tried to follow them right?
Could you please help us by sharing your solution implementation what you did so far. So that we can try to debug it and see where and what you are missing?
Thank you.
-
ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator
2021-07-26T05:44:09.61+00:00 Hi @Ferran Vidal ,
Following up to check did you get change share details on requested query? Thank you.
-
ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator
2021-07-30T05:42:09.257+00:00 Hi @Ferran Vidal ,
Just checking did you get change share details on requested query? Thank you.
-
Ferran Vidal 1 Reputation point
2021-08-25T14:13:15.057+00:00 Hello @ShaikMaheer-MSFT ,
Thanks for your response. Let me give you more details about the deployment I'm trying to do.
I'm using a release pipeline inside Azure DevOps to make the deployment of an Azure Data Factory from one subscription to another subscription.
I'm nos using the yaml approach to make this pipeline but the template approach connecting 'boxes'. As a 'artifact' I'm using a connection to the Azure DevOps Git repo where I have ADF connected. Regarding the 'stages' of the pipeline, I'm using 3 stages:
1st: stop all triggers with PowerShell and recap all the resources on the origin subscription
2nd: ARM Template deployment (https://github.com/microsoft/azure-pipelines-tasks/blob/master/Tasks/AzureResourceManagerTemplateDeploymentV3/README.md)
3rd: start all triggers with PowerShell and delete all the resources in the destination that are not present in the origin adf.
I'm getting an error on the stage 2 where its says that I have too much parameters.
I've tried to make an script to replace the parameters on the original ARM template and deploy the result but I'm stuck in some of the details of this powershell script because the ARM template that I'm getting (the json) seems to be not 100% correct.
Any ideas? The idea to make the substitution of the parameters on the original template seems good but I couldn't make it work.
Wich other alternative do I have? or could you help me with the script?
Please, if you need more information let me know.
Thanks for your help,
Ferran -
ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator
2021-08-27T06:05:12.773+00:00 Hi @Ferran Vidal ,
Kindly check below link where similar parameters related issue discussed.
https://social.msdn.microsoft.com/Forums/azure/en-US/6308cb5a-84d2-4c0a-aec0-d15d0a134693/adf-cicd-exceeding-maximum-number-of-template-parameters?forum=AzureDataFactoryCustom Parameters are useful when your data factory has grown so huge that you exceed the 256 parameter limit.
Kindly check below links to know details about ARM template structures and make sure your script output template adheres to them.
Sign in to comment
Sign in to answer