@Karthik Elavan Hello and welcome to Microsoft Q&A.
As I understand, you have a pipeline in DEV environment. This pipeline uses parameter for name of notebook in Azure Databricks Notebook activity. In DEV this works well in DEBUG. In DEV does it work as Trigger Now, or Scheduled Trigger?
I understand after moving from DEV to PROD, the sceduled trigger run reports error as URI is empty
. Does DEBUG work in PROD?
I am trying to separate 2 issues. Working DEBUG vs triggered. Working DEV vs PROD.
The URI is empty
suggests the notebook name is empty, which means the value is not getting passed in. Since the value is given to the pipeline from the trigger, we should look at the trigger definition.
Find the trigger definition under "Manage" > "Triggers" > {}
In the trigger definition, look for "pipelines". This is the list of pipelines the trigger is used by. Find your pipeline by its "referenceName". Check for "parameters", as this details the parameter name & value. I suspect this is where the problem lies.
If you cannot find the parameter, or the value is blank, this is the cause of the problem.
You can also get this info from the Pipeline authoring screen by "Trigger" > "New / Edit" > my trigger > number of parameters.
Let me know if this helps or not. There could be another cause, which is why I wanted to separate the 2 problems. Is the parameter being overwritten or erased when you go from DEV > PROD?