How to start a existing trigger in adf programmatically, using Python? or any best solution?

Rajesh Gopisetti 5

How to start a existing trigger in adf programmatically. When i am creating trigger thru code it is in stopped status. I tried patch as well as begin_start and both are not working here. I used patch with runtime State to Started with REST API it is not working and begin_start also not working. I also tried start?api in url and post method also not working. Please help me in this.

Rajesh Gopisetti 5 Reputation points

2023-08-11T16:53:26.46+00:00

I am using python sdk to execute the script

i was able to create a schedule trigger using python and after creating i can see the status of trigger in adf as stopped.

Now i want to start the above trigger created.

I didn’t see any error message after executing the below snippet. But no change in trigger state.

region: east US2

snippet:

trigger_url = f"{base_url}/subscriptions/{subscription_id}/resourceGroups/{resource_group}/providers/Microsoft.DataFactory/factories/{factory_name}/triggers/{trigger_name}/start?api-version=2018-06-01"

response = requests.post(trigger_url, headers=headers)

using start in Url to make it to start using Rest API. However still trigger is in stopped status.

pls help me to make the trigger active/start
QuantumCache 20,261 Reputation points

2023-08-11T20:42:13.8433333+00:00

@Rajesh Gopisetti is the Trigger Published?

Amira Bedhiafi 22,691

You can achieve that through Azure SDK or REST API. I see you've tried several methods, but without specific error messages or code examples, it's difficult to pinpoint the exact issue.

Below, I'll outline a method using Azure SDK for Python, and another using REST API, to start an existing trigger.

Using Azure SDK for Python

Make sure you have the SDK installed:


pip install azure-mgmt-datafactory

Then you can use the following code:


from azure.identity import DefaultAzureCredential

from azure.mgmt.datafactory import DataFactoryManagementClient

# Authenticate using default Azure credentials

credential = DefaultAzureCredential()

adf_client = DataFactoryManagementClient(credential, "<subscription-id>")

# Resource Group and Data Factory names

resource_group_name = "<resource-group-name>"

data_factory_name = "<data-factory-name>"

trigger_name = "<trigger-name>"

# Start the trigger

adf_client.triggers.begin_start(resource_group_name, data_factory_name, trigger_name)

Using REST API

You can also start a trigger using the REST API by making a POST request to the endpoint for starting a trigger:


POST https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.DataFactory/factories/{factoryName}/triggers/{triggerName}/start?api-version=2018-06-01

Here's an example using cURL:


curl -X POST "https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.DataFactory/factories/{factoryName}/triggers/{triggerName}/start?api-version=2018-06-01" \

     -H "Authorization: Bearer {access_token}"

Rajesh Gopisetti 5 Reputation points

2023-08-14T13:00:18.74+00:00

I need to publish the trigger but it should be done manually right??

is there a way to publish the changes programmatically??

if yes please let me know
Rajesh Gopisetti 5 Reputation points

2023-08-14T13:07:11.2666667+00:00

I need to publish the Trigger changes. But i need to do it manually right thru UI ADF portal??

I want to publish the changes programmatically. Could you please help me in publishing programmatically
QuantumCache 20,261 Reputation points

2023-08-16T15:33:30.06+00:00

Hello @Rajesh Gopisetti, I am looking into this, sorry for the delayed response. Please stay tuned.
Rajesh Gopisetti 5 Reputation points

2023-08-16T16:00:17.2233333+00:00

Thank you Satish

i am looking for python or Rest api call code which i can execute thru python programming

not from powershell just a headsup for you
QuantumCache 20,261 Reputation points

2023-08-16T18:17:03.59+00:00

Hello @Rajesh Gopisetti, Thanks for the heads-up, i am working on this. Will keep you posted.
Rajesh Gopisetti 5 Reputation points

2023-08-22T06:43:28.5933333+00:00

Any update pls

i am able to create a trigger but it is getting created in stopped status

i tried start command in rest api url but nothing is happening like not at all starting.
QuantumCache 20,261 Reputation points

2023-08-22T21:41:39.8533333+00:00

Hello @Rajesh Gopisetti

Did you try to create the Trigger via Python?

Could you please share more details!
Rajesh Gopisetti 5 Reputation points

2023-08-24T13:27:07.3333333+00:00

Yeah i ran the python code to had the trigger created. Trigger got created but it is in Stopped state.

I used rest api start in url but it is not starting the trigger
QuantumCache 20,261 Reputation points

2023-08-24T14:15:12.5066667+00:00

Hello Rajesh Gopisetti
Thanks for the update, we are looking into this issue.
Rajesh Gopisetti 5 Reputation points

2023-08-28T10:08:45.89+00:00

Any update pls

1 answer

QuantumCache 20,261

Hello @Rajesh Gopisetti Welcome to QnA forum,

What programming language are you using here? Any sample code snippets or any documentation you have followed?
Please add screenshots of your trigger logs if they are available? any error logs? either form your code execution or from Azure portal?

Any Firewall issues?

Is this intermittent issue?

Any API version issue?
What is the Trigger Type?

Azure Region?

def main():

    # Azure subscription ID
    subscription_id = '597e'  
    rg_name = 'MyRG'

    df_name = 'msce'

    # Specify your Active Directory client ID, client secret, and tenant ID
    credentials = ClientSecretCredential(client_id='1f52', client_secret='2i', tenant_id='c8') 
    resource_client = ResourceManagementClient(credentials, subscription_id)
    adf_client = DataFactoryManagementClient(credentials, subscription_id)

# Create a trigger
   
    adf_client.triggers.create_or_update(  resource_group_name="MyRG",
        factory_name="msftCommunityspace",
        trigger_name="ETFTrigger",
        trigger={
            "properties": {
                "pipelines": [
                    {
                        # "parameters": {"OutputBlobNameList": ["exampleoutput.csv"]},
                        "pipelineReference": {"referenceName": "MonitorPipelineTriggers", "type": "PipelineReference"},
                    }
                ],
                "type": "ScheduleTrigger",
                "typeProperties": {
                    "recurrence": {
                        "endTime": "2018-06-16T00:55:13.8441801Z",
                        "frequency": "Minute",
                        "interval": 4,
                        "startTime": "2018-06-16T00:39:13.8441801Z",
                        "timeZone": "UTC",
                    }
                },
            }
        },)
#  Start A Trigger
    adf_client.triggers.begin_start(
        resource_group_name="MyRG",
        factory_name="mse",
        trigger_name="ETFTrigger",
    ).result()
# Start the trigger
# adf_client.triggers.start(rg_name, df_name, tr_name)

# Start the main method
main()

The trigger will be created and published, you may try to edit the trigger from the portal and you may see the publish option. But the above script creates the trigger and publishes. User's image

If the response is helpful, please click "Accept Answer" and Click 'Yes' (For Short Survey). So that we can close this case.

QuantumCache 20,261

Hello @Rajesh Gopisetti

Sorry For the delay, here is the Python Code snippet which creates a trigger and then starts it.

I hope this helps with your initial query.

def main():

    # Azure subscription ID
    subscription_id = '597e'  
    rg_name = 'MyRG'

    df_name = 'msce'

    # Specify your Active Directory client ID, client secret, and tenant ID
    credentials = ClientSecretCredential(client_id='1f52', client_secret='2i', tenant_id='c8') 
    resource_client = ResourceManagementClient(credentials, subscription_id)
    adf_client = DataFactoryManagementClient(credentials, subscription_id)

# Create a trigger
   
    adf_client.triggers.create_or_update(  resource_group_name="MyRG",
        factory_name="msftCommunityspace",
        trigger_name="ETFTrigger",
        trigger={
            "properties": {
                "pipelines": [
                    {
                        # "parameters": {"OutputBlobNameList": ["exampleoutput.csv"]},
                        "pipelineReference": {"referenceName": "MonitorPipelineTriggers", "type": "PipelineReference"},
                    }
                ],
                "type": "ScheduleTrigger",
                "typeProperties": {
                    "recurrence": {
                        "endTime": "2018-06-16T00:55:13.8441801Z",
                        "frequency": "Minute",
                        "interval": 4,
                        "startTime": "2018-06-16T00:39:13.8441801Z",
                        "timeZone": "UTC",
                    }
                },
            }
        },)
#  Start A Trigger
    adf_client.triggers.begin_start(
        resource_group_name="MyRG",
        factory_name="mse",
        trigger_name="ETFTrigger",
    ).result()
# Start the trigger
# adf_client.triggers.start(rg_name, df_name, tr_name)

# Start the main method
main()

The trigger will be created and published, you may try to edit the trigger from the portal and you may see the publish option. But the above script creates the trigger and publishes. User's image

Rajesh Gopisetti 5 Reputation points

2023-08-30T14:07:51.5466667+00:00

Hi Satish,

thanks for the response but i see no pipeline name is passing in this code and also while executing same code i am getting error as

invalid reference “monitorpipelinereferences”
Rajesh Gopisetti 5 Reputation points

2023-08-30T14:11:52.0066667+00:00

Thank you so much satish

i replace monitorpipelineparameters with my pipeline name and trigger is getting created in started status

my problem resolved

omg thank you for your help
QuantumCache 20,261 Reputation points

2023-08-30T18:44:34.9633333+00:00

Hello @Rajesh Gopisetti Glad to hear the issue is now resolved.

If the response is helpful, please click "Accept Answer" and Click 'Yes' (For Short Survey). So that we can close this case.
QuantumCache 20,261 Reputation points

2023-09-01T01:38:32.5033333+00:00

Hello @Rajesh Gopisetti Please click "Accept Answer" So that we can close this case.
QuantumCache 20,261 Reputation points

2023-09-06T00:26:01.87+00:00

Hello @Rajesh Gopisetti Hope you are doing great.

Please click "Accept Answer" So that we can close this case.
Rajesh Gopisetti 5 Reputation points

2023-09-07T13:52:28.72+00:00

Thank you Satish. It is working from python sdk from local. I want to paste this in Azure function and run the code when event hub receives an event. I had a script to trigger pipeline and it is working and bow added your trigger code in it. But it is stating create or update trigger map error

map_error raise error

is it related to any packages issue??

do i need to include any packages to run this specially from azure function. I am deploying this azure function from VS as of now

Share via

How to start a existing trigger in adf programmatically, using Python? or any best solution?

1 answer

Your answer