Our Azure Data Factory integration runtimes are not auto-updating even though we have them set to auto-update. We checked the troubleshooting items listed, and none seem to apply. auto-update is turned on we are able to access the download center from the IR no error that the estimated upgrade date has passed the upgrade service is running we have .net version above 4.7.2 we don't have a x86 machine we have enough drive space not sure how to check whether the IR credential has not synced, i assume it has as we have not received any error messages like that. The auto-update is supposed to try daily at a certain time as far as I am aware. It is a quiet time for our data factory with usually no pipelines running, but the integration runtimes have not updated since June 2024. Could anyone give any guidance as to why the auto-updates are not happening? Thank you, Jackie

Hi @phemanth We are still working on troubleshooting this. I've checked a few things but still trying to find/figure out the others. IR credential sync : I am seeing our SHIRs as synced under Credential status. Daily auto-update schedule : Yes, verified we have set the intended scheduled time. Azure Data Factory version : I can't find that information in Azure Portal under Overview but if I click on the JSON code in Azure Portal for our Data Factory and search for version I see: "version": "2018-06-01", Would that mean we are running an old version? Does this get auto updated? Firewall or network restrictions : We still need to check with our internal IT if these URLs are allowed and ports are open. https://*.azure.com , https://*.microsoft.com , and https://*.windows.net Azure Data Factory logs : I'm not finding logs. Do I need to remote into our SHIRs and find logs there I assume?

Integration runtimes are not auto-updating

JB 86

Our Azure Data Factory integration runtimes are not auto-updating even though we have them set to auto-update.

We checked the troubleshooting items listed, and none seem to apply.

auto-update is turned on
we are able to access the download center from the IR
no error that the estimated upgrade date has passed
the upgrade service is running
we have .net version above 4.7.2
we don't have a x86 machine
we have enough drive space
not sure how to check whether the IR credential has not synced, i assume it has as we have not received any error messages like that.

The auto-update is supposed to try daily at a certain time as far as I am aware. It is a quiet time for our data factory with usually no pipelines running, but the integration runtimes have not updated since June 2024.

Could anyone give any guidance as to why the auto-updates are not happening?

Thank you,

Jackie

phemanth 10,085 Reputation points Microsoft Vendor

2024-09-05T15:35:03.41+00:00
@JB

Welcome to the Microsoft Q&A and thank you for posting your questions here

Here are a few additional potential causes and steps to investigate:

IR credential sync: Although you haven't received any error messages, it's still worth verifying that the IR credential has synced correctly. You can check the IR's credential status in the Azure portal:

Go to your Azure Data Factory resource

Click on "Author & Monitor"

Select the Integration Runtime

Click on "Edit" (pencil icon)

Scroll down to the "Credentials" section

Verify that the credential is listed and has a "Synced" status

Daily auto-update schedule: You mentioned that the auto-update is supposed to try daily at a certain time. Double-check the schedule to ensure it's set correctly:

Go to your Azure Data Factory resource

Click on "Author & Monitor"

Select the Integration Runtime

Click on "Edit" (pencil icon)

Scroll down to the "Auto-update" section

Verify that the schedule is set to the correct time and frequency (daily)

Azure Data Factory version: Ensure that your Azure Data Factory instance is running the latest version. You can check the version in the Azure portal:

Go to your Azure Data Factory resource

Click on "Overview"

Look for the "Version" information

If you're not on the latest version, consider upgrading

Firewall or network restrictions: Although you can access the download center from the IR, there might be firewall or network restrictions blocking the auto-update process. Verify that the necessary ports and URLs are allowed:

Check your firewall and network settings to ensure that the following URLs are allowed: https://*.azure.com, https://*.microsoft.com, and https://*.windows.net

Ensure that the necessary ports are open (e.g., 443 for HTTPS)

Azure Data Factory logs: Investigate the Azure Data Factory logs to see if there are any errors or warnings related to the auto-update process:

Go to your Azure Data Factory resource

Click on "Author & Monitor"

Select the Integration Runtime

Click on "Logs" ( magnifying glass icon)

Filter the logs by date and look for any errors or warnings related to auto-update

Hope this helps. Do let us know if you any further queries.
phemanth 10,085 Reputation points Microsoft Vendor

2024-09-06T17:24:09.9733333+00:00

@JB We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
phemanth 10,085 Reputation points Microsoft Vendor

2024-09-09T11:42:11.9366667+00:00
@JB

Thanks for the update on the troubleshooting progress. I'll help clarify some of the points you've checked and provide guidance on the remaining ones.

IR credential sync: Good to hear that you've verified the SHIRs as synced under Credential status. This should not be the cause of the issue.

Daily auto-update schedule: You've confirmed that the schedule is set correctly, so this is unlikely to be the cause.

Azure Data Factory version: The version you found in the JSON code, "2018-06-01", refers to the API version of your Azure Data Factory instance. This is not the same as the version of the Azure Data Factory service itself. The API version is used to specify the version of the Azure Data Factory REST API that your instance is compatible with.

The Azure Data Factory service is automatically updated by Microsoft, and you don't need to worry about updating it manually. However, it's possible that your instance is not using the latest features or fixes if the API version is outdated.

To check the actual version of the Azure Data Factory service, you can follow these steps:

Go to the Azure portal and navigate to your Azure Data Factory resource.

Click on "Author & Monitor".

Click on the three dots (ellipsis) next to the "Author & Monitor" button.

Click on "About".

Look for the "Version" information.

Firewall or network restrictions: It's great that you're working with your internal IT to verify the firewall and network settings. Please ensure that the necessary ports and URLs are allowed, as mentioned earlier.

Azure Data Factory logs: You don't need to remote into your SHIRs to find logs. Instead, you can check the Azure Monitor logs for your Azure Data Factory resource. To do this:

Go to the Azure portal and navigate to your Azure Data Factory resource.

Click on "Monitor".

Click on "Logs".

Select the log category and time range you're interested in.

Look for any errors or warnings related to the auto-update process.

Additionally, you may want to consider checking the Azure Data Factory resource's activity log, as I mentioned earlier, to see if there are any errors or warnings related to the integration runtime

1 answer

JB 86 Reputation points

2024-09-08T20:31:59.1966667+00:00
Hi @phemanth We are still working on troubleshooting this. I've checked a few things but still trying to find/figure out the others.

IR credential sync: I am seeing our SHIRs as synced under Credential status.

Daily auto-update schedule: Yes, verified we have set the intended scheduled time.

Azure Data Factory version: I can't find that information in Azure Portal under Overview but if I click on the JSON code in Azure Portal for our Data Factory and search for version I see: "version": "2018-06-01", Would that mean we are running an old version? Does this get auto updated?

Firewall or network restrictions: We still need to check with our internal IT if these URLs are allowed and ports are open. https://*.azure.com, https://*.microsoft.com, and https://*.windows.net

Azure Data Factory logs: I'm not finding logs. Do I need to remote into our SHIRs and find logs there I assume?
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Integration runtimes are not auto-updating

1 answer

Your answer