Issue with ADF Postgres connector

thomasthomas 1

If the database password contains a semicolon, then the ADF Postgres connector fails. Even if the secret is collected from an Azure Key Vault.

The guy below ran into this issue (with the same error messages I got) with the ADF Oracle connector.

https://social.msdn.microsoft.com/Forums/en-US/10a3454f-69b8-41bb-9af3-8846f44f6dfe/scape-character-in-azure-password?forum=AzureDataFactory

Please advise.

KranthiPakala-MSFT 46,462 Reputation points Microsoft Employee

2023-03-28T07:07:22.9433333+00:00

Hi @thomasthomas

Welcome to Microsoft Q&A forum and thanks for reaching out here.

This seems to be same issue as the once discussed in the link you have shared.

I'm reaching out to internal team to double check if this is a bug or a known limitation and will keep you posted as soon as I hear back from the team.

In the meantime, as a workaround (not sure if it works but worth giving a try) could you please try encoding the semicolon character in the password using URL encoding. In URL encoding, the semicolon character is represented by %3B. Please try replacing each semicolon character with %3B. For example, if the password is my;password, you can encode it as my%3Bpassword.

Then, use the encoded password in the connection string for the Postgres connector in Azure Data Factory and see if it works.

Pleas keep us posted how it goes.

Thank you
KranthiPakala-MSFT 46,462 Reputation points Microsoft Employee

2023-03-29T08:05:39.4333333+00:00

@thomasthomas Just checking to see if you have got a chance to try the workaround provided in my previous response. If so, could you please share if that helped or still the issue persists?

Thanks
KranthiPakala-MSFT 46,462 Reputation points Microsoft Employee

2023-03-31T22:31:06.0533333+00:00

@thomasthomas We still have not heard back from you. Just wanted to check if the above workaround was helpful to unblock you? Let us know how it goes

Thank you
thomasthomas 1 Reputation point

2023-04-01T19:13:44.74+00:00

Hi @KranthiPakala-MSFT

I decided to update the pwd in the Azure Keyvault that contains no semicolons at all. I think the workaround may work for ADF, but it might fail if I used it with pyscopg2 in python. There are several applications that depend on this secret - and only the ADF Postgres connector resulted in this issue.

Thanks,
Tamas
KranthiPakala-MSFT 46,462 Reputation points Microsoft Employee

2023-04-06T05:49:04.46+00:00

@thomasthomas Checking to see if you have got a chance to try my recent suggestions. If so, keep this thread posted on how it goes.

Thank you

1 answer

KranthiPakala-MSFT 46,462 Reputation points Microsoft Employee

2023-04-04T21:42:38.89+00:00

@thomasthomas Thanks for your response and appreciate for sharing additional information. I have shared the feedback with respective product owners, and they confirmed that they don't see problem when there's semicolon in password, when we are using AKV to store the password. If users using AKV to store the whole connection string, then correct escape (surrounding password with {}) should be in place.

Could you please try escaping as {} for the password and see if that helps to resolve issue for ADF and also please make sure that it works for other services too.
Please let us know how it goes. Thank you
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Issue with ADF Postgres connector

1 answer

Your answer