Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
ADF Snowflake Connector - Key pair authentication - [Snowflake] adbc.snowflake.sql.client_option.jwt_private_key_pkcs8_password is not configured
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 4%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
ANAND SHIVA SINGH
0
Reputation points
Hello,
I have created a private encrypted key pair to connect ADF to Snowflake. The private key is in Azure key vault secret. When I am trying to test the connection with the key pair using Linked Service, it throws the below error.
The basic jdbc authentication with basic username and password works fine. The odbc authentication with key-pair is also successful. So, the issue is definitely not with the private key in keyvault.
I have followed all the steps from this issue as well. https://learn.microsoft.com/en-us/answers/questions/1659093/adf-snowflake-connector-key-pair-authentication-fa
Any kind of help is greatly appreciated. TIA
Azure Data Factory
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth 15,765 Reputation points Microsoft External Staff Moderator2024-08-05T15:14:46.58+00:00 Thanks for using MS Q&A platform and posting your query.
The error message "Test connection operation failed. Failed to open the database connection. [Snowflake] adbc.snowflake.sql.client_option.jwt_private_key_pkcs8_password is not configured" suggests that the Azure Data Factory (ADF) is having trouble accessing the private key in your Azure Key Vault to authenticate with Snowflake.
Here's a breakdown of the possible causes and solutions:
Key Vault Access Permissions:
- Check the ADF Service Principal: Ensure the ADF service principal has the necessary permissions to access the secret in your Key Vault. Specifically, it needs the
Getpermission for the secret. - Key Vault Managed Identity: If you're using a managed identity for ADF, ensure the managed identity is correctly linked to your Key Vault and has the necessary permissions.
Key Vault Configuration:
- Secret Name: Verify the secret name used in your ADF Linked Service configuration matches the exact name of the private key in Key Vault.
- Secret Version: If you have multiple versions of the private key in Key Vault, make sure the ADF Linked Service is referencing the correct version.
Key Pair Type:
- PKCS#8 Format: The error message suggests the private key should be in PKCS#8 format. Ensure your private key is generated in this format.
- Password Protection: If your private key is password-protected, you need to provide the password securely within the ADF Linked Service configuration.
Key Vault Connection String:
- Correct Connection String: Verify that the Key Vault connection string in the ADF Linked Service is correctly formatted and points to the correct Key Vault instance.
Linked Service Configuration:
- Key Pair Configuration: Double-check that the configuration within your ADF Linked Service correctly identifies the private key location, its type, and any relevant password information.
Troubleshooting Steps:
- Test Key Vault Access: Use the Azure CLI or PowerShell to check if the ADF service principal or managed identity can successfully retrieve the private key from Key Vault.
- Check Key Format: Verify the format of your private key using tools like OpenSSL.
Test Authentication Outside ADF: Try to connect to Snowflake using the private key outside of ADF (e.g., using a Python script) to isolate the issue.
Hope this helps. Do let us know if you any further queries.
- Check the ADF Service Principal: Ensure the ADF service principal has the necessary permissions to access the secret in your Key Vault. Specifically, it needs the
-
ANAND SHIVA SINGH 0 Reputation points
2024-08-05T15:36:29.2166667+00:00 Hi, Thanks for your response. I have a different issue now. It says that - " Test connection operation failed.
Failed to open the database connection.
[Snowflake] Post "https://ORGNAME-ACCOUNTNAME.snowflakecomputing.com:443/session/v1/login-request?databaseName=db_name&requestId=28e40da2-9a62-4cba-6851-2f5cbd258650&request_guid=f9f4c892-fa99-408c-70b6-e71979a531be&warehouse=TEST_ADF_WH": EOF "
-
phemanth 15,765 Reputation points Microsoft External Staff Moderator
2024-08-06T10:25:53.68+00:00 The error message you're seeing now suggests that Azure Data Factory (ADF) is having trouble establishing a connection to Snowflake. The "EOF" (End Of File) error typically indicates that the connection was terminated unexpectedly.
Here are some potential causes and solutions for this issue:
- Firewall or Network Configuration: Ensure that the firewall rules and network configuration allow ADF to connect to Snowflake. You may need to add the ADF IP addresses to the Snowflake whitelist.
- Snowflake Account Configuration: Verify that the Snowflake account is properly configured, and the database, warehouse, and role are correctly specified in the ADF Linked Service.
- SSL/TLS Configuration: Snowflake requires SSL/TLS encryption for all connections. Ensure that the ADF Linked Service is configured to use SSL/TLS encryption.
- Proxy Configuration: If you're using a proxy server, ensure that it's correctly configured in the ADF Linked Service.
- Snowflake Serverless Configuration: If you're using Snowflake Serverless, ensure that the ADF Linked Service is configured to use the correct Snowflake Serverless URL.
To troubleshoot this issue, you can try the following:
- Verify Snowflake Connection: Try connecting to Snowflake using a tool like SnowSQL or a Snowflake client to verify that the connection works outside of ADF.
- Check ADF Logs: Check the ADF logs for more detailed error messages that may indicate the cause of the issue.
- Test Connection with Different Warehouse: Try testing the connection with a different warehouse to see if the issue is specific to the current warehouse
-
phemanth 15,765 Reputation points Microsoft External Staff Moderator
2024-08-08T12:04:59.54+00:00 @ANAND SHIVA SINGH We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
-
phemanth 15,765 Reputation points Microsoft External Staff Moderator
2024-08-09T14:01:45.62+00:00 @ANAND SHIVA SINGH just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
-
ANAND SHIVA SINGH 0 Reputation points
2024-08-27T11:13:36.0566667+00:00 Hi, the problem still persists. This is the error I am getting now using KeyPair.
Please note that the issue only exists with key-pair. The username-password authentication works fine with the same set of values.
-
phemanth 15,765 Reputation points Microsoft External Staff Moderator
2024-08-28T16:11:10.3+00:00 The error code 27554 indicates that the database connection is not allowed to access the Snowflake account. Here are some additional steps to troubleshoot this issue:
- Account Permissions:
- Ensure that the Snowflake user associated with the key pair has the necessary permissions to access the database and perform the required operations.
- IP Whitelisting:
- Verify that the IP address from which the connection is being made is whitelisted in Snowflake. This can be configured in the Snowflake network policies.
- Key Pair Configuration:
- Double-check the key pair configuration in ADF. Ensure that the private key is correctly referenced and that the key pair is valid.
- Network Configuration:
- Ensure there are no network restrictions or firewalls blocking the connection between ADF and Snowflake.
- Snowflake Account Configuration:
- Verify that the Snowflake account is correctly configured to accept connections using key pair authentication. This includes checking the Snowflake user settings and the account’s security policies.
- Test Outside ADF:
- As a troubleshooting step, try connecting to Snowflake using the key pair authentication outside of ADF (e.g., using a Python script or another tool) to isolate whether the issue is specific to ADF.
- Account Permissions:
Sign in to comment
Sign in to answer