HashiCorp volt integration Azure Data Factory

Question

We are using HashiCorp Volt as common key volt storage for our downstream applications. Please help me the steps, how to connect HashiCorp volt secrets in Azure Data Factory. I have clear understanding of Azure Key Volts but need help call the HashiCorp secret values in Azure Data Factory (line in Linked service configuration or Web App.

Appreciate

Thanks- Krishna

Answer 1

There is not currently an integration for Hashicorp Vault in Data Factory, so the only way you would be able to do this would be using an HTTP source in Data Factory to call the Vault API.

Answer 2

@Krishna

Thanks for reaching out to Microsoft Q&A.

Here are the steps to configure Azure Key Vault as a sync destination:

1. Create a new Key Vault in Azure Portal if you do not already have one.
2. Create a service principal with a client id and client secret.
3. Grant the service principal access to Azure Key Vault. We recommend using the “Key Vault Secrets Officer” built-in role, which gives sufficient access to manage secrets.
4. Configure a sync destination with the service principal credentials and Key Vault URI:

$ vault write sys/sync/destinations/azure-kv/my-azure-1 \
key_vault_uri="$KEY_VAULT_URI" \
client_id="$CLIENT_ID" \
client_secret="$CLIENT_SECRET" \
tenant_id="$TENANT_ID"

1. Create secrets you wish to sync with a target Azure Key Vault:

$ vault kv put -mount='my-kv' my-secret foo='bar'

1. Create an association between the destination and a secret to synchronize:

$ vault write sys/sync/destinations/azure-kv/my-azure-1/associations/set \
mount='my-kv' \
secret_name='my-secret'

Please replace the placeholders like $KEY_VAULT_URI, $CLIENT_ID, $CLIENT_SECRET, and $TENANT_ID with your actual values. Once you have the secrets from HashiCorp Vault synced to Azure Key Vault, you can use them in Azure Data Factory in a manner akin to Azure Key Vault. Please note that these steps require you to have the necessary permissions in both HashiCorp Vault and Azure. If you encounter any issues, please refer to the official HashiCorp Vault documentation and Azure Data Factory documentation Hope this helps. Do let us know if you any further queries.