How to connect salesforce from azure data factory using OAUTH2

Question

How to connect salesforce from azure data factory using OAUTH2

Madhavan Alagesan 11

QuantumCache 20,366 Reputation points Moderator

2023-05-30T22:26:41.3833333+00:00

Hello @Madhavan Alagesan,

Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!

if the below response is helpful, please do "Accept Answer" and Upvote , so that we can close this discussion!
QuantumCache 20,366 Reputation points Moderator

2023-06-05T16:13:43.8566667+00:00

Hello @Madhavan Alagesan,
Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!

If the response is helpful, please click "Accept Answer" and upvote it. So that we can close this thread.
Calvin Ng 0 Reputation points

2025-01-06T20:21:40.8366667+00:00

Is this still the case now? Azure Data Factory is showing warning signs to move over to Oauth 2.0 for Salesforce, but we are unable to establish a connection via Oauth 2.0. Other apps work find, but not ADF. Using the old method of username/password/token works, but not Oauth 2.0.

2 answers

Your answer

QuantumCache 20,366 Reputation points Moderator

2023-05-30T22:26:41.3833333+00:00

Hello @Madhavan Alagesan,

Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!

if the below response is helpful, please do "Accept Answer" and Upvote , so that we can close this discussion!
QuantumCache 20,366 Reputation points Moderator

2023-06-05T16:13:43.8566667+00:00

Hello @Madhavan Alagesan,
Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!

If the response is helpful, please click "Accept Answer" and upvote it. So that we can close this thread.
Calvin Ng 0 Reputation points

2025-01-06T20:21:40.8366667+00:00

Is this still the case now? Azure Data Factory is showing warning signs to move over to Oauth 2.0 for Salesforce, but we are unable to establish a connection via Oauth 2.0. Other apps work find, but not ADF. Using the old method of username/password/token works, but not Oauth 2.0.

Answer 1

QuantumCache 20,366 Moderator

Hello @Madhavan Alagesan,

It looks like you are trying to use the Salesforce Connection credentials to pull object data(OAuth Flow). I hope this helps with your initial query!
User's image

You might have already created the Salesforce Connected APP!

User's image

You might have already tested the Access_Token via Postman! User's image

Use the Access_Token to get the Salesforce Object:

User's image

The above 2 steps can be executed in ADF using the WebActivity, which i have shown in the below section.

ADF: Linked Service which uses in-built Salesforce Connector!

User's image

Copy Data Activity:

Source: Use Salesforce Linked Service to Connect and get the Source DataSet

Source

User's image

Sink
User's image

Mapping:

User's image

Below ADF Pipeline Shows the implementation and usage of oAuth2 with Salesforce in 2 ways:

Web Activity-->GetToken--Web Activity-->GetEmployeeDetails-->Do the Mapping from the Json to SINK dataset.
CopyData Activity-->Use Salesforce Linked Services--Use UserName+Password+Consumer Key+Secret+SecurityToken--Mapping Source&Sink

User's image

If the response is helpful, please click "Accept Answer" and upvote it. So that we can close this thread.

Balaji R 0 Reputation points

2025-01-07T07:07:16.3+00:00

Hi @QuantumCache

**
In web activity (GetSFToken) can you share the process/steps how you got the API Token...

Able to access via - regbin - CURL onlineConsumer key, Consurmer Secret, Username, Password with grant as password

Not able to Access via - ADF - Web Activity - getting below error.

Error calling the endpoint 'https://test.salesforce.com'. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] An error occurred while sending the request.'.

Request didn't reach the server from the client. This could happen because of an underlying issue such as network connectivity, a DNS failure, a server certificate validation or a timeout.

Any help is appreciated
Balaji R 0 Reputation points

2025-01-07T07:19:03.2566667+00:00

Hi @QuantumCache

In web activity (GetSFToken) can you share the process/steps how you got the API Token...

Able to access via - regbin - CURL onlineConsumer key, Consurmer Secret, Username, Password with grant as password

Not able to Access via - ADF - Web Activity - getting below error.

Error calling the endpoint 'https://test.salesforce.com'. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] An error occurred while sending the request.'.

Request didn't reach the server from the client. This could happen because of an underlying issue such as network connectivity, a DNS failure, a server certificate validation or a timeout.

Any help is appreciated

Answer 2

Dillon Silzer 57,826 Volunteer Moderator

Hello Madhavan,

As far as I know OAUTH is not supported in Azure Data Factory.

You will need to authenticate with a username/password to salesforce:

Copy data from and to Salesforce using Azure Data Factory or Azure Synapse Analytics

https://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce?tabs=data-factory#linked-service-properties

If this is helpful please accept answer.

Rezwan Asraf Ali 0 Reputation points

2023-11-03T15:21:33.6466667+00:00

Hi SatishBoddu-MSFT,

I understand that we could only use Web Activity which is OAUTH 2.0 However, there is a limitation where we could only extract 2000 records. Could you please provide any documentation on how to achieve this in Synapse. For example, can we utilize a specific activity (For each, until) basically a loop to fetch records utilizing nextrecordsurl.

Any advice is highly appreciated.

Regards, Rezwan

Share via

How to connect salesforce from azure data factory using OAUTH2

2 answers

Your answer