The ADF Salesforce connector Bulk API V2 does not display Bulk Data Load jobs on the Salesforce side, when performing a Insert or Upsert.

Question

The ADF Salesforce connector Bulk API V2 does not display Bulk Data Load jobs on the Salesforce side, when performing a Insert or Upsert.

albert dove 30

I am using a Bulk V2 Salesforce API connector in ADF to push data from ADF to Salesforce.

I've experiened the following issue with the connector:

The ADF, Salesforce connector Bulk API V2 does not display Bulk Data Load jobs on the Salesforce side, when performing a Insert or Upsert. But it does show up when performing a Query. I need to be able to see the Bulk Data load jobs in the Bulk data load screen when doing insert and upserts.

I've tested this on Postman with an API call using Bulk API V2, and it works fine, it shows the Bulk Data Load job with a job ID (Request and Results) when performing Inserts or Upserts. However, when running the same task using Azure Data Factory Salesforce Connector, it does not show up. I suspect its something wrong with the ADF Salesforce connector itself.

Vinodh247 34,741 Reputation points MVP Volunteer Moderator

2024-07-11T00:46:35.14+00:00

but does the insert/upserts happen at the destination without any issues?

try using bulk API V1 instead of V2 in the salesforce connector. Bulk API V1 allows you to retrieve the results of a bulk load via the Salesforce UI, which is not possible with V2., see below.

https://codeulike.com/posts/2023/adf-salesforce
Smaran Thoomu 24,260 Reputation points Microsoft External Staff Moderator

2024-07-12T12:05:27.1433333+00:00

@albert dove We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Accepted answer

1 additional answer

Your answer

Vinodh247 34,741 Reputation points MVP Volunteer Moderator

2024-07-11T00:46:35.14+00:00

but does the insert/upserts happen at the destination without any issues?

try using bulk API V1 instead of V2 in the salesforce connector. Bulk API V1 allows you to retrieve the results of a bulk load via the Salesforce UI, which is not possible with V2., see below.

https://codeulike.com/posts/2023/adf-salesforce
Smaran Thoomu 24,260 Reputation points Microsoft External Staff Moderator

2024-07-12T12:05:27.1433333+00:00

@albert dove We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Answer 1

Hi @albert dove
Thanks for the question and using MS Q&A platform.
It sounds like you are experiencing an issue with the ADF Salesforce connector Bulk API V2 not displaying Bulk Data Load jobs on the Salesforce side when performing an Insert or Upsert. This could be due to a few different reasons.

One possible reason is that the ADF Salesforce connector is not properly configured to display Bulk Data Load jobs. You may need to check the configuration settings for the connector to ensure that it is set up correctly.

It's also possible that there may be a limitation or restriction on the Salesforce side that is preventing the Bulk Data Load jobs from being displayed. You may need to check the Salesforce documentation or contact Salesforce support to see if there are any known limitations or issues with the Bulk API V2.

In any case, I would recommend checking the configuration settings for the connector and contacting Microsoft support for assistance with resolving the issue.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

albert dove 30 Reputation points

2024-07-15T15:29:41.2266667+00:00

Hi @Smaran Thoomu

I've checked all configuration setting on the ADF connector. There is no setting associated with Bulk Data Load Jobs. The only alternative it seems it to use the suggested link by @Vinodh247 to use the copy activity ADF logs that are stored in the blob storage.

Bulk V1 is soon to be deprecated, and i therefore cannot use it. It seems the only way around this is to view the Copy Activity ADF logs. I will accept this suggestion as the solution. But will proceed to log a support request with Microsoft as the Bulk API V2 API does not behave the same way as when testing on other clients like Postman.

I will log a support request with Microsoft for further assistence. Thanks everyone!

Answer 2

Since Microsoft upgraded the ADF Salesforce Connector (so that it now uses Bulk Api 2.0) I believe the connector deliberately 'deletes' the jobs from Salesforce after completion so that you cannot view them.

That is - on the Salesforce 'Bulk Jobs' list, you can't see the jobs, or if you can they only appear very briefly. You can see however that your daily count of 'batches' increases so the jobs must be happening. I believe this is a deliberate (but undocumented) design decision by Microsoft, perhaps based on privacy concerns. Its very annoying.

I would recommend using the older ADF Salesforce Connector, but you cannot create it via the UI, you have to create it via JSON.

Share via

The ADF Salesforce connector Bulk API V2 does not display Bulk Data Load jobs on the Salesforce side, when performing a Insert or Upsert.

1 additional answer

Your answer