How to select/enable of legacy connector for Salesforce for newly created linked services on Azure Data Factory

JG 5 Reputation points
2024-02-14T15:13:14.86+00:00

Is there a way to force the connector to use the old direct login and BULKAPI method and not OAUTH / BulkAPI 2.0 when creating a new linked service on Azure Data Factory?

  • From the new documentation it appears the new Salesforce connector for Azure Data factory relies on OAuth/Connected Apps and uses BulkAPI 2.0.
  • This is a an issue for a few reasons:
    • It is PITA to control access/test security/rights/auditing as opposed to a direct access to a single user.
      • This is especially true in environments where the admin is not well versed in all the byzantine world of SFA record/object access and rights.
        • Navigating this issue is a no go on many projects where companies have tight timelines to standup their SFA environments and integrations.
    • Bulk API 2.0 is very inefficient for frequent small updates across many objects.
    • Not being able to control batch size makes it unusable for many custom objects configured by teams that write haphazard/poor triggers / workflows which forces the need for specific batch sizes so you don't encounter timeouts and unexpected errors in downstream processes.
      • For most environments, write a more efficient trigger isn't actually an option or one companies will spend money on.
        • If you've worked in many different SFA Orgs you're going to encounter this and BULKAPI 2.0 after years still does not automatically select a workable batch size correctly (i.e. marketing materials aren't reality).
        • In actually environments with lots of sales interactions infrequent updates/data maintenance are not an option.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,590 questions
{count} vote

1 answer

Sort by: Most helpful
  1. QuantumCache 20,266 Reputation points
    2024-02-15T01:08:50.22+00:00

    Hello JG Are you trying the Salesforce Connector? or the other connectors? Please confirm User's image

    You can use UX feature flag '&feature.enableSalesforceV2=false' to temporarily switch back to legacy salesforce connector to unblock your business needs. In order to use the feature flag, just add above in your data factory URL. For example: https://ms-adf.azure.com/en/home?factory=%2Fsubscriptions%2xxx%2FresourceGroups%2Fxxx%2Fproviders%2FMicrosoft.DataFactory%2Ffactories%2Fxxx**&feature.enableSalesforceV2=false User's image

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.