New ADF Connector for Salesforce doesn't allow for aggregate queries

JB 106 Reputation points
2024-08-27T03:56:52.6266667+00:00

Hi,

We are trying to update from our legacy Salesforce connector in ADF to the new one which is mostly working to retrieve data but we cannot do a count of rows in a table with the new connector.

Bulk API doesn’t support queries with any of the following:

  • GROUP BY, OFFSET, or TYPEOF clauses
  • Aggregate functions such as COUNT()
  • Date functions in GROUP BY clauses (date functions in WHERE clauses are supported)
  • Compound address fields or compound geolocations fields

We have a pipeline where we need to get row counts for each of our salesforce objects. Is there a workaround for this? I was trying to set up a REST connector as well as the new Salesforce connector but I'm not sure if this is the correct approach nor do I know how to do this in ADF.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,585 questions
{count} vote

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.