Synapse Link Question

Question

Hi,

Reference ... https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-pipelines?tabs=synapse-analytics

The population of the Data Lake from Dataverse appears successful overall. However, I have increased the incremental refresh interval to 24 hours since the load took several hours.

 

The ADF trigger did not execute as expected so I attempted to execute the trigger manually. However I received the following error …

 

Operation on target SetupProcessingLog failed: Operand data type varchar is invalid for divide operator.

Operand data type varchar is invalid for divide operator.

 

Any thoughts?

 

 

Answer 1

Thank you @Amira Bedhiafi ,
My question is about getting the Synapse Line pipeline template to work as reference ... https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-pipelines?tabs=synapse-analytics

I have not changed the original design of this template. I need help from someone who has used this template recently, successfully ...

I should not have to change the design of the template package to get it working, only change how it is configured.

Answer 2

When you read the message you can have the answer since it seems like a column of type varchar (string) is being used where a numeric data type is expected for division.

You might cast a varchar column to a numeric type in SQL:

SELECT 

    column1,

    column2,

    CAST(varchar_column AS float) AS numeric_column

FROM 

    your_table

If the division operation is part of a SQL query, ensure all operands are numeric:

SELECT 

    column1 / CAST(varchar_column AS float) AS result

FROM 

    your_table

If you're using ADF Data Flow, you can add a Derived Column transformation to cast the varchar column to a numeric type:

1. Derived Column Transformation:
   • Add a Derived Column transformation to your data flow.
   • Create a new column or replace the existing one with the cast expression, e.g., toFloat(varchar_column).
2. Perform the Division Operation:
   • Use the newly cast column in your arithmetic operations.