Issue with datatype in ADF dataflow

Nidhi Solanki 1 Reputation point
2022-07-19T06:29:28.003+00:00

I am reading one parquet file using dataflow and overwriting datatype of one column into decimal. But after changing to decimal i am getting Null values for only those which have comma like 1,115.40000 and rest other values are coming correct.

222126-image.png

222164-image.png

Source File Data :
222076-image.png

This means decimal datatype didn't accept comma values ?

Is there any way to resolve this type of issue ?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,154 questions
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,407 Reputation points Microsoft Employee
    2022-07-20T05:26:42.897+00:00

    Hello @Nidhi Solanki ,

    Thanks for the question and using MS Q&A platform.

    From my understanding, you would like to convert a string type currency value column data to Decimal type in data flow. Please correct me if I am wrong.
    In order to convert the source string data type of currency value you can use a derived column transformation as shown below and covert it to Decimal type in the expression builder.

    Regarding the schema overwrite issue, we will escalate to internal team to check if there is any bug with the functionality and will keep you posted as soon as we have an update from the team.
    But in the meantime, you can use the below derived column expression to convert your currency values in string data type to Decimal/Currency type.

    222507-image.png

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments