SAP ECC table connector replace function in ADF

Nagesh CL 641 Reputation points
2022-11-24T16:08:24.133+00:00

Hello there,

We are load data from SAP ECC (Using SAP table connector) to ADLS Gen2. There are special characters in few of the fields which we need to cleanse before loading data to the file. Tried the below options but getting some error: -

REPLACE(Col1, '\', '')
replace_substr(Col1, '\', '')

Please advice how to cleanse or use replace function?

264011-image.png

264012-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,131 questions
{count} votes

1 answer

Sort by: Most helpful
  1. HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
    2022-11-28T18:59:38.5+00:00

    Hello @Nagesh CL ,
    Thanks for the question and using MS Q&A platform.
    As we understand the ask here is copy the data using the table connector , please do let us know if its not accurate.
    Let me start with the fact I am not ECC literate , but i am sure that Replace function should start with @ , so the expression should be @replace(Col1, '\', '') .
    One more think you cannot rename the column at the source , but i think

    1. Try to copy a subset of the records as its is ( it should work ) . The reasion I am requesting you to go this route , is it double check if the special character in the column names is breaking something .
    2. If one goes fine , you can go back to the file generated in the storage account , make the changes in the name of the column. Come back to the Sink option in the connector . You should be able to see the updated column name . Cross check the same in thje mapping section .

    Run the conmnector and it should work out .

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators