Azure Data Factory ODATA API - trouble with encoding (copy data activity)

Mike Hems 1 Reputation point
2022-04-19T08:35:41.45+00:00

Hi,

I am trying to do a simple "Copy Data" activity in Azure Data Factory.

My source dataset is an ODATA API, which has a $select filter (to specify columns) like so:
![194189-image.png]1

All columns are loaded just fine in my destination (SQL server), only I am missing the column "specialField/Custom:81". When I click "preview data", or simply run the Copy Data activity, I get all fields except this one.

It seems clear that it is because the field name contains special characters. How do I fix this? I can easily retrieve data from this field in Postman, so it is a Data Factory issue.

My progress so far: I tried to using "encodeUriComponent", which successfully retrieves the specialField and all other specialFields, but they are all NULL, when they should not be.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,525 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. ShaikMaheer-MSFT 37,896 Reputation points Microsoft Employee
    2022-04-20T05:49:48.427+00:00

    Hi @Mike Hems ,

    Thank you for posting query in Microsoft Q&A Platform.

    Could you please try using below as filter to escape special character in your column name and see if that helps?
    specialField//Custom:81

    Please let us know how it goes. Also please share your Dataset configuration screenshots and copy activity screenshots to understand your setup better. Thank you.