Azure Data Factory ODATA API - trouble with encoding (copy data activity)

Question

Hi,

I am trying to do a simple "Copy Data" activity in Azure Data Factory.

My source dataset is an ODATA API, which has a $select filter (to specify columns) like so:
]1

All columns are loaded just fine in my destination (SQL server), only I am missing the column "specialField/Custom:81". When I click "preview data", or simply run the Copy Data activity, I get all fields except this one.

It seems clear that it is because the field name contains special characters. How do I fix this? I can easily retrieve data from this field in Postman, so it is a Data Factory issue.

My progress so far: I tried to using "encodeUriComponent", which successfully retrieves the specialField and all other specialFields, but they are all NULL, when they should not be.

Answer 1

Hi @Mike Hems ,

Thank you for posting query in Microsoft Q&A Platform.

Could you please try using below as filter to escape special character in your column name and see if that helps?
specialField//Custom:81

Please let us know how it goes. Also please share your Dataset configuration screenshots and copy activity screenshots to understand your setup better. Thank you.