Error - Function does not exist when using UDF in Data Flow Activity

Venkatasiva Bharath Talluri 1

Hello,

I am using a newly enabled feature to create User-defined functions in Data Flow Library and use them in Data Flow activities. Please see the below screenshot for the UDF I generated.

Here is the Select activity I am using the above UDF

Here is the error I am getting when I do data preview:

Can someone help me on how to resolve this?

Note: I tested the same UDF in Derived Column Activity and used in Value Expression, it works fine.

KranthiPakala-MSFT 46,602 Reputation points Microsoft Employee

2022-06-15T23:11:58.627+00:00

Hello @Venkatasiva Bharath Talluri ,

Thanks for the question and using MS Q&A platform.

After creating the UDF in ADF, have you saved it before using it? And also, I see that you are using the UDF in a Select transformation where I don't see an expression builder option. But as per the official documentation, the UDF will appear only in the mapping data flow expression builder under Data flow library functions.

Let me double check with internal team if UDF's can be used in Select expressions and keep you posted as soon as I have an update.

In the meantime, could you please try to use the same UDF in a derived column transformation and let us know how it goes? Please let us know if you notice the same error message as Select transformation.

Thank you
Venkatasiva Bharath Talluri 1 Reputation point

2022-06-16T15:33:10.723+00:00

Hello @KranthiPakala-MSFT ,

Thank you for responding.

I saved the UDF and it's reflecting in the Expression Builder:

I did put that in the note of my question it is working in the Value Expression of Derived Column activity. Please check the below screenshot.

But I can't use it in Column Expression as below and it is giving me the same error: Function doesn't exist:

Let me know if you need any more info.

Thank you,
Bharath
MarkKromer-MSFT 5,216 Reputation points Microsoft Employee

2022-06-16T19:14:36.707+00:00

In Select transformation, use expression functions (system or user-defined functions) via "rule-based mapping" as opposed to fixed mapping.
Venkatasiva Bharath Talluri 1 Reputation point

2022-06-17T15:45:53.87+00:00

I am using rule-based mapping but not fixed mapping from the screenshot with Select activity I posted in my question.
MarkKromer-MSFT 5,216 Reputation points Microsoft Employee

2022-06-17T15:54:21.137+00:00

I will forward that on to engineering ... in the meantime, please open a support ticket on the Azure portal
Venkatasiva Bharath Talluri 1 Reputation point

2022-06-19T23:48:28.923+00:00

Thank you. I will raise it.
KranthiPakala-MSFT 46,602 Reputation points Microsoft Employee

2022-06-23T00:51:49.307+00:00

Hello @Venkatasiva Bharath Talluri ,

Following up to see if you have got a chance to file a support case for the above issue. If so, would you please share it here so that we can track it internally.

Thank you
Venkatasiva Bharath Talluri 1 Reputation point

2022-06-24T20:10:12.28+00:00

Hello @KranthiPakala-MSFT ,

Please see the below tracking id for the request raised by our Admin team:
TrackingID#2206240040007262

Share via

Error - Function does not exist when using UDF in Data Flow Activity

Your answer