Error "The payload including configurations on activity/dataSet/linked service is too large. Please check if you have settings with very large value and try to reduce its size." while executing azure function in adf.

Amar Agnihotri 891 Reputation points
2022-08-16T05:54:19.013+00:00

Hi,
I have an adf pipeline which calls the azure function to convert the string output to a valid json format. My pipeline works fine most of the time but some times i face this error while executing azure function activity

231306-image.png

This is my pipeline
231295-image.png

Can anybody tell any solution for this ?

Thanks

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,464 questions
0 comments No comments
{count} vote

2 answers

Sort by: Most helpful
  1. Suba Balaji 11,186 Reputation points
    2022-08-16T11:15:00.823+00:00

    Hi @Amar Agnihotri ,

    Is the string that you are forming differ in size in every run? Like for clean runs, the size is lesser and sometimes it becomes a bigger payload with huge data?

    As per this documentation, the payload is limited to 896 KB.

    As a workaround, you can write the string to a table column or a blob file an access that from your azure function.

    Let us know


  2. 11-4688 61 Reputation points
    2023-01-23T08:15:26.3033333+00:00

    Any update on that? It still causes issues.

    0 comments No comments