Parameterization of Row Delimiter property of ADF dataset

Utsav Chanda 71 Reputation points
2022-08-23T19:10:36.713+00:00

I am creating a fully parameterized ADLS Gen2 Delimited dataset. Passing the parameter value of the 'Row Delimiter' dataset property as '\r,\n, or \r\n' from the pipeline parameter throws the error

ErrorCode=DelimitedTextInvalidSettings,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Copy activity doesn't support multi-char or none row delimiter.,Source=Microsoft.DataTransfer.ClientLibrary,'

234196-param-dataset.jpg

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,600 questions
{count} votes

3 answers

Sort by: Most helpful
  1. AnnuKumari-MSFT 31,061 Reputation points Microsoft Employee
    2022-08-24T10:03:18.833+00:00

    Hi @Utsav Chanda ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your question.

    As I understand your query, you want to parameterize the row delimiter property in copy data activity, but it's throwing the following error in your case: "Copy activity doesn't support multi-char or none row delimiter" . Please let me know if my understanding is incorrect.

    First of all, the parameter value what you are trying to use is : \r,\n, or \r\n which is invalid .

    Row Delimiter is the character used to separate rows in a file. Only one character is allowed for this field. The default value is any of the following values on read: ["\r\n", "\r", "\n"] and "\r\n" on write .

    As I can see you are trying to parameterize for sink dataset which means while writing the data, kindly use \r\n as the Default value. After you provide this value in the default value option, please open the pipeline json and remove extra '\' and run the pipeline.

    234406-parameterizerowdel.gif

    Reference document: Dataset properties in Delimited text format

    Hope this will help. Please let us know if any further queries.


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

  2. Nitin Joshi 6 Reputation points
    2022-10-20T05:12:37.173+00:00

    Thanks, Annu

    I have a similar problem statement and you solution is helpful.

    1 person found this answer helpful.

  3. Yu Han Shao 6 Reputation points
    2022-12-19T13:40:25.047+00:00

    Hi!

    I have the same problem, but I cannot edit the JSON because I am passing the parameter through a lookup that has a SQL stored procedure.

    Is there anyway we can do this by just passing \r\n without it turning into \r\n?

    1 person found this answer helpful.
    0 comments No comments