Azure data factory - bob delimited data set error on parameterizing row delimiter

Siddharth Kumar 71 Reputation points
2022-09-30T14:14:45.42+00:00

Hi
We have created a dataset that is used to write blob to our storage container. Out idea was to parameterize ceratin connection properties like FilePath, column delimiter, row delimiter and encoding - so team members can generate client data files using different delimiters(comma, pipe) or encoding(UTF-8 or 16) or row delimiter(like \r, \n or \r\n).

246466-first.png

All parameters except the row delimiter work. When we try to pass \r\n for the row delimiter parameter value we get an error

Operation on target Get Veeva Data failed: ErrorCode=DelimitedTextInvalidSettings,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Copy activity doesn't support multi-char or none row delimiter.,Source=Microsoft.DataTransfer.ClientLibrary

When we change the row delimiter to Default setting it works fine. Any way this can be achieved.
246524-second.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,036 Reputation points
    2022-10-03T20:51:52.517+00:00

    Hello @Siddharth Kumar ,
    Thanks for the question and using MS Q&A platform.

    As I understand the ask is how to use for a row delimiter, the combination \r\n when the row delimiter is parameterized in dataset.

    There is a layer of nuance in the explanation why typing "\r\n" does not work. This takes the actual 4 characters [\,r,\,n] instead of the 2 escaped characters they represent. Furthermore, pressing enter in the textbox doesn't enter the desired value.

    However I found that when I open the expression editor, and press enter or paste in the actual carriage return + newline (as opposed to "\r\n") , the validation error goes away.
    247193-image.png
    I know its kinda confusing, but it is like "two" vs "2". While both represent a quantity, one is a word while the other is a digit.

    Please do let me if you have any queries.

    Thanks
    Martin


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments