Share via

HDFS modify row delimiter

Silipigni Marco 1 Reputation point
2021-02-19T16:23:02.103+00:00

Hi,
for maintain the standard in my HDFS i need to modify the row delimiter.
I use SSIS to get data from a DB and put in HDFS with the tool "Destination HDFS" , i need to replace the row delimiter from {CR}{LR} to {LR}.
The tool "Destination HDFS" not offer option to change this parameter.

Anyone know how to do for resolve this problem?

SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,467 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Monalv-MSFT 5,896 Reputation points
    2021-02-22T02:06:53.947+00:00

    Hi @Silipigni Marco ,

    We can set the expression [HDFS File Destination].[ColumnDelimiter] in the properties of Data Flow Task.

    70422-dft-expression.png

    Please refer to HDFS File Destination and Importing and Exporting data using SSIS Hadoop components.

    Best regards,
    Mona

    ----------

    If the answer is helpful, please click "Accept Answer" and upvote it.

    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.