Share via

ingest only first 999 rows from .csv file using ADF to move data to ADLS

AzeemK 516 Reputation points
2020-12-08T21:17:12.7+00:00

I am moving data from .csv file on a file share to ADLS Gen2 using ADF V2 pipeline , is there a way to read only first 999 rows from .csv and ingest those and not the whole file.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,706 questions
Accepted answer
  1. MarkKromer-MSFT 5,211 Reputation points Microsoft Employee
    2020-12-09T01:07:18.887+00:00

    Create a new data flow. Set your source to point to the source CSV file. Add a Surrogate Key transformation and give the key a name like "mykey". Now add a Filter transformation with this formula "mykey<1000". Then add your Sink.

    2 people found this answer helpful.
    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.