Share via

csv to csv data load in adf

Shambhu Rai 1,411 Reputation points
2022-05-10T20:44:43.223+00:00

Hi Expert,

how to load data from csv o csv using ADF nusing copy transformation or any readymade component

Azure Data Lake Storage
Azure Data Lake Storage

An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

0 comments No comments

Answer accepted by question author

AnnuKumari-MSFT 34,571 Reputation points Microsoft Employee Moderator
2022-05-11T10:21:44.523+00:00

Hi @Shambhu Rai ,
Thankyou for using Microsoft Q&A platform and thanks for posting your query.
As I understand your question, you want to copy data from one ADLS location to another and source and sink both are of csv format. Please let me know if my understanding about your query is not clear.

Here are the steps you need to follow to achieve the above requirement:

Open Azure data factory workspace and perform the following steps:

  1. Create dataset with type- Azure datalake gen2 and select csv format. Browse the location and select the input file which you want to copy. This will act as the source dataset.
  2. Create another dataset with type -Azure datalake gen2 and select csv format. Provide the foldername and filename in which you want to store the data. If the output folder is not existing already, ADF will create the folder during the runtime.
  3. Use copy data activity in ADF pipeline and select first dataset as Source and second dataset as Sink and debug the pipeline.

Here is a video which you can refer for better understanding : https://www.youtube.com/watch?v=XOJeyRBXBos

Hope this will help. Please let us know if any further queries.

------------------------------

  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
    Original posters help the community find answers faster by identifying the correct answer. Here is how
  • Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Was this answer helpful?

1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.