csv to csv data load in adf

Shambhu Rai 1,411 Reputation points
2022-05-10T20:44:43.223+00:00

Hi Expert,

how to load data from csv o csv using ADF nusing copy transformation or any readymade component

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,423 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,063 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,103 questions
0 comments No comments
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 32,011 Reputation points Microsoft Employee
    2022-05-11T10:21:44.523+00:00

    Hi @Shambhu Rai ,
    Thankyou for using Microsoft Q&A platform and thanks for posting your query.
    As I understand your question, you want to copy data from one ADLS location to another and source and sink both are of csv format. Please let me know if my understanding about your query is not clear.

    Here are the steps you need to follow to achieve the above requirement:

    Open Azure data factory workspace and perform the following steps:

    1. Create dataset with type- Azure datalake gen2 and select csv format. Browse the location and select the input file which you want to copy. This will act as the source dataset.
    2. Create another dataset with type -Azure datalake gen2 and select csv format. Provide the foldername and filename in which you want to store the data. If the output folder is not existing already, ADF will create the folder during the runtime.
    3. Use copy data activity in ADF pipeline and select first dataset as Source and second dataset as Sink and debug the pipeline.

    Here is a video which you can refer for better understanding : https://www.youtube.com/watch?v=XOJeyRBXBos

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful