ADF Data flow task writing to BLOB CSV

Mav 81 Reputation points
2022-02-02T08:11:44.373+00:00

Hi,

I am working on ADF data flow and writing to sink JSON CSV BLOB .
In my my SINK dataset config I am providing the name of the file that I want to be created
I am using dynamic config for filename @markus.bohland@hotmail.de ('FILENAME,utcnow())

170511-4.jpg

However when data flow runs successfully, the file that is created in the container is of different name like highlighted in yellow below

170495-5.jpg

Any ideas why the file name is different from the one mentioned in the dataset

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,445 questions
0 comments No comments
{count} vote

Accepted answer
  1. AnnuKumari-MSFT 30,361 Reputation points Microsoft Employee
    2022-02-02T09:02:56.467+00:00

    Hi @devhere ,
    Thankyou for using Microsoft Q&A platform and posting your question.
    In the sink transformation of your data flow, you need to change few things :
    1. Select FileName option as 'Output to single file' in Settings tab
    170508-image.png
    2. When you do that there there will be a recommendation popping up saying 'Output to single file' requires 'Single partition' . Click on Set single partition. You can also do this by selecting 'Set single partition' option in Optimize tab.
    170469-image.png
    170459-image.png
    3. Provide name of the output file in the option 'Output to Single file'

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    2 people found this answer helpful.

0 additional answers

Sort by: Most helpful