Data flow blob json sink destination path problem

Jan Porowski 61 Reputation points


My data flow is pretty simple:

  1. source -> blob file full of JSON objects
  2. derivative column -> to add fileName column to every item
  3. sink -> inline blob JSON that saves every item to a separate file by column "fileName"

This is my sink setup:

As you can see the path is based on a "destination" parameter. Unfortunately, when I run this data flow, all files are placed in the container root as well as an empty file named by the "destination" parameter.

Is this a bug, or am I doing something wrong? The empty file is not a problem, but why all files are not placed in the destination folder?

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,084 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,472 questions
0 comments No comments
{count} votes

Accepted answer
  1. Suba Balaji 9,946 Reputation points

    Hi @Jan Porowski ,

    Thanks for posting your query on MS Q&A portal.

    You can try concatenate the whole folder path in the derived column transformation where you are forming the file name, like below - ('qatemp/',$detination,'/',<filenamelogic>)

    this should derive to a string with the whole folderpath plus filename.

    Please try this and let us know how it goes.


    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful