Data flow blob json sink destination path problem

Anonymous
2022-08-16T08:31:45.067+00:00

Hi!

My data flow is pretty simple:
231405-image.png

  1. source -> blob file full of JSON objects
  2. derivative column -> to add fileName column to every item
  3. sink -> inline blob JSON that saves every item to a separate file by column "fileName"

This is my sink setup:
231414-image.png

As you can see the path is based on a "destination" parameter. Unfortunately, when I run this data flow, all files are placed in the container root as well as an empty file named by the "destination" parameter.
231406-image.png

Is this a bug, or am I doing something wrong? The empty file is not a problem, but why all files are not placed in the destination folder?

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,436 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,603 questions
0 comments No comments
{count} votes

Accepted answer
  1. Suba Balaji 11,186 Reputation points
    2022-08-16T11:01:03.403+00:00

    Hi @Anonymous ,

    Thanks for posting your query on MS Q&A portal.

    You can try concatenate the whole folder path in the derived column transformation where you are forming the file name, like below -

    @markus.bohland@hotmail.de ('qatemp/',$detination,'/',<filenamelogic>)

    this should derive to a string with the whole folderpath plus filename.

    Please try this and let us know how it goes.

    thanks

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful