Can Assert transformation log file name be customised in Azure Data Factory

Partha Das 286 Reputation points
2022-12-20T13:48:25.317+00:00

Hi,

In ADF, Assert Transformation logs data in storage container but the file name is very cryptic.
272485-storage-container.jpg

Can this be customized to give it a more meaningful name? Is any configuration possible anywhere?
272498-dataflow-config.jpg

Also if the structure of the contents present in the CSV file can be changed?

Please help.

Regards,
Partha

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions
0 comments No comments
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator
    2022-12-21T08:38:20.333+00:00

    Hi @Partha Das ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

    As I understand your query, you want to know if there is any way to explicitly provide the file name to the log files after assert transformation is failing for the errored rows. Please let me know if that is not the ask.

    I tried to repro your case, and got to notice that it's not possible to explicitly provide the file name for the log file capturing error rows after assert transformation.

    However, the workaround you can go for is to filter out and get only the errored row using filter transformation and load them into a separate sink (.csv file) and provide the filename explicitly.

    272856-erroredrow.gif

    For more details, kindly check out : https://www.youtube.com/watch?v=VFRx0wjlA4s

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.