Share via

How to Automatically create a Data Cycle diagram

ADM. Javier Gaig Mellado 0 Reputation points
2024-05-02T10:45:02.88+00:00

Currently, the entire data cycle of a project has been developed in Azure Data Factory.

The main objective is to have an automated visual scheme of the entire data cycle at a low level (from the basic activities, not the sequential execution of pipelines) to optimise the entire process.

In other words, by visually seeing how the data is modified, you can better understand the structure being created and thus implement system optimisation in a more optimal way.

To this end, the entire ADF project has already been implemented and an automated Excel has been created which, for each ADF activity and in order of execution, shows the origin and destination of the data.

Is there a tool that can help me to get a visual and automated diagram of this whole data cycle?

Thank you!

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,803 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. BhargavaGunnam-MSFT 27,976 Reputation points Microsoft Employee
    2024-05-02T19:06:06.4266667+00:00

    Hello ADM. Javier Gaig Mellado,Welcome to the Microsoft Q&A forum.

    Please correct me if I am wrong. You are looking for a tool that can visually represent the entire data cycle in Azure Data Factory.

    ADF it self provides monitoring features that allow you to visualize pipeline runs, activity runs, trigger runs, and debug runs.

    You can use Power BI to create custom dashboards and reports based on the data from ADF. This can provide a more granular view of the data cycle and help identify areas for optimization.

    Also, Azure Purview offers data governance and cataloging features that can help you map out your data landscape, including how data is transformed and moved.

    I hope this helps.

    0 comments