Share via

Documenting Data Factory Pipelines

Yonatan Grinberg 46 Reputation points
2021-06-21T09:22:35.11+00:00

Hi,

While defining documentation aspects on pipelines (mostly from on premise databases to azure synapse via data factory pipelines).
Looking for best practice suggestions on documenting pipelines and synapse sql stored procedures.

My team is currently using a network folder but thinking of using azure devops wiki.

Was wondering if there is some better way to link the pipeline to the corresponding documentation so that you could access it from a link within the data factory graphical modeling UI.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,373 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions
Accepted answer
  1. Vaibhav Chaudhari 38,916 Reputation points Volunteer Moderator
    2021-06-21T09:50:38.993+00:00

    DevOps Wiki would be good place where you can document the pipeline details manually and provide links to the ADF.

    There is Azure Purview service as well which can help you with data lineage which shows what data is flowing where.

    https://learn.microsoft.com/en-us/azure/purview/how-to-link-azure-data-factory#supported-lineage-patterns

    ----------

    Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

    2 people found this answer helpful.

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.