How to extract lineage from on-prem sql server ?

Question

How to extract lineage from on-prem sql server ?

Ritik 5

I want to scan store procedure from on-prem sql server as well as extract the lineage, Is there any way to achieve it either using Mircosoft Purview or using Apache Atlas API?

I'm not using any ADF pipeline to transform the data, data is moving and transforming using store procedures.

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-05-09T15:22:26.2833333+00:00

@Ritik Just checking in to see if any of the below information was helpful. If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. If you have any further query, do let us know.

Thank you
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-05-11T03:34:29.0866667+00:00

@Ritik We still have not heard back from you. Just wanted to check if the below information was helpful? If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Thank you
LiHongMSFT-4306 31,566 Reputation points

2023-05-19T08:30:52.0033333+00:00

Hi @Ritik

Do you have further question on this issue, could we offer more support?

If any answer helps on your issue, you could mark it as answer so other user with similar problem could see this easier. :)
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Nazeer Ali Mohammed 0 Reputation points

2024-10-03T16:20:40.24+00:00

Hi @Ritik

We have a connector called the MPP Connector, designed to scan metadata from on-premises SQL Server and load the lineage directly into Azure Purview. This solution enables seamless integration and enhanced data governance. For more details, visit our page here: MPP Connector Info, or feel free to reach out to us directly at ******@prolifics.com.

We'd be happy to assist!

3 answers

Your answer

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-05-09T15:22:26.2833333+00:00

@Ritik Just checking in to see if any of the below information was helpful. If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. If you have any further query, do let us know.

Thank you
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-05-11T03:34:29.0866667+00:00

@Ritik We still have not heard back from you. Just wanted to check if the below information was helpful? If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Thank you
LiHongMSFT-4306 31,566 Reputation points

2023-05-19T08:30:52.0033333+00:00

Hi @Ritik

Do you have further question on this issue, could we offer more support?

If any answer helps on your issue, you could mark it as answer so other user with similar problem could see this easier. :)
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Nazeer Ali Mohammed 0 Reputation points

2024-10-03T16:20:40.24+00:00

Hi @Ritik

We have a connector called the MPP Connector, designed to scan metadata from on-premises SQL Server and load the lineage directly into Azure Purview. This solution enables seamless integration and enhanced data governance. For more details, visit our page here: MPP Connector Info, or feel free to reach out to us directly at ******@prolifics.com.

We'd be happy to assist!

Answer 1

LiHongMSFT-4306 31,566

Hi @Ritik

Lineage from stored procedures for the Azure SQL database has been released into public preview. Please refer to this article: Introducing dynamic lineage extraction from Azure SQL Databases in Azure Purview.

However, it seems that the On-premise SQL Server haven't been updated.

Best regards,

Cosmog Hong

If the answer is the right solution, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

Note: Please follow the steps in our Documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

Ritik 5 Reputation points

2023-05-08T07:37:55.5066667+00:00

Is it possible extracting the lineage and Scanning the stored precedure from on-prem sql server using Apache atlas API ?
LiHongMSFT-4306 31,566 Reputation points

2023-05-09T00:59:55.4766667+00:00

As answered below, Mircosoft Purview or using Apache Atlas API doesn't support Lineage for On-prem SQL server.

Answer 2

@Ritik

Thanks for using Microsoft Q&A forum and posting your query.

I want to scan store procedure from on-prem sql server as well as extract the lineage, Is there any way to achieve it either using Mircosoft Purview or using Apache Atlas API?

No, Mircosoft Purview or using Apache Atlas API doesn't support Lineage for On-prem SQL server.

Ref doc: Connect to and manage an on-premises SQL server instance in Microsoft Purview

Ref article: Atlas and Purview API Coverage

Microsoft Purview has limited lineage support if the on-prem sql dataset (only tables) is used as source/sink in ADF copy activity. Else it is not supported.

If you have additional feedback or a feature request, please feel free to share your comments on this existing feature requst item: Scanning/Lineage of stored procedures in SQL Server and Azure SQL

Hope this helps.

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Answer 3

Erland Sommarskog 121.4K MVP Volunteer Moderator

You can scan them from Purview if you enable for you servers for Azure Arc. I guess this would be the starting point: https://learn.microsoft.com/en-us/azure/azure-arc/servers/learn/quick-enable-hybrid-vm. This articles talks about Windows, but as I understand that is the starting point. You first enable the machine on OS level, and then you add SQL Server.

I am myself planning to look into Azure Arc more closely.

Share via

How to extract lineage from on-prem sql server ?

3 answers

Your answer