Static Code Analysis for ADF or Synapse Pipelines in Azure

Debajit Mitra 20

Hi team,

I would like to know is there any use case possible to perform static code analysis of our ADF or Synapse pipelines residing in Azure DevOps repository?

Thanks,

Debajit Mitra

Nandan Hegde 32,416 Reputation points MVP

2024-06-14T05:25:29+00:00

Hey,

Can you provide some additional context behind your ask here? Do you mean to ask that in case if the ADF is got enabled, what can we do from that code within the Repo?
Debajit Mitra 20 Reputation points

2024-06-18T03:36:48.1033333+00:00

Hi @Nandan Hegde , our azure data factory code resides in azure devops repos after commit. Now is it possible to do some static code analysis on this adf pipeline code using some program extension inside azure devops after the build step.
Nandan Hegde 32,416 Reputation points MVP

2024-06-18T03:45:46.4733333+00:00

Can you specify what analysis you intend to do? Basically the code in the repo is a JSON format and in case if your analysis intends to be parsing the JSON, yes; it is doable
Smaran Thoomu 16,475 Reputation points Microsoft Vendor

2024-06-19T10:36:14.2+00:00

@Debajit Mitra We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Debajit Mitra 20 Reputation points

2024-06-19T17:17:03.4233333+00:00

Hi @Nandan Hegde , yes you are right the azure data factory code indeed is stored in json format per data pipeline basis inside Azure DevOps. Our intention is to perform checks on this code and validate it in terms of quality, reliability and security aspects like we normally carry out for any static code analysis for C, C++, Java and so on. So wanted to check if there is any specific tool or option to perform similar analysis for ADF part.

Accepted answer

Smaran Thoomu 16,475 Reputation points Microsoft Vendor

2024-06-20T06:24:34.0933333+00:00

Hi @Debajit Mitra
Thanks for the question and using MS Q&A platform.

Yes, it is possible to perform static code analysis on Azure Data Factory (ADF) pipelines residing in Azure DevOps repository. As you mentioned, the ADF code is stored in JSON format per data pipeline basis inside Azure DevOps. You can use any static code analysis tool that supports JSON format to perform checks on the code and validate it in terms of quality, reliability, and security aspects.

You can integrate static code analysis tools like SonarQube, Checkmarx, or Fortify with Azure DevOps to perform static code analysis on ADF pipelines. These tools can help you identify code quality issues, security vulnerabilities, and reliability issues in your ADF pipelines.

To integrate these tools with Azure DevOps, you can create a pipeline in Azure DevOps that includes a build step to generate the JSON files for your ADF pipelines. Then, you can add a static code analysis step to the pipeline that uses the tool of your choice to analyze the JSON files.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.
Nandan Hegde 32,416 Reputation points MVP

2024-06-20T06:33:52.3566667+00:00

Also adding on top is https://github.com/Azure-Player/azure.datafactory.tools

Debajit Mitra 20 Reputation points

2024-06-21T10:37:31.2333333+00:00

Hi @Smaran Thoomu , thanks for the detailed response. Its good to know we have option to perform the analysis in ADF code. Just wanted to check do you have any sample of such implementation using any of the tools you mentioned, a snippet would also suffice, to get an idea.

Smaran Thoomu 16,475 Reputation points Microsoft Vendor

2024-06-24T05:36:30.8133333+00:00

Debajit Mitra Currently, we do not have any sample implementations or snippets available for the tools mentioned. However, I can provide guidance on how to proceed with your specific use case if you need further assistance.

However, you can refer to the official documentation of the respective tools to get an idea of how to integrate them with Azure DevOps and perform static code analysis on ADF pipelines.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Static Code Analysis for ADF or Synapse Pipelines in Azure

0 additional answers

Your answer