azure ml designer: how to use parameters with sql transformation?

javier 921 Reputation points
2021-04-24T16:23:49.04+00:00

Hi, I would like to apply an SQL Query Transformation to my data in Azure ML Designer but the transformation needs to take two parameters as inputs. How do I reference them

The idea is to have something like this:

select * from customers where account = [param1] and cuType = [param2] 

I have defined param1 and param2 as pipeline parameters but not sure how to reference them in the sql script

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,576 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Ramr-msft 17,616 Reputation points
    2021-04-26T10:55:52.5+00:00

    @javier Thanks for the question, When designing a pipeline in Azure ML Designer, each step or module creates intermediate datasets that can be seen using the UI. Those datasets are persisted in the blob storage. To filter data, you can use Apply SQL Transformation to write SQL query or Split Data using regular expression. You can also use Execute Python Script and Execute R script module to write your own data processing logic.

    Designer Pipeline Documentation:https://github.com/Azure/AzureMachineLearningGallery/blob/main/pipelines/README.md