azure ml designer: how to use parameters with sql transformation?

javier 901 Reputation points
2021-04-24T16:23:49.04+00:00

Hi, I would like to apply an SQL Query Transformation to my data in Azure ML Designer but the transformation needs to take two parameters as inputs. How do I reference them

The idea is to have something like this:

select * from customers where account = [param1] and cuType = [param2] 

I have defined param1 and param2 as pipeline parameters but not sure how to reference them in the sql script

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
1,640 questions
No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Ramr-msft 10,066 Reputation points Microsoft Employee
    2021-04-26T10:55:52.5+00:00

    @javier Thanks for the question, When designing a pipeline in Azure ML Designer, each step or module creates intermediate datasets that can be seen using the UI. Those datasets are persisted in the blob storage. To filter data, you can use Apply SQL Transformation to write SQL query or Split Data using regular expression. You can also use Execute Python Script and Execute R script module to write your own data processing logic.

    Designer Pipeline Documentation:https://github.com/Azure/AzureMachineLearningGallery/blob/main/pipelines/README.md