how to store the script return value as a dataset that can be used in dataflow

LI CHENG LAM 25 Reputation points
2023-06-02T04:23:48.7433333+00:00

Hi want to seek help here.

I have a written a sql query to do some query on db, the return value will be used as lookup table to use in dataflow. Currently, ard 600 row records has been returned in the script activity, how can i output those JSON value as as csv format for me to use in other dataflow

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,526 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Suba Balaji 11,186 Reputation points
    2023-06-02T06:20:46.8666667+00:00

    Hello, Welcome to MS q&a platform.

    If your source database is not in on premise, you can simply add second source in your data flow and use the result in look up transformation in data flow directly.

    Please refer to this video : https://youtu.be/9U-0VPU2ZPU

    One difference in the video is, in source, you will have to write query under source options instead of directly pointing to table.

    If your source is in on Prem we will have to use private end points/vpn as shown in the video, https://learn.microsoft.com/en-us/azure/data-factory/tutorial-managed-virtual-network-on-premise-sql-server

    Please let us know if you have questions.

    0 comments