DataFactory sink from variable array?

Klaus Nørregaard 1 Reputation point


I am looking for the best strategy or method to sink from a defined pipeline array. I have with success created a foreach loop, that iterates over a list of objects. Then each object have been stored within a Pipeline variable of type Array. Now I would like to sink the array to csv. How to do that?


Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,726 questions
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 25,651 Reputation points Microsoft Employee

    Hello @Klaus Nørregaard , @Ryan Abbey . Welcome to Microsoft Q&A.

    I don't want to interrupt the great collaboration you have going on, but I thought of suggesting another way.

    If you just need to get the data from a web-based source, use the HTTP dataset or the REST dataset. Web activity is more for getting meta-data.

    Web activity can be used to write via leveraging a storage api.

    It is also possible to write from an array by using the "additional column" feature in a delimited text dataset. The trick in this, is to use an almost-empty file as source, put the array into additional column, and map to sink.