Azure Data Factory - Lookup activity for ADLS G2/Blob - Can we have file name included in the output of the lookup activity?

BV 1 Reputation point
2021-09-22T10:21:12.547+00:00

Currently Lookup activity for ADLS G2/Blob returns only the data. Please can we have file name(s) included in the output of the lookup activity?
i.e. if the lookup activity is looking at a root folder and returns rows from multiple files or a single file, it would be great to include the file name (+ relative path) as a column in the results

Currently we can use Get Metadata activity and For Each Loop with Lookup to achieve this. But is really cumbersome.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,996 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. HimanshuSinha-msft 19,476 Reputation points Microsoft Employee
    2021-09-22T19:20:43.387+00:00

    Hello @BV ,
    Thanks for the ask and using Microsoft Q&A platform and sharing your feedback .
    You also pass on the feedback on rge ADF UI also , please see the snapshot below . We will be passing this feedback to the ADF team .

    134330-image.png

    Just on a side note , if you are reading the data from a single file , you can parameterized the dataset and pass the file name as a parameter , this will atleast unblock you for now as you can reference the parameter in the pipeline later . Off course this will not work for scenarios where we use wildcard .

    Please do let me know how it goes .
    Thanks
    Himanshu

    -------------------------------------------------------------------------------------------------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.