Azure Table Storage with Lookup activity to obtain max date

Clara Pantoja Salado 6 Reputation points
2022-12-17T10:28:37.197+00:00

Hi,

I'm trying to use a lookup in datafactory to get the maximum date value stored in a column from my azure table storage but I can't get the desired result. Can you help me with the query syntax?

271596-lookup.png

Azure Table Storage
Azure Table Storage
An Azure service that stores structured NoSQL data in the cloud.
171 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,853 questions
Not Monitored
Not Monitored
Tag not monitored by Microsoft.
39,748 questions
{count} vote

1 answer

Sort by: Most helpful
  1. AnnuKumari-MSFT 33,401 Reputation points Microsoft Employee
    2022-12-19T07:03:02.577+00:00

    Hi @Clara Pantoja Salado ,

    Welcome to Microsoft Q&A platform and thanks for posting your question here.

    As I understand your issue, you are trying to get max date value from a column in table storage. Please let me know if that is not the ask.

    According to 'Querying tables and entities' documentation , the supported operators are : Equal,GreaterThan,GreaterThanOrEqual ,LessThan ,LessThanOrEqual, ,NotEqual, And, or and Not

    There is no direct option to get the max date . I would suggest you to copy the data to ADLS and get the max date value using Dataflow (cache sink). Or, copy the data to SQL server table and use SQL query on top of it to get max value.

    Resources: Cache Sink and Cached lookup in Mapping Data Flow in Azure Data Factory

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.