Table Storage Dynamic lookup query from ADF

Question

Hello everybody.

I'm trying to setup an ADF Pipeline that 'explodes' data from an Azure Table Storage to a file system creating csv files with dynamic names based on the Partition Key value of the table.

I have on the left side a list of devices taken from a SQL Azure DB (Now they're 16 but in real-life will be thousands) and for each device I need to create every day a CSV.

I've configured a copy pipeline like this

and set a TableStorage Source inside the FOR EACH cycle

and everything seems to work well except the fact that the filter expression of the TABLESTORAGE provide a strange error:

The function 'length' expects its parameter to be an array or a string. The provided value is of type 'Object'.

I've tried several ways to format the input string, all using or not the Dynamic Content to parse it but I always obtain the same error.

PartitionKey eq '{@item().deviceserial}' and Timestamp gt datetime'2021-02-01T00:00:00' and Timestamp le datetime'2021-02-02T00:00:00'
or
PartitionKey eq @item().deviceserial and Timestamp gt datetime'2021-02-01T00:00:00' and Timestamp le datetime'2021-02-02T00:00:00'

but nothing changes.

Where am I wrong ?
Thanks
Max

Answer 1

Hi @Max T ,

Thank you for posting query on Microsoft Q&A and thank you for sharing your pipeline json.

I see small errors in your pipeline json.

It seems you are passing @activity('lkDeviceList').output to items field in ForEach activity. You should pass @activity('lkDeviceList').output.value there.

Could you please update your configurations accordingly and see if that helps.

Hope this will help. Please let us know if any further queries. Thank you.

-------------------

• Please don't forget to click on Accept Answer button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators