T-N record pull from API

Question

T-N record pull from API

Karthik Malaiyappan 0

I am using rest linked service to copy the data from web using API and inserting the data into database. every time I run the pipeline it will get the whole data and now I want to restrict the pipeline base on the data like one day before inserted/modified data?

I believe that there should be a way to do that using parameter or some other way? since I am new to ADF I am not pretty aware of it the functionality. Any help would be greatly appreciated.

Thanks.

Subashri Vasudevan 11,306 Reputation points Volunteer Moderator

2023-07-17T16:15:00.6833333+00:00

Hi Karthik, Do you have any column that has dates?
Karthik Malaiyappan 0 Reputation points

2023-07-17T17:21:22.5666667+00:00

Subashri Vasudevan Thanks for getting back to me.

Yes I do have dates which is part of the response as you see below in the mapping.
Vahid Ghafarpour 23,605 Reputation points

2023-07-17T18:35:32.9066667+00:00

Did you try to set a filter on createdAt or similar fields?

1 answer

Your answer

Subashri Vasudevan 11,306 Reputation points Volunteer Moderator

2023-07-17T16:15:00.6833333+00:00

Hi Karthik, Do you have any column that has dates?
Karthik Malaiyappan 0 Reputation points

2023-07-17T17:21:22.5666667+00:00

Subashri Vasudevan Thanks for getting back to me.

Yes I do have dates which is part of the response as you see below in the mapping.
Vahid Ghafarpour 23,605 Reputation points

2023-07-17T18:35:32.9066667+00:00

Did you try to set a filter on createdAt or similar fields?

Answer 1

Subashri Vasudevan 11,306 Volunteer Moderator

Hi Karthik

As you have mentioned, we can pass value of date as a parameter to url. Here is a thread in SO with similar use case, with only change, in the source data set you can use the below expression in relative url. (No need to use parameters in data set)

@concat('?CreatedAt=',addDays(utcNow(),-1))

Based on the format of the date, we could use the below expression.

@concat('?CreatedAt=',formatDateTime(addDays(utcNow(),-1),'MM/dd/yyyy')

Subashri Vasudevan 11,306 Reputation points Volunteer Moderator

2023-07-19T16:37:25.9766667+00:00

@Karthik Malaiyappan hello Karthik, did you get a chance to try the above suggestion? Was it useful? Please let us know if you have any question
Karthik Malaiyappan 0 Reputation points

2023-07-20T14:39:17.44+00:00

I have figured some other way out doing it. But I will try this when I get a time to do it.

I appreciate your input on this.
Subashri Vasudevan 11,306 Reputation points Volunteer Moderator

2023-07-20T16:03:53.2666667+00:00

Thanks Karthik.
ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2023-07-24T09:05:37.0966667+00:00

Hi Karthik Malaiyappan, Glad to know your issue resolved. Please feel to share your resolution details here and help to hit Accept Answer button. Accepted answers helps community as well. Thank you.
Karthik Malaiyappan 0 Reputation points

2023-07-24T18:37:08.5666667+00:00

ShaikMaheer-MSFT The request body has filtering feature as part of API call which I used to enhance the solution I need.

Thank you.
ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2023-07-26T06:45:20.6333333+00:00

Hi Karthik Malaiyappan, thank you for sharing resolution details. Kindly consider hitting Accept Answer button. Accepted answers help community as well. Please let me know if any further queries. Thank you.

Share via

T-N record pull from API

1 answer

Your answer