@Prashant Welcome to Microsoft Q&A forum and thanks for reaching out here.
To better assist on your query, could you please confirm what is the connector you are using in Azure data factory? If it is a REST endpoint, could you please share the documentation link to the 4me API that you are referring to?
In case if you are referring to 4me API filters, then I would recommend reaching out in 4me Community Support as this is more of 4me side question rather than ADF. In case if you have tried string filters in API requests using other tools like POSTMAN and you are successful with it but not able to implement the same in ADF, then please let us how you are passing the query filters in POSTMAN which is working so that we can assist accordingly on how to implement in ADF. But if you are stuck on POSTMAN query filters then, as I called out, please reach out in 4me community support.
Additional info: I would also recommend reading through this documentation to better understand how filtering works in 4me REST endpoint.
This document has the sample for allowed filters, allowed operators and filter exceptions: 4me REST API filtering
The reason you are getting only 100 records is that 4me API requests that return collections of records are always paginated. The default page size of 20 records can be adjusted by setting the ?per_page=
parameter. The maximum number of records per page is 100.
If you expect records to be more than 100 then you will have to implement pagination in ADF.
For more info, please refer to this doc: ADF REST Connector Pagination support.
You can also refer to this sample demonstration video which can help you implement pagination in ADF: Copy data from REST API which sends response in Pages using Azure data factory.
Hope this info helps. If you have further questions, please do share few additional clarifications as requested above.
Thank you
Please don’t forget to Accept Answer
and Yes
for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.