Thank you for posting query in Microsoft Q&A Platform.
Yes, lookup activity can read up to 5000 rows or 4MB of size only. So you cannot use that in this case. You need to consider using mapping data flows. In
source transformation
use your file and then useaggregate transformation
to group all data and get count of rows. Finally usesink transformation
withoutput to activity
option. This helps to output the row count to output ofdata flow activity
.
Kindly consider checking below videos to understand each of above capabilities or transformations.
Aggregate Transformation in Mapping Data Flow in Azure Data Factory
Write Cache Sink to Activity Output in Azure Data factory
Hope this helps. Please let me know if any further queries.
Please consider hitting Accept Answer
button. Accepted answers help community as well.