Hi @JasonW-5564 ,
Welcome to Microsoft Q&A Platform. Thanks for posting the query.
Copy new files by LastModifiedDate template in data factory seems to be an appropriate approach for this requirement. This document currently uses binary source and binary destination datasets as this shows to copy any type of files. In your requirement, since soaurce type is JSON and destination type is Parquet, the same datasets can be created and used. This article also uses tumbling window trigger to pass the parameters and to run pipeline after scheduled time (In this case, it can be 1hour). More details and options in tumbling window trigger can be found in this document.
Please let us know for further queries and we will be glad to assist.
--
- Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
- Want a reminder to come back and check responses? Here is how to subscribe to a notification.