mdvl-8474 Welcome to Microsoft Q&A forum!
If i run the custom pipeline manually, the parquet file got updated however if run on schedule the parquet file doesnt get updated.
Are you seeing any failure error messages? Which documentation are you following?
Did you check Schedule machine learning pipeline jobs and Trigger machine learning pipelines already?