I want to do validation as first step before proceeding further in pipeline execute. I am fetching metadata activity for my dataset and then checking it against a predefined schema in if condition.
Metadata for csv files show column type string even for integer which is breaking the validation.
For json files, structure field is not supported in metadata activity
I have a use case, where i need to validate the dataset(both column count and column types) against a predefined schema before going further in pipeline execution and my dataset will be json or csv files.