TabularDataset "topandasdataframe()" - does not support pandas errorbadlines?

Question

Hello,

I am trying to skip lines that produces more columns than intended while loading to a pandas dataframe.

Like this Pandas Option: When error_bad_lines = False, pandas will skip these lines.

How can I achieve this with to-pandas-dataframe? Thanks.

https://learn.microsoft.com/en-us/python/api/azureml-core/azureml.data.tabulardataset?view=azure-ml-py#to-pandas-dataframe-on-error--null---out-of-range-datetime--null--

Answer 1

@Sriram Narayanan As mentioned in the referred documentation link this option is not available with to_pandas_dataframe(), you can only use on_error='null' to replace the failed values with null or fail with exception if 'fail' is used.