Ingestion behavior of invalid data

Data that is malformed, unparsable, too large, or doesn't conform to the schema may fail to be ingested properly. The following tables describe what to expect when ingesting invalid data into Azure Data Explorer.

Note

For more information about why ingestion might fail, see Ingestion failures and Ingestion error codes in Azure Data Explorer.

Failure with error code

The following table shows cases where ingestion of invalid data fails with an error code:

Ingestion problem Error code
Invalid or corrupted format (actual data does not match the specified format) BadRequest_InvalidBlob
Empty Data BadRequest_NoRecordsOrWrongFormat
Malformed records in JSON data ingested with format="multijson" (e.g. missing braces or quotes) BadRequest_InvalidBlob
CSV lines with inconsistent number of fields Stream_WrongNumberOfFields

Failure without error code

The following table shows cases where ingestion succeeds without an error, silently handling the invalid data:

Ingestion problem Notes
Malformed records in JSON data ingested with format="json". For example: unexpected newlines, missing braces or quotes. Malformed records are ignored and not ingested
Value larger than 1MB ingested into a string column Value truncated up to 1MB
Value larger than 1MB (default, see Encoding policy) ingested into a dynamic column NULL value filled
Value not matching the table schema data type. For example: floating point value ingested into an int column. NULL value filled
Mapped fields are missing from the data NULL value filled