Synapse - spark table over CSV - date not matching file

Ryan Abbey 1,181 Reputation points
2023-05-03T22:39:28.64+00:00

We are seeing a really odd issue... we have a Spark table configured to read a CSV file, for a particular row in the file, we have a date column which is set to "2023-05-02T21:27:34.3299026Z". If we query that row via the table via Synapse Serverless, we get "2023-05-02 21:27:34", however, when querying that exact same table from within a Notebook session is giving us "2023-05-02T22:22:33Z"

The time discrepancy appears to vary across the records, anyone with any ideas as to how they are being read differently?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,565 questions
{count} votes