Does synapse serverless sql pool OPENROWSET support "parquest based structured stream" format?

Question

I can read from a data lake structured stream using synapse serverless sql pool OPENROWSET, by specifying FORMAT = 'SSTREAM'. Does OPENROWSET support "parquest based structured stream" format? If yes, then what value should I specify to FORMAT argument?

Answer 1

@Salander He - Thanks for the question and using MS Q&A platform.

Unfortuantely, we don’t support querying parquet based SStream. We do work on that feature, and we will support it in future and I will update once it's available.

According to the documentation: How to use OPENROWSET using serverless SQL pool in Azure Synapse Analytics, OPENROWSET in Synapse serverless SQL pool supports CSV, Parquet, and Delta formats.

You have three choices for input files that contain the target data for querying. Valid values are:

• 'CSV' - Includes any delimited text file with row/column separators. Any character can be used as a field separator, such as TSV: FIELDTERMINATOR = tab.
• 'PARQUET' - Binary file in Parquet format
• 'DELTA' - A set of Parquet files organized in Delta Lake (preview) format

Therefore, you can read from a Parquet-based structured stream using Synapse serverless SQL pool OPENROWSET by specifying FORMAT = 'PARQUET'.

Here is an example query that reads from a Parquet file using OPENROWSET:

SELECT * FROM OPENROWSET( BULK 'https://yourstorageaccount.blob.core.windows.net/yourcontainer/yourfile.parquet', FORMAT = 'PARQUET' ) AS rows

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.