Does SQL 2022 Standard Edition Polybase support Native S3 External Connection?

Michael Tarnarutsky 0 Reputation points
2024-12-29T14:47:40.2666667+00:00

I installed 2022 SQL Developer edition to check if there is a polybase support to connect to S3 natively.

I tested it on developer edition and its working correctly after installing all the proper CU versions.

Now my production server will be Standard SQL Server, not enterprise.

Is there any way for me to confirm that this feature specifically will be available on standard?

To give some code example I am talking about connecting to S3 without a Hadoop type:

CREATE EXTERNAL DATA SOURCE s3_ds
WITH
(   LOCATION = 's3://<ip_address>:<port>/'
,   CREDENTIAL = s3_dc
);
GO

Here is the documentation I found: https://learn.microsoft.com/en-us/sql/relational-databases/polybase/polybase-configure-s3-compatible?view=sql-server-ver16&viewFallbackFrom=sql-server-ver15

SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
14,321 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Erland Sommarskog 115.6K Reputation points MVP
    2024-12-29T15:53:11.8433333+00:00

    The place to investigate such matters is this one: https://learn.microsoft.com/en-us/sql/sql-server/editions-and-components-of-sql-server-2022?view=sql-server-ver16

    According to this page, Polybase is supported on all editons or SQL Server. There is no special mention of S3, but this is data virtualisation in general. The only explicit mention of S3 is "Backup and restore to S3-compatible object storage over REST API", which is supported on Standard Edition (but not Express).

    0 comments No comments

  2. ZoeHui-MSFT 39,671 Reputation points
    2024-12-30T02:57:45.0866667+00:00

    Hi @Michael Tarnarutsky,

    SQL Server 2022 (16.x) adds new connector, S3-compatible object storage, using the S3 REST API. You can use both OPENROWSET and CREATE EXTERNAL TABLE to query data files in S3-compatible object storage.

    Data virtualization with PolyBase in SQL Server

    Regards,

    Zoe Hui


    If the answer is helpful, please click "Accept Answer" and upvote it.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.