Share via

Does SQL 2022 Standard Edition Polybase support Native S3 External Connection?

Michael Tarnarutsky 0 Reputation points
2024-12-29T14:47:40.2666667+00:00

I installed 2022 SQL Developer edition to check if there is a polybase support to connect to S3 natively.

I tested it on developer edition and its working correctly after installing all the proper CU versions.

Now my production server will be Standard SQL Server, not enterprise.

Is there any way for me to confirm that this feature specifically will be available on standard?

To give some code example I am talking about connecting to S3 without a Hadoop type:

CREATE EXTERNAL DATA SOURCE s3_ds
WITH
(   LOCATION = 's3://<ip_address>:<port>/'
,   CREDENTIAL = s3_dc
);
GO

Here is the documentation I found: https://learn.microsoft.com/en-us/sql/relational-databases/polybase/polybase-configure-s3-compatible?view=sql-server-ver16&viewFallbackFrom=sql-server-ver15

SQL Server | Other
SQL Server | Other

Additional SQL Server features and topics not covered by specific categories

0 comments No comments

2 answers

Sort by: Most helpful
  1. ZoeHui-MSFT 41,551 Reputation points
    2024-12-30T02:57:45.0866667+00:00

    Hi @Michael Tarnarutsky,

    SQL Server 2022 (16.x) adds new connector, S3-compatible object storage, using the S3 REST API. You can use both OPENROWSET and CREATE EXTERNAL TABLE to query data files in S3-compatible object storage.

    Data virtualization with PolyBase in SQL Server

    Regards,

    Zoe Hui


    If the answer is helpful, please click "Accept Answer" and upvote it.

    Was this answer helpful?

    0 comments No comments

  2. Erland Sommarskog 133.9K Reputation points MVP Volunteer Moderator
    2024-12-29T15:53:11.8433333+00:00

    The place to investigate such matters is this one: https://learn.microsoft.com/en-us/sql/sql-server/editions-and-components-of-sql-server-2022?view=sql-server-ver16

    According to this page, Polybase is supported on all editons or SQL Server. There is no special mention of S3, but this is data virtualisation in general. The only explicit mention of S3 is "Backup and restore to S3-compatible object storage over REST API", which is supported on Standard Edition (but not Express).

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.