CREATE EXTERNAL DATA SOURCE not working on SQL Server 2022 Linux for S3

Mounir.B 26 Reputation points
2022-10-20T14:31:00.563+00:00

Hi all,

I have SQL 2022 installed on docker with Polybase enabled. I am not able to add an external data source for S3.

AWS CLI works fine for the same credentials.

CREATE DATABASE SCOPED CREDENTIAL s3_dc WITH IDENTITY = 'S3 Access Key', SECRET = 'XXXX:YYY'
Worked OK

CREATE EXTERNAL DATA SOURCE s3_ds WITH(LOCATION = 's3://my-s3-server/', CREDENTIAL = s3_dc);
Failed
Msg 111631, Level 16, State 1, Server PDWTDSSERVER, Line 1
111631;The specified parameter for external data source scheme (s3) is not valid.

Logs:
Error (PDW Component Failures): . - sqldweng(852):
s3MetadataProcessor
System.NotImplementedException: s3MetadataProcessor
at Microsoft.SqlServer.DataWarehouse.Common.Ioc.ObjectFactoryProvider.ObjectFactory.GetObject(String name, Object[] constructorArgs)
at Microsoft.SqlServer.DataWarehouse.Common.Ioc.ObjectFactoryProvider.ObjectFactory.GetObjectT
at Microsoft.SqlServer.DataWarehouse.Common.Ioc.Resolver.ResolveT
at Microsoft.SqlServer.DataWarehouse.Common.Ioc.ObjectFactoryProvider.ObjectFactory.GetObject(String name, Object[] constructorArgs)
at Microsoft.SqlServer.DataWarehouse.Common.Ioc.ObjectFactoryProvider.ObjectFactory.GetObjectT
at Microsoft.SqlServer.DataWarehouse.Common.Ioc.Resolver.ResolveT
2022-10-20 13:49:15.84 Encountered error(46714) with major(467), minor(14), severity(25), state(1) while processing request

My docker image is based on 252525-image.png with the polybase package installed mssql-server-polybase installed.

Thanks

SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
12,823 questions
{count} votes

Accepted answer
  1. YufeiShao-msft 7,061 Reputation points
    2022-10-21T08:37:09.167+00:00

    Hi @Mounir.B

    If you have solved your problem, please mark as accepted answer so it can be helpful for other community members with same questions.

    Regards

    Check out this doc:
    https://learn.microsoft.com/en-us/sql/linux/sql-server-linux-configure-mssql-conf?view=sql-server-ver16#traceflags

    Enable a trace flag 13702 will help you, use the following commands:

    sudo /opt/mssql/bin/mssql-conf traceflag 13702 on  
    

    -------------

    If the answer is the right solution, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

    1 person found this answer helpful.
    0 comments No comments

1 additional answer

Sort by: Most helpful
  1. Mounir.B 26 Reputation points
    2022-10-20T18:25:31.977+00:00

    I was able to fix the issue :

    252568-image.png

    1 person found this answer helpful.
    0 comments No comments