Set up your Amazon S3 connection

This article outlines the steps to create an Amazon S3 connection.

Supported authentication types

The Amazon S3 connector supports the following authentication types for copy and Dataflow Gen2 respectively.

Authentication type Copy Dataflow Gen2
Access key n/a

Set up your connection in Dataflow Gen2

The Amazon S3 connector isn't currently supported in Dataflow Gen2.

Set up your connection in a data pipeline

Browse to the New connection page for the Data Factory pipeline to configure the connection details and create the connection.

Screenshot showing the new connection page.

You have two ways to browse to this page:

  • In copy assistant, browse to this page after selecting the connector.
  • In pipeline, browse to this page after selecting + New in Connection section and selecting the connector.

Step 1: Specify the new connection name, type, data source path

Screenshot showing how to set new connection.

In the New connection pane, specify the following field:

  • Url: Specify the account endpoint URL of your Amazon S3 data.

Step 2: Select and set your authentication

Under Authentication kind, select your authentication kind from the drop-down list and complete the related configuration. The Amazon S3 connector supports the following authentication types:

Screenshot showing the authentication kind for Amazon S3.

Access key authentication

  • Access Key Id: Specify the ID of the secret access key.
  • Secret Access Key: Specify the secret access key itself.

Screenshot showing the access key authentication kind for Amazon S3.

Step 3: Specify the privacy level that you want to apply

In the General tab, under Privacy level, select the privacy level that you want apply. Three privacy levels are supported. For more information, go to privacy levels.

Step 4: Create your connection

Select Create. Your creation is successfully tested and saved if all the credentials are correct. If the credentials aren't correct, the creation fails with errors.

Screenshot showing connection page.

Table summary

The following table contains connector properties that are supported in pipeline copy.

Name Description Required Property Copy
Connection name A name for your connection. Yes
Connection type Select Amazon S3 for your connection type. Yes
Data source path Enter your account endpoint URL of your Amazon S3. Yes
Authentication Go to Authentication Yes Go to Authentication

Authentication

The following table contains properties for the supported authentication type.

Name Description Required Property Copy
Access key
- Access Key Id Specify the ID of the secret access key. Yes
- Secret Access Key Specify the secret access key itself. Yes