Del via


Azure Data Lake

Azure Data Lake Store connector allows you to read and add data to an Azure Data Lake account.

This connector is available in the following products and regions:

Service Class Regions
Logic Apps Standard All Logic Apps regions except the following:
     -   Azure Government regions
     -   Azure China regions
     -   US Department of Defense (DoD)
Power Automate Premium All Power Automate regions except the following:
     -   US Government (GCC)
     -   US Government (GCC High)
     -   China Cloud operated by 21Vianet
     -   US Department of Defense (DoD)
Power Apps Premium All Power Apps regions except the following:
     -   US Government (GCC)
     -   US Government (GCC High)
     -   China Cloud operated by 21Vianet
     -   US Department of Defense (DoD)
Contact
Name Microsoft
URL Microsoft LogicApps Support
Microsoft Power Automate Support
Microsoft Power Apps Support
Connector Metadata
Publisher Microsoft
Website https://azure.microsoft.com/solutions/data-lake/

To use this integration, you will need an Azure Data Lake Storage Gen1 account. You can create account in 3 ways: use Azure PowerShell; use Azure CLI; use Azure portal. For more information, see Get started.

Azure Data Lake Storage Gen2

The Azure Data Lake connector supports only Azure Data Lake Gen1. However, the Azure Blob Storage connector supports connecting to Azure Data Lake Storage Gen2 (ADLS Gen2) accounts, using multi-protocol access. You can read more about this new feature, including the availability and known limitations, in this blog.

Known Issues and Limitations

  • The connector support Azure Data Lake Gen1.
  • The Azure Data Lake limitations are documented here.
  • An error "Another chunk upload session is still active" may occur if throttling limits was exceeded during file upload. To avoid this, consider adding a delay between uploading multiple large files to the storage.

Creating a connection

The connector supports the following authentication types:

Default Parameters for creating connection. All regions Not shareable

Default

Applicable: All regions

Parameters for creating connection.

This is not shareable connection. If the power app is shared with another user, another user will be prompted to create new connection explicitly.

Throttling Limits

Name Calls Renewal Period
API calls per connection 3600 60 seconds

Actions

Append File (concurrent)

Concurrent append to a file.

Append File (sequential)

Append to a file serially.

Create Folder

Create a folder in a Data Lake Store account.

Delete File

Delete a file from a Data Lake Store account.

List Files

List files and folders in a Data Lake Store account.

Read File

Read data from a Data Lake Store account.

Upload File

Upload data into a Data Lake Store account.

Append File (concurrent)

Concurrent append to a file.

Parameters

Name Key Required Type Description
Account name
account True string

Account name for Azure Data Lake.

Append mode
appendMode string

Set to auto-create if path doesn't exist.

File path
filepath True string

Path of the file (no leading '/').

Content
body True binary

Content of the file

Returns

Operation message
string

Append File (sequential)

Append to a file serially.

Parameters

Name Key Required Type Description
Account name
account True string

Account name for Azure Data Lake.

File path
filepath True string

Path of the file (no leading '/').

Content
body True binary

Content to append

Offset
offset integer

The optional offset in the stream to begin the append operation. Leave it empty or set value to file size in bytes. In both cases, the operation appends at the end of the stream.

Create Folder

Create a folder in a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
account True string

Account name for Azure Data Lake.

Folder path
path True string

Path of the folder to create (no leading '/').

Returns

Delete File

Delete a file from a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
account True string

Account name for Azure Data Lake.

File path
filepath True string

Path of the file (no leading '/').

Returns

List Files

List files and folders in a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
account True string

Account name for Azure Data Lake.

Folder path
path string

Path of the folder (no leading '/').

Returns

Read File

Read data from a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
account True string

Account name for Azure Data Lake.

File path
filepath True string

Path of the file (no leading '/').

Returns

File content
binary

Upload File

Upload data into a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
account True string

Account name for Azure Data Lake.

File path
filepath True string

Path of the file (no leading '/').

Overwrite
overwrite boolean

Overwrite if existing file.

Content
body True binary

Content of the file

Definitions

folderResponse

Name Path Type Description
FileStatus
FileStatuses.FileStatus fileStatusArray

FileStatus

fileStatusArray

FileStatus

Name Path Type Description
File name
pathSuffix string

File or folder name.

Type
type string

Type of item (directory or file).

Block Size
blockSize integer

Block size of folder or file.

Access Time
accessTime integer

Unix (Epoch) time when the item last accessed.

Modification Time
modificationTime integer

Unix (Epoch) time when the item last modified.

operationPerformed

Name Path Type Description
Is Successful
boolean boolean

Flag if the last operation was successful.

string

This is the basic data type 'string'.

binary

This is the basic data type 'binary'.