Editéieren

Deelen iwwer


Use the Lookup activity to look up data from a data source

The Fabric Lookup activity can retrieve a dataset from any of the data sources supported by Microsoft Fabric. You can use it to dynamically determine which objects to operate on in a subsequent activity, instead of hard coding the object name. Some object examples are files and tables.

Lookup activity reads and returns the content of a configuration file or table. It also returns the result of executing a query or stored procedure. The output can be a singleton value or an array of attributes, which can be consumed in a subsequent copy, transformation, or control flow activities like ForEach activity.

Prerequisites

To get started, you must complete the following prerequisites:

Add a lookup activity to a pipeline with UI

To use a Lookup activity in a pipeline, complete the following steps:

Creating the activity

  1. Create a new pipeline in your workspace.

  2. Search for Lookup in the pipeline Activities pane, and select it to add it to the pipeline canvas.

    Screenshot of the Fabric UI with the Activities pane and Lookup activity highlighted.

  3. Select the new Lookup activity on the canvas if it isn't already selected.

    Screenshot showing the General settings tab of the Lookup activity.

Refer to the General settings guidance to configure the General settings tab.

Lookup settings

Select the Settings tab, select an existing connection from the Connection dropdown, or create a new connection, and specify its configuration details.

Screenshot showing the Lookup activity settings tab highlighting the tab, and where to choose a new connection.

The example in the previous image shows a blob storage connection, but each connection type has its own configuration details specific to the data source selected.

Supported capabilities

  • The Lookup activity can return up to 5,000 rows; if the result set contains more records, the first 5,000 rows are returned.
  • The Lookup activity output supports up to 4 MB in size; activity fails if the size exceeds the limit.
  • The longest duration for Lookup activity before timeout is 24 hours.

Note

When you use query or stored procedure to look up data, make sure to return one and exact one result set. Otherwise, Lookup activity fails.

The following data sources are supported for Lookup activity.

Category Data store
Azure Azure Blob Storage
  Azure Cosmos DB for NoSQL
  Azure Databricks
  Azure Data Explorer
  Azure Database for MySQL
  Azure Database for PostgreSQL
  Azure Data Lake Storage Gen2
  Azure Files
  Azure SQL database
  Azure SQL Managed Instance
  Azure Synapse Analytics
  Azure Table Storage
Database Amazon RDS for Oracle
  Amazon RDS for SQL Server
  Amazon Redshift
  IBM Db2 database
  Google BigQuery
  Greenplum for Pipeline
  Informix For Pipeline
  MariaDB
  Microsoft Access
  MySQL database
  Oracle database
  PostgreSQL database
  Presto
  SAP BW Open Hub Application Server
  SAP BW Open Hub Message Server
  SAP HANA database
  SAP Table Application Server
  SAP Table Message Server
  Snowflake
  SQL Server database
  Teradata database
  Vertica
File Amazon S3
  Amazon S3 Compatible
  Folder
  FTP
  Google Cloud Storage
  Hdfs for Pipeline
  Oracle Cloud Storage
  SFTP
Generic protocol HTTP
  OData
  ODBC
Microsoft Fabric Lakehouse
  Data Warehouse
  KQL Database
  SQL database
NoSQL Cassandra
Services and apps Dataverse
  Dynamics 365
  Dynamics AX
  Dynamics CRM
  Salesforce objects
  Salesforce Service Cloud
  ServiceNow
  SharePoint Online List

Save and run or schedule the pipeline

Switch to the Home tab at the top of the pipeline editor and select the save button to save your pipeline. Select Run to run it directly or Schedule to schedule runs at specific times or intervals. For more information on pipeline runs, see: schedule pipeline runs.

Screenshot showing the Home tab in the pipeline editor with the tab name, Save, Run, and Schedule buttons highlighted.

After running, you can monitor the pipeline execution and view run history from the Output tab below the canvas.