Developing a Custom Data Flow Component

Applies to: SQL Server SSIS Integration Runtime in Azure Data Factory

The data flow task consists of components that connect to a variety of data sources and then transform and route that data at high speed. Microsoft SQL Server Integration Services provides an extensible object model that lets developers create custom sources, transformations, and destinations that you can use in SQL Server Data Tools (SSDT) and in deployed packages. This section contains topics that will guide you in developing custom data flow components.

In This Section

Creating a Custom Data Flow Component
Describes the initial steps in creating a custom data flow component.

Design-time Methods of a Data Flow Component
Describes the design-time methods to implement in a custom data flow component.

Run-time Methods of a Data Flow Component
Describes the run-time methods to implement in a custom data flow component.

Execution Plan and Buffer Allocation
Describes the data flow execution plan and the allocation of data buffers.

Working with Data Types in the Data Flow
Explains how the data flow maps Integration Services data types to .NET Framework managed data types.

Validating a Data Flow Component
Explains the methods used to validate component configuration and to reconfigure component metadata.

Implementing External Metadata
Explains how to use external metadata columns for data validation.

Raising and Defining Events in a Data Flow Component
Explains how to raise predefined and custom events.

Logging and Defining Log Entries in a Data Flow Component
Explains how to create and write to custom log entries.

Using Error Outputs in a Data Flow Component
Explains how to redirect error rows to an alternative output.

Upgrading the Version of a Data Flow Component
Explains how to update saved component metadata when a new version of your component is first used.

Developing a User Interface for a Data Flow Component
Explains how to implement a custom editor for a component.

Developing Specific Types of Data Flow Components
Contains information about developing the three types of data flow components: sources, transformations, and destinations.

Reference

Microsoft.SqlServer.Dts.Pipeline
Contains the classes and interfaces used to create custom data flow components.

Microsoft.SqlServer.Dts.Pipeline.Wrapper
Contains the classes and interfaces that make up the data flow task object model, and is used to create custom data flow components or build a data flow task.

Microsoft.SqlServer.Dts.Pipeline.Design
Contains the classes and interfaces used to create the user interface for data flow components.

Integration Services Error and Message Reference
Lists the predefined Integration Services error codes with their symbolic names and descriptions.

Related Sections

Information Common to All Custom Objects

For information that is common to all the type of custom objects that you can create in Integration Services, see the following topics:

Developing Custom Objects for Integration Services
Describes the basic steps in implementing all types of custom objects for Integration Services.

Persisting Custom Objects
Describes custom persistence and explains when it is necessary.

Building, Deploying, and Debugging Custom Objects
Describes the techniques for building, signing, deploying, and debugging custom objects.

Information about Other Custom Objects

For information on the other types of custom objects that you can create in Integration Services, see the following topics:

Developing a Custom Task
Discusses how to program custom tasks.

Developing a Custom Connection Manager
Discusses how to program custom connection managers.

Developing a Custom Log Provider
Discusses how to program custom log providers.

Developing a Custom ForEach Enumerator
Discusses how to program custom enumerators.

See Also

Extending the Data Flow with the Script Component
Comparing Scripting Solutions and Custom Objects