Events
Mar 31, 11 PM - Apr 2, 11 PM
The biggest SQL, Fabric and Power BI learning event. March 31 – April 2. Use code FABINSIDER to save $400.
Register todayThis browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
Applies to:
SQL Server
SSIS Integration Runtime in Azure Data Factory
Use the OData Source component in an SSIS package to consume data from an Open Data Protocol (OData) service.
The component supports the OData v3 and v4 protocols.
For OData V3 protocol, the component supports the ATOM and JSON data formats.
For OData V4 protocol, the component supports the JSON data format.
The OData source includes support for the following data sources:
https://<server>/_vti_bin/ListData.svc
. For more information about SharePoint URL conventions, see SharePoint Foundation REST Interface.The OData source supports the following simple data types: int, byte[], bool, byte, DateTime, DateTimeOffset, decimal, double, Guid, Int16, Int32, Int64, sbyte, float, string, and TimeSpan.
To discover the data types of columns in your data source, check the https://<OData feed endpoint>/$metadata
page.
For the Decimal data type, the precision and scale are determined by the source metadata. If the source metadata does not specify the Precision and Scale properties, the data may be truncated.
Important
The OData Source component does not support complex types, such as multiple-choice items, in SharePoint lists.
Note
If the source only allows TLS 1.2 connection, you need to enforce TLS 1.2 on your machine through registry settings. In an elevated command prompt run the following commands:
reg add HKLM\SOFTWARE\Microsoft.NETFramework\v4.0.30319 /v SchUseStrongCrypto /t REG_DWORD /d 1 /reg:64
reg add HKLM\SOFTWARE\Microsoft.NETFramework\v4.0.30319 /v SchUseStrongCrypto /t REG_DWORD /d 1 /reg:32
Most OData services can return results in multiple formats. You can specify the format of the result set by using the $format
query option. Formats such as JSON and JSON Light are more efficient than ATOM or XML, and may give you better performance when transferring large amounts of data. The following table provides results from sample tests. As you can see, there was a 30-53% performance gain when switching from ATOM to JSON and a 67% performance gain when switching from ATOM to the new JSON light format (available in WCF Data Services 5.1).
Rows | ATOM | JSON | JSON (Light) |
---|---|---|---|
10000 | 113 seconds | 74 seconds | 68 seconds |
1000000 | 1110 seconds | 853 seconds | 665 seconds |
Use the Connection page of the OData Source Editor dialog box to select the OData connection manager for the OData source. This page also lets you specify a collection or a resource path and any query options to indicate what data needs to be retrieved from the OData source.
OData connection manager
Select an existing connection manager from the list, or create a new connection by clicking New.
After you select or create a connection manager, the dialog box displays the OData protocol version that the connection manager is using.
New
Create a new connection manager by using the OData Connection Manager Editor dialog box.
Use collection or resource path
Specify the method for selecting data from the source.
Option | Description |
---|---|
Collection | Retrieve data from the OData source by using a collection name. |
Resource Path | Retrieve data from the OData source by using a resource path. |
Query options
Specify options for the query. For example: $top=5
Feed url
Displays the read-only feed URL based on options you selected on this dialog box.
Preview
Preview results by using the Preview dialog box. Preview can display up to 20 rows.
Collection
Select a collection from the drop-down list.
Resource path
Type a resource path. For example: Employees
Use the Columns page of the OData Source Editor dialog box to select external (source) columns to be included in the output and map them to output columns.
Available External Columns
View the list of available source columns in the data source. Use check boxes in the list to add to or remove columns to the table at the bottom of the page. The selected columns are added to the output.
External Column
View source columns that you chose to be included in the output.
Output Column
Provide a unique name for each output column. The default is the name of the selected external (source) column; however, you can choose any unique, descriptive name.
Use the Error Output page of the OData Source Editor dialog box to select error handling options and to set properties on error output columns.
Input/Output
View the name of the data source.
Column
View the external (source) columns that you selected on the Connection Manager page of the OData Source Editor dialog box.
Error
Specify what should happen when an error occurs: ignore the failure, redirect the row, or fail the component.
Related Topics: Error Handling in Data
Truncation
Specify what should happen when a truncation occurs: ignore the failure, redirect the row, or fail the component.
Description
View the description of the error.
Set this value to selected cells
Specify what should happen to all the selected cells when an error or truncation occurs: ignore the failure, redirect the row, or fail the component.
Apply
Apply the error handling option to the selected cells.
Events
Mar 31, 11 PM - Apr 2, 11 PM
The biggest SQL, Fabric and Power BI learning event. March 31 – April 2. Use code FABINSIDER to save $400.
Register today