Performance of CLR integration architecture
Applies to: 
SQL Server
Azure SQL Managed Instance
This article discusses some of the design choices that enhance the performance of SQL Server integration with the Microsoft .NET Framework common language runtime (CLR).
The compilation process
During compilation of SQL expressions, when a reference to a managed routine is encountered, a Microsoft intermediate language (MSIL) stub is generated. This stub includes code to marshal the routine parameters from SQL Server to the CLR, invoke the function, and return the result. This "glue" code is based on the type of parameter and on parameter direction (in, out, or reference).
The glue code enables type-specific optimizations and ensures efficient enforcement of SQL Server semantics, such as nullability, constraining facets, by-value, and standard exception handling. By generating code for the exact types of the arguments, you avoid type coercion or wrapper object creation costs (called "boxing") across the invocation boundary.
The generated stub is then compiled to native code and optimized for the particular hardware architecture on which SQL Server executes, using the just-in-time (JIT) compilation services of the CLR. The JIT services are invoked at the method level and allow the SQL Server hosting environment to create a single compilation unit that spans both SQL Server and CLR execution. Once the stub is compiled, the resulting function pointer becomes the run-time implementation of the function. This code generation approach ensures that there are no extra invocation costs related to reflection or metadata access at run time.
Fast transitions between SQL Server and CLR
The compilation process yields a function pointer that can be called at run time from native code. For scalar-valued user-defined functions, this function invocation happens on a per-row basis. To minimize the cost of transitioning between SQL Server and the CLR, statements that contain any managed invocation have a startup step to identify the target application domain. This identification step reduces the cost of transitioning for each row.
Performance considerations
The following section summarizes performance considerations specific to CLR integration in SQL Server. For more information, see Using CLR Integration in SQL Server 2005. For information about managed code performance, see Improving .NET Application Performance and Scalability.
User-defined functions
CLR functions benefit from a quicker invocation path than Transact-SQL user-defined functions. Additionally, managed code has a decisive performance advantage over Transact-SQL in terms of procedural code, computation, and string manipulation. CLR functions that are computing-intensive and that don't perform data access are better written in managed code. Transact-SQL functions do, however, perform data access more efficiently than CLR integration.
User-defined aggregates
Managed code can significantly outperform cursor-based aggregation. Managed code generally performs slightly slower than built-in SQL Server aggregate functions. We recommend that if a native built-in aggregate function exists, you should use it. In cases in which the needed aggregation isn't natively supported, consider a CLR user-defined aggregate over a cursor-based implementation for performance reasons.
Streaming table-valued functions
Applications often need to return a table as a result of invoking a function. Examples include reading tabular data from a file as part of an import operation, and converting comma-separated-values to a relational representation. Typically, you can accomplish this by materializing and populating the result table before it can be consumed by the caller. The integration of the CLR into SQL Server introduces a new extensibility mechanism called a streaming table-valued function (STVF). Managed STVFs perform better than comparable extended stored procedure implementations.
STVFs are managed functions that return an IEnumerable interface. IEnumerable has methods to navigate the result set returned by the STVF. When the STVF is invoked, the returned IEnumerable is directly connected to the query plan. The query plan calls IEnumerable methods when it needs to fetch rows. This iteration model allows results to be consumed immediately after the first row is produced, instead of waiting until the entire table is populated. It also significantly reduces the memory consumed by invoking the function.
Arrays vs. cursors
When Transact-SQL cursors must traverse data that is more easily expressed as an array, managed code can be used with significant performance gains.
String data
SQL Server character data, such as varchar, can be of the type SqlString or SqlChars in managed functions. SqlString variables create an instance of the entire value into memory. SqlChars variables provide a streaming interface that can be used to achieve better performance and scalability by not creating an instance of the entire value into memory. This becomes important for large object (LOB) data. Additionally, server XML data can be accessed through a streaming interface returned by SqlXml.CreateReader().
CLR vs. extended stored procedures
The Microsoft.SqlServer.Server application programming interfaces (APIs) that allow managed procedures to send result sets back to the client perform better than the Open Data Services (ODS) APIs used by extended stored procedures. Furthermore, the System.Data.SqlServer APIs support data types such as xml, varchar(max), nvarchar(max), and varbinary(max), introduced in SQL Server 2005 (9.x), while the ODS APIs haven't been extended to support the new data types.
With managed code, SQL Server manages use of resources such as memory, threads, and synchronization. This is because the managed APIs that expose these resources are implemented on top of the SQL Server resource manager. Conversely, SQL Server has no view or control over the resource usage of the extended stored procedure. For example, if an extended stored procedure consumes too much CPU or memory resources, there's no way to detect or control this with SQL Server. With managed code, however, SQL Server can detect that a given thread hasn't yielded for a long period of time, and then force the task to yield so that other work can be scheduled. So, using managed code provides for better scalability and system resource usage.
Managed code might incur extra overhead necessary to maintain the execution environment and perform security checks. This is the case, for example, when running inside SQL Server and numerous transitions from managed to native code are required (because SQL Server needs to do extra maintenance on thread-specific settings when moving out to native code and back). So, extended stored procedures can significantly outperform managed code running inside SQL Server for cases in which there are frequent transitions between managed and native code.
Note
Don't develop new extended stored procedures, because this feature is deprecated.
Native serialization for user-defined types
User-defined types (UDTs) are designed as an extensibility mechanism for the scalar type system. SQL Server implements a serialization format for UDTs called Format.Native. During compilation, the structure of the type is examined to generate MSIL that is customized for that particular type definition.
Native serialization is the default implementation for SQL Server. User-defined serialization invokes a method defined by the type author to do the serialization. Format.Native serialization should be used when possible for best performance.
Normalization of comparable UDTs
Relational operations, such as sorting and comparing UDTs, operate directly on the binary representation of the value. This is accomplished by storing a normalized (binary ordered) representation of the state of the UDT on disk.
Normalization has two benefits:
it makes the comparison operation considerably less expensive by avoiding the construction of the type instance and the method invocation overhead
it creates a binary domain for the UDT, enabling the construction of histograms, indexes, and histograms for values of the type.
So, normalized UDTs have a similar performance profile to the native built-in types for operations that don't involve method invocation.
Scalable memory usage
In order for managed garbage collection to perform and scale well in SQL Server, avoid large, single allocation. Allocations greater than 88 kilobytes (KB) in size are placed on the Large Object Heap, which causes garbage collection to perform and scale worse than many smaller allocations. For example, if you need to allocate a large multi-dimensional array, it's better to allocate a jagged (scattered) array.