Guidelines for online index operations
Applies to: SQL Server Azure SQL Database Azure SQL Managed Instance
When you perform online index operations, the following guidelines apply:
- Clustered indexes must be created, rebuilt, or dropped offline when the underlying table contains the following large object (LOB) data types: image, ntext, and text.
- Nonunique nonclustered indexes can be created online when the table contains LOB data types but none of these columns are used in the index definition as either key or nonkey (included) columns.
- Indexes on local temp tables can't be created, rebuilt, or dropped online. This restriction doesn't apply to indexes on global temp tables.
- Indexes can be resumed from where it stopped after an unexpected failure, database failover, or a
PAUSE
command. See Create Index and Alter Index.
Note
Online index operations aren't available in every edition of Microsoft SQL Server. For a list of features that are supported by the editions of SQL Server, see Editions and supported features of SQL Server 2022.
The following table shows the index operations that can be performed online, the indexes that are excluded from these online operations, and resumable index restrictions. Additional restrictions are also included.
Online index operation | Excluded indexes | Other restrictions |
---|---|---|
ALTER INDEX REBUILD |
Disabled clustered index or disabled indexed view XML index Columnstore index Index on a local temp table |
Specifying the keyword ALL can cause the operation to fail when the table contains an excluded index.Additional restrictions on rebuilding disabled indexes apply. For more information, see Disable Indexes and Constraints. |
CREATE INDEX |
XML index Initial unique clustered index on a view Index on a local temp table |
|
CREATE INDEX WITH DROP_EXISTING |
Disabled clustered index or disabled indexed view Index on a local temp table XML index |
|
DROP INDEX |
Disabled index XML index Nonclustered index Index on a local temp table |
Multiple indexes can't be specified within a single statement. |
ALTER TABLE ADD CONSTRAINT (PRIMARY KEY or UNIQUE ) |
Index on a local temp table Clustered index |
Only one subclause is allowed at a time. For example, you can't add and drop PRIMARY KEY or UNIQUE constraints in the same ALTER TABLE statement. |
ALTER TABLE DROP CONSTRAINT (PRIMARY KEY or UNIQUE ) |
Clustered index |
The underlying table can't be modified, truncated, or dropped while an online index operation is in process.
The online option setting (ON
or OFF
) specified when you create or drop a clustered index is applied to any nonclustered indexes that must be rebuilt. For example, if the clustered index is built online by using CREATE INDEX WITH DROP_EXISTING, ONLINE=ON
, all associated nonclustered indexes are recreated online also.
When you create or rebuild a UNIQUE
index online, the index builder and a concurrent user transaction might try to insert the same key, therefore violating uniqueness. If a row entered by a user is inserted into the new index (target) before the original row from the source table is moved to the new index, the online index operation fails.
Although not common, the online index operation can cause a deadlock when it interacts with database updates because of user or application activities. In these rare cases, the SQL Server Database Engine selects the user or application activity as a deadlock victim.
You can perform concurrent online index DDL operations on the same table or view only when you're creating multiple new nonclustered indexes, or reorganizing nonclustered indexes. All other online index operations performed at the same time fail. For example, you can't create a new index online while rebuilding an existing index online on the same table.
An online operation can't be performed when an index contains a column of the large object type, and in the same transaction there are update operations before this online operation. To work around this issue, place the online operation outside the transaction or place it before any updates in the transaction.
Disk space considerations
Online index operations require more disk space requirements than offline index operations.
- During index creation and index rebuild operations, additional space is required for the index being built (or rebuilt).
- In addition, disk space is required for the temporary mapping index. This temporary index is used in online index operations that create, rebuild, or drop a clustered index.
- Dropping a clustered index online requires as much space as creating (or rebuilding) a clustered index online.
For more information, see Disk Space Requirements for Index DDL Operations.
Performance considerations
Although online index operations permit concurrent user update activity, the index operations can take longer if the update activity is very heavy. Typically, online index operations are slower than equivalent offline index operations, regardless of the concurrent update activity level.
Because both the source and target structures are maintained during the online index operation, the resource usage for insert, update, and delete transactions is increased, potentially up to double. This could cause a decrease in performance and greater resource usage, especially CPU time, during the index operation. Online index operations are fully logged.
Although we recommend online operations, you should evaluate your environment and specific requirements. It might be optimal to run index operations offline. In doing so, user access to the data is restricted during the operation, but the operation finishes faster and uses fewer resources.
On multiprocessor computers that are running SQL Server 2016 (13.x), index statements can use more processors to perform the scan and sort operations associated with the index statement just like other queries do. You can use the MAXDOP
index option to control the number of processors dedicated to the online index operation. In this way, you can balance the resources that are used by index operation with resources of the concurrent users. For more information, see Configure Parallel Index Operations. For more information about the editions of SQL Server that support parallel index operations, see Editions and supported features of SQL Server 2022.
Because an S-lock or Sch-M lock is held in the final phase of the index operation, be careful when you run an online index operation inside an explicit user transaction, such as BEGIN TRANSACTION ... COMMIT
block. Doing this causes the lock to be held until the end of the transaction, therefore impeding user concurrency.
Online index rebuilding can increase fragmentation when it's runs with MAXDOP
greater than 1
, and ALLOW_PAGE_LOCKS=OFF
. For more information, see How It Works: Online Index Rebuild - Can Cause Increased Fragmentation.
Transaction log considerations
Large-scale index operations performed offline or online can generate large data loads, which cause the transaction log to quickly fill. This is because both offline and online index rebuild operations are fully logged. To make sure that the index operation can be rolled back, the transaction log can't be truncated until the index operation is completed; however, the log can be backed up during the index operation.
Therefore, the transaction log must have sufficient space to store both the index operation transactions and any concurrent user transactions during the index operation. For more information, see Transaction Log Disk Space for Index Operations.
Resumable index considerations
The resumable index option for create index and index rebuild applies to SQL Server (index rebuild starting with SQL Server 2017 (14.x), and create index supported in SQL Server 2019 (15.x)), and Azure SQL Database. For more information see Create Index and Alter Index.
When you perform resumable online index create or rebuild, the following guidelines apply:
- Managing, planning and extending of index maintenance windows. You can pause and restart an index create or rebuild operation multiple times to fit your maintenance windows.
- Recovering from index create or rebuild failures (such as database failovers or running out of disk space).
- When an index operation is paused, both the original index and the newly created one require disk space and need to be updated during DML operations.
- Enables truncation of transaction logs during an index create or rebuild operation.
SORT_IN_TEMPDB=ON
option isn't supported.- Disabled indexes aren't supported.
Important
Resumable index create or rebuild doesn't require you to keep open a long running transaction, allowing log truncation during this operation and a better log space management. With the new design, we managed to keep necessary data in a database together with all references required to restart the resumable operation.
Generally, there's no performance difference between resumable and nonresumable online index rebuild. For create resumable index, there's a constant overhead that causes a small performance difference between resumable and nonresumable index create. This difference is mostly noticeable only for smaller tables.
When you update a resumable index while an index operation is paused:
- For read-mostly workloads, the performance effect is insignificant.
- For update-heavy workloads, you can experience some throughput degradation (our testing shows less than 10% degradation).
Generally, there's no difference in defragmentation quality between resumable and nonresumable online index create or rebuild.
Note
While an online index operation is paused, any operation that requires a table-level exclusive lock on the table that contains the paused index will fail. This is most often encountered with INSERT ... WITH (TABLOCK)
operations. You might see the following error:
Msg 10637, Level 16, State 1, Line 32: Cannot perform this operation on 'object' with ID (objectid) as one or more indexes are currently in resumable index rebuild state. Please refer to sys.index_resumable_operations for more details.
To resolve error 10637, remove the TABLOCK
hint from your transaction, or unpause the index operation and wait for it to complete before attempting your transaction again.
Online default options
You can set default options for online or resumable at a database level by setting the ELEVATE_ONLINE
or ELEVATE_RESUMABLE
database scoped configuration options. With these default options, you can avoid accidentally performing an operation that takes your database table offline. Both options cause the engine to automatically elevate certain operations to online or resumable execution.
You can set either option as FAIL_UNSUPPORTED
, WHEN_SUPPORTED
, or OFF
using the ALTER DATABASE SCOPED CONFIGURATION command. You can set different values for online and resumable.
Both ELEVATE_ONLINE
and ELEVATE_RESUMABLE
only apply to DDL statements that support the online and resumable syntax respectively. For example, if you attempt to create an XML index with ELEVATE_ONLINE=FAIL_UNSUPORTED
, the operation will run offline since XML indexes don't support the ONLINE=
syntax. The options only affect DDL statements that are submitted without specifying an ONLINE or RESUMABLE option. For example, by submitting a statement with ONLINE=OFF
or RESUMABLE=OFF
, the user can override a FAIL_UNSUPPORTED
setting and run a statement offline and/or nonresumably.
Note
ELEVATE_ONLINE
and ELEVATE_RESUMABLE
don't apply to XML index operations.