What's new in Azure AI Search

Azure Cognitive Search is now Azure AI Search. Learn about the latest updates to Azure AI Search functionality, docs, and samples.

Note

Preview features are announced here, but we also maintain a preview features list so you can find them in one place.

April 2024

Item                         Type Description
Storage expansion on Basic and Standard tiers Feature Basic now supports up to three partitions and three replicas. Basic and Standard (S1, S2, S3) tiers have significantly more storage per partition, at the same per-partition billing rate. Extra capacity is subject to regional availability and applies to new search services created after April 3, 2024. Currently, there's no in-place upgrade, so please create a new search service to get the extra storage.
Increased quota for vectors Feature Vector quotas are also higher on new services created after April 3, 2024 in selected regions.
Built-in vector quantization, narrow vector data types, and a new stored property (preview) Feature This preview adds support for larger vector workloads at a lower cost through three enhancements. First, scalar quantization reduces vector index size in memory and on disk. Second, narrow data types can be assigned to vector fields that can use them. Third, we added more flexible vector field storage options.
2024-03-01-preview Search REST API API New preview version of the Search REST APIs for the new data types, vector compression properties, and storage options.
2024-03-01-preview Management REST API API New preview version of the Management REST APIs for control plane operations.
2023-07-01-preview deprecation announcement API Deprecation announced on April 8, 2024. Retirement on July 8, 2024. This was the first REST API that offered vector search support. Newer API versions have a different vector configuration. We recommend migrating to a newer version as soon as possible.

February 2024

Item                         Type Description
New dimension limits Feature For vector fields, maximum dimension limits are now 3072, up from 2048.

2023 announcements

Month Type Announcement
November Feature Vector search, generally available. The previous restriction on customer-managed keys (CMK) is now lifted. Prefiltering and exhaustive K-nearest neighbor algorithm are also now generally available.
November Feature Semantic ranking, generally available
November Feature Integrated vectorization (preview) adds data chunking and text-to-vector conversions during indexing, and also adds text-to-vector conversions at query time.
November Feature Import and vectorize data wizard (preview) automates data chunking and vectorization. It targets the 2023-10-01-Preview REST API.
November Feature Index projections (preview) defines the shape of a secondary index, used for a one-to-many index pattern, where content from an enrichment pipeline can target multiple indexes.
November API 2023-11-01 Search REST API is stable version of the Search REST APIs for vector search and semantic ranking. See Upgrade REST APIs for migration steps to generally available features.
November API 2023-11-01 Management REST API adds APIs that enable or disable semantic ranking.
November Skill Azure OpenAI Embedding skill (preview) connects to a deployed embedding model on your Azure OpenAI resource to generate embeddings during skillset execution.
November Skill Text Split skill (preview) updated in 2023-10-01-Preview to support native data chunking.
November Video How vector search and semantic ranking improve your GPT prompts explains how hybrid retrieval gives you optimal grounding data for generating useful AI responses and enables search over both concepts and keywords.
November Sample Role-based access control in Generative AI applications explains how to use Microsoft Entra ID and Microsoft Graph API to roll out granular user permissions on chunked content in your index.
October Sample "Chat with your data" solution accelerator. End-to-end RAG pattern that uses Azure AI Search as a retriever. It provides indexing, data chunking, and orchestration.
October Feature Exhaustive K-Nearest Neighbors (KNN) scoring algorithm for similarity search in vector space. Available in the 2023-10-01-Preview REST API only.
October Feature Prefilters in vector search evaluate filter criteria before query execution, reducing the amount of content that needs to be searched. Available in the 2023-10-01-Preview REST API only, through a new vectorFilterMode property on the query that can be set to preFilter (default) or postFilter, depending on your requirements.
October API 2023-10-01-Preview Search REST API, breaking changes the definition for vector fields and vector queries.
August Feature Enhanced semantic ranking. Upgraded models are rolling out for semantic reranking, and availability is extended to more regions. Maximum unique token counts doubled from 128 to 256.
July Sample Vector demo (Azure SDK for JavaScript). Uses Node.js and the @azure/search-documents 12.0.0-beta.2 library to generate embeddings, create and load an index, and run several vector queries.
July Sample Vector demo (Azure SDK for .NET). Uses the Azure.Search.Documents 11.5.0-beta.3 library to generate embeddings, create and load an index, and run several vector queries. You can also try this sample from the Azure SDK team.
July Sample Vector demo (Azure SDK for Python) Uses the latest beta release of the azure.search.documents to generate embeddings, create and load an index, and run several vector queries. Visit the azure-search-vector-samples/demo-python repo for more vector search demos.
June Feature Vector search public preview.
June Feature Semantic search availability, available on the Basic tier.
June API 2023-07-01-Preview Search REST API. Support for vector search.
May Feature Azure RBAC (role-based access control, generally available).
May API 2022-09-01 Management REST API, with support for configuring search to use Azure roles. The Az.Search module of Azure PowerShell and Az search module of the Azure CLI are updated to support search service authentication options. You can also use the Terraform provider to configure authentication options (see this Terraform quickstart for details).
April Sample Multi-region deployment of Azure AI Search for business continuity and disaster recovery. Deployment scripts that fully configure a multi-regional solution for Azure AI Search, with options for synchronizing content and request redirection if an endpoint fails.
March Sample ChatGPT + Enterprise data with Azure OpenAI and Azure AI Search (GitHub). Python code and a template for combining Azure AI Search with the large language models in OpenAI. For background, see this Tech Community blog post: Revolutionize your Enterprise Data with ChatGPT.

Key points:

Use Azure AI Search to consolidate and index searchable content.

Query the index for initial search results.

Assemble prompts from those results and send to the gpt-35-turbo (preview) model in Azure OpenAI.

Return a cross-document answer and provide citations and transparency in your customer-facing app so that users can assess the response.

Previous year's announcements

Service rebrand

This service has had multiple names over the years. Here they are in reverse chronological order:

  • Azure AI Search (November 2023) Renamed to align with Azure AI services and customer expectations.
  • Azure Cognitive Search (October 2019) Renamed to reflect the expanded (yet optional) use of cognitive skills and AI processing in service operations.
  • Azure Search (March 2015) The original name.

Service updates

Service update announcements for Azure AI Search can be found on the Azure web site.

Feature rename

Semantic search was renamed to semantic ranking in November 2023 to better describe the feature, which provides L2 ranking of an existing result set.