SemanticSimilarityChunker Constructor

Definition

Namespace:

Microsoft.Extensions.DataIngestion.Chunkers

Assembly:

Microsoft.Extensions.DataIngestion.dll

Package:

Microsoft.Extensions.DataIngestion v10.6.0-preview.1.26261.4

Source:

SemanticSimilarityChunker.cs

Initializes a new instance of the SemanticSimilarityChunker class.

public SemanticSimilarityChunker(Microsoft.Extensions.AI.IEmbeddingGenerator<string,Microsoft.Extensions.AI.Embedding<float>> embeddingGenerator, Microsoft.Extensions.DataIngestion.IngestionChunkerOptions options, float? thresholdPercentile = default);

new Microsoft.Extensions.DataIngestion.Chunkers.SemanticSimilarityChunker : Microsoft.Extensions.AI.IEmbeddingGenerator<string, Microsoft.Extensions.AI.Embedding<single>> * Microsoft.Extensions.DataIngestion.IngestionChunkerOptions * Nullable<single> -> Microsoft.Extensions.DataIngestion.Chunkers.SemanticSimilarityChunker

Public Sub New (embeddingGenerator As IEmbeddingGenerator(Of String, Embedding(Of Single)), options As IngestionChunkerOptions, Optional thresholdPercentile As Nullable(Of Single) = Nothing)

Parameters

embeddingGenerator

IEmbeddingGenerator<String,Embedding<Single>>

Embedding generator.

options

IngestionChunkerOptions

The options for the chunker.

thresholdPercentile

Nullable<Single>

Threshold percentile to consider the chunks to be sufficiently similar. 95th percentile will be used if not specified.