Only a top-level field of the index can be a vector field.

Question

Only a top-level field of the index can be a vector field.

Jorge Bo 5

Hello,

I've got an Azure Cognitive Search index with several large documents. I've been waiting for vector fields and an implementation similar to the one in this article:

https://learn.microsoft.com/en-us/samples/azure-samples/azure-search-power-skills/azure-open-ai-embeddings-generator/

Unfortunately, on the index you can't create the complex property "chunks" with a vector sub-field "chunks/embedding_metadata/embedding" as shown in the article. You will get a

Only a top-level field of the index can be a vector field

The article doesn't directly mention any Index field configuration. But judging by the skill's output and skillset configuration that vector sub-fields should be supported.

So is this limitation going to be lifted eventually? Or, is my assumption wrong?

VenkateshDodda-MSFT 25,111 Reputation points Microsoft Employee Moderator

2023-07-24T10:48:09.83+00:00

@Jorge Bo Thanks for reaching out to Microsoft Q&A.

I am checking with team internally on this and will update you here. Once I hear back from them.
Jorge Bo 5 Reputation points

2023-07-24T12:16:39.4066667+00:00

@VenkateshDodda-MSFT Thank you. I look forward to your response.
Jorge Bo 5 Reputation points

2023-07-24T12:18:23.7633333+00:00

Thanks @VenkateshDodda-MSFT ! I look forward to your response.
VenkateshDodda-MSFT 25,111 Reputation points Microsoft Employee Moderator

2023-07-28T06:51:24.8233333+00:00

@Jorge Bo Thanks for your patience on this.

I would suggest you follow this similar GitHub issue #119 about How to define "chunks" field of index for EmbeddingGenerator where in Engineering team actively engaged on it.
VenkateshDodda-MSFT 25,111 Reputation points Microsoft Employee Moderator

2023-07-31T05:01:13.01+00:00

Hello @Jorge Bo ,

Following up to see if you have a chance to check my previous response and helped. Do let us know if you have any further questions on this.

Your answer

VenkateshDodda-MSFT 25,111 Reputation points Microsoft Employee Moderator

2023-07-24T10:48:09.83+00:00

@Jorge Bo Thanks for reaching out to Microsoft Q&A.

I am checking with team internally on this and will update you here. Once I hear back from them.
Jorge Bo 5 Reputation points

2023-07-24T12:16:39.4066667+00:00

@VenkateshDodda-MSFT Thank you. I look forward to your response.
Jorge Bo 5 Reputation points

2023-07-24T12:18:23.7633333+00:00

Thanks @VenkateshDodda-MSFT ! I look forward to your response.
VenkateshDodda-MSFT 25,111 Reputation points Microsoft Employee Moderator

2023-07-28T06:51:24.8233333+00:00

@Jorge Bo Thanks for your patience on this.

I would suggest you follow this similar GitHub issue #119 about How to define "chunks" field of index for EmbeddingGenerator where in Engineering team actively engaged on it.
VenkateshDodda-MSFT 25,111 Reputation points Microsoft Employee Moderator

2023-07-31T05:01:13.01+00:00

Hello @Jorge Bo ,

Following up to see if you have a chance to check my previous response and helped. Do let us know if you have any further questions on this.

Share via

Only a top-level field of the index can be a vector field.

Your answer