How to merge two people in video indexer using the API?

eMAM IT 0

Hello,

I am currently working with Azure Video Indexer and would like to know if there is an available API method to merge two people detected in a video.

I’ve explored the documentation but couldn’t find any endpoint that supports this functionality. Could you please confirm whether such an API exists?

Looking forward to your guidance.

santoshkc 15,355 Reputation points Microsoft External Staff Moderator

2025-05-08T16:05:49.66+00:00

Hi @eMAM IT,

At the moment, Azure Video Indexer doesn’t provide an API method to directly merge two people detected in a video.

Merging Identities of two or different person

However, as a workaround, you can manually manage detected persons within your indexed videos. If you want to merge detection of two different face entries, you can give it the same name to both detection and then re-index the video with updated model.

This way, Video Indexer will group them under the same identity in the video. It’s not a true merge at the model level, but it merges identity as two of person under one category or name.

Reference - https://learn.microsoft.com/en-us/azure/azure-video-indexer/customize-person-model-how-to?tabs=customizewebportal

Merging two or more person on Frame basis

You might need to split the entire video into frames and use third party diffusion models or DALL-E to keep only one person image and re-stich the frames to come with desired result.

But not possible with Azure Video indexer API.

Microsoft may add full support for merging in the future, but for now, this remains a manual process.

I hope you understand! Thank you.
santoshkc 15,355 Reputation points Microsoft External Staff Moderator

2025-05-09T13:42:00.7666667+00:00

Hi @eMAM IT,

Following up to see if the given information was helpful. And, if you have any further query do let us know.

1 answer

JAYA SHANKAR G S 3,960 Reputation points Microsoft External Staff Moderator

2025-05-13T08:37:30.08+00:00

Hello @eMAM IT ,

Like Santosh mentioned as of now there is no Api to merge detected people.

But if you are indexing your video with people model then you can merge the people within the people model in portal.

Here is the sample.

Make sure the people model is associated with video you uploaded, if not then re-index the video with people models like below.

Next, click on Advanced settings

After successful re-indexing, go to model customization and merge the people under the people model.

Try above and let us know if you have any query in comments or in private message.

Thank you
Please sign in to rate this answer.
JAYA SHANKAR G S 3,960 Reputation points Microsoft External Staff Moderator

2025-05-14T11:07:42.0733333+00:00

Hello @eMAM IT ,

Did you check above given answer? Please check and let us know if you have any query.

Thank you

JAYA SHANKAR G S 3,960 Reputation points Microsoft External Staff Moderator

2025-05-15T05:52:54.1333333+00:00

Hello @eMAM IT ,

I believe the above answer helped you, do let us know if you have any query.

Thank you
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Your answer