Need to do a Face detection and get demographic data on rtsp stream URL using Azure services

Question

I would like to use some of the Azure service for my project. Idea is to stream encoded video stream using rtsp endpoint, expecting Azure to decode and perform face detection and give person details like name, department on it in real time. What are the best azure services to use it.

Please provide assistance here, which service will be helpful here to implement the face detection using Azure Services for my scenario.

Answer 1

Hello @Harshita Gupta,

welcome to this moderated Azure community forum.

In Azure , check out Azure AI video indexer.

Azure AI Video Indexer is a cloud application, part of Azure AI services, built on Azure AI services (such as the Face, Translator, Azure AI Vision, and Speech). It enables you to extract the insights from your videos using Azure AI Video Indexer video and audio models.

Another approach is using the edge to analyze videos locally. Check out this video where Azure IA video indexer is used in combination with Azure IoT Operations. Notice this is in public preview.

A more traditional edge solution is making use of Azure IoT Edge with eg. custom video ingestion and ML Vision solutions. Check out the eg. NVidia Jetson Nano for local inferencing and then send the outcome to the cloud via the Azure IoT Hub of EventGrid Namespace MQTT support.

For more details, check out this MS Learn training path.

---

If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. All community members with similar issues will benefit by doing so. Your contribution is highly appreciated.