Need to do a Face detection on rtsp stream using Azure services

Saurabh Singh Sengar 21 Reputation points Microsoft Employee
2021-09-09T04:49:59.54+00:00

I would like to use some of the Azure service for my project. Idea is to stream encoded video stream (h264), expecting Azure to decode and perform face detection on it in real time. What are the best services to use it.
One option I explore is to use computer vision/face Api with media services, however computed vision API requires image in jpeg/bif format which requires reencoding of decoding stream, or I need to do screen grab, which I dont want to do as it will increase latency.
If there is service which does ML operations on raw frame decoded by media services would help here.

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,561 questions
Azure Media Services
Azure Media Services
A group of Azure services that includes encoding, format conversion, on-demand streaming, content protection, and live streaming services.
302 questions
Azure Computer Vision
Azure Computer Vision
An Azure artificial intelligence service that analyzes content in images and video.
311 questions
0 comments No comments
{count} votes

Accepted answer
  1. romungi-MSFT 41,961 Reputation points Microsoft Employee
    2021-09-09T10:28:15.583+00:00

    @Saurabh Singh Sengar The service that offers the capability to enable identification of faces in real time with streaming video is Azure Video Analyzer. It should support HLS and other popular formats, you can take a look at the limitations and quotas from the documentation.

    With computer vision or face API you need to capture the frame or a screen shot and pass the same to the API to get the results.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

1 additional answer

Sort by: Most helpful
  1. Anil Murching 11 Reputation points Microsoft Employee
    2021-09-09T15:05:35.147+00:00

    In particular, review https://learn.microsoft.com/en-us/azure/azure-video-analyzer/video-analyzer-docs/use-intel-openvino-tutorial that shows you how you can run Intel's face detection model on an RTSP stream.

    0 comments No comments