5,380 questions
How can I create a real-time video processing app using Xamarin.Forms?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 76%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECA%3C/text%3E%3C/svg%3E)
Carlos Anderson
1
Reputation point
I'd like to create a Xamarin.Forms app where I could process images from a live video, and show the user the processed images (as a video in real-time). I'd like to use OpenCV for the processing, which I've done before with individual images (using SkiaSharp to show the processed image). But I haven't done this live, and I'm having a hard time finding a straightforward solution for this online.
I suppose I could use SkiaSharp to show the processed images as a video, but I'm not sure whether this is the most efficient or performant way.
Developer technologies .NET Xamarin
{count} votes
-
Lex Li (Microsoft) 6,037 Reputation points Microsoft Employee2021-05-15T17:48:55.603+00:00 If SkiaSharp can be used to develop 2D games (like others did), I wonder why it cannot support what you planned to implement (simpler than games).
-
Carlos Anderson 1 Reputation point
2021-05-16T04:19:28.903+00:00 I haven't tried using SkiaSharp, but perhaps I should in case it's good enough for my needs. I was just wondering if there's something known to work well.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 87%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
JarvanZhang 23,971 Reputation points2021-05-17T08:21:54.213+00:00 Hi, CarlosAnderson. Please test the function on your side. We're not experts in skiasharp, it's suggested to report the problem about the code to the skiasharp github repo if you're facing some issues while implementing.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 6%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJH%3C/text%3E%3C/svg%3E)
Jannis Holtkötter 1 Reputation point2021-07-19T11:36:07.407+00:00 Hello Carlos Anderson,
did you have any progress developing an app with live video processing? I am trying something similar but I am pretty new to programming, so i am having troubles finding sources which provide me helpful information on how to proceed.
Moreover, I'm not sure if you have found this page: xamarin-forms-camera-barcode-scanner.html
It describes the xamarin forms code of a barcode scanner, which uses live video to apply a barcode detection. I was thinking, maybe it is possible to extract the steps, which extract individual frames from the camera stream to then use continuous image processing on them. But again, I am not sure if that works. -
Carlos Anderson 1 Reputation point
2021-07-19T15:49:27.707+00:00 Hi Jannis,
Yes, I was able to get something working on Android. I used the Android Camera 2 API (via Xamarin.Android) to get each frame from the video. I then processed each image in OpenCV and finally converted it to a SkiaSharp image to display in Xamarin.Forms. I'm not working on this project anymore, but thanks for the barcode sample anyway.
-
Jannis Holtkötter 1 Reputation point
2021-08-05T12:36:12.5+00:00 Thanks for your reply, Carlos!
Would it be possible for you to share the code with me? I am still trying to find a way, how to extract the individual frames in order to further process them. Unfortunately, I can't seem to solve my problem and can't continue in my project... -
Carlos Anderson 1 Reputation point
2021-08-05T15:35:51.3+00:00 Yes, my code is available at https://github.com/redcurry/GreenTea. Specifically, look at ICameraService in the GreenTea solution and project, and its implementation in the GreenTea.Android project.
Sign in to comment
Sign in to answer