Giter Club home page Giter Club logo

vcamnetsample's Introduction

VCamNetSample

This solution contains a Media Foundation Virtual Camera Sample developed using .NET. It works only on Windows 11 thanks to the MFCreateVirtualCamera API.

It's a port of the same project written in C++ VCamSample: https://github.com/smourier/VCamSample and it's based on DirectN for all DirectX, WIC and Media Foundation interop.

There are two projects in the solution:

  • VCamNetSampleSource: the Media Source that provides RGB32 and NV12 streaming samples.
  • VCamNetSample: the "driver" application that does very little but calls MFCreateVirtualCamera.

To test the .NET virtual cam:

  • Build in debug or release
  • Go to the build output and register the media source (a COM object) with a command similar to this: regsvr32 VCamNetSampleSource.dll (you must run this as administrator, it' not possible to register a Virtual Camera media source in HKCU, only in HKLM since it will be loaded by multiple processes)
  • Run the VCamNetSample app.
  • Run for example the Windows Camera app or using a Web Browser ImageCapture API

You should now see something like this in the Windows Camera App

Screenshot 2024-03-22 174749

Something like this in Windows' Edge Web Browser, using this testing page: https://googlechrome.github.io/samples/image-capture/grab-frame-take-photo.html

Screenshot 2024-03-22 181438

Something like this in OBS (Video Capture Device):

Screenshot 2024-03-22 181650

Something like this in Teams, yes, this is your avatar :-)

Screenshot 2024-03-22 181914

Notes

  • The media source uses Direct2D and DirectWrite to create images. It will then create Media Foundation samples from these. To create MF samples, it can use:
    • The GPU, if a Direct3D manager has been provided by the environment. This is the case of the Windows 11 camera app.
    • The CPU, if no Direct3D environment has been provided. In this case, the media source uses a WIC bitmap as a render target and it then copies the bits over to an MF sample. The ImageCapture API code embedded in Chrome or Edge, Teams, etc. is an example of such a D3D-less environment (but sometimes it uses Direct3D).
    • If you want to force CPU usage at all times, you can change the code in MediaStream::SetD3DManager and put the lines there in comment.
  • The media source provides RGB32 and NV12 formats as most setups prefer the NV12 format. Samples are initially created as RGB32 (Direct2D) and converted to NV12. To convert the samples, the media source uses two ways:
    • The GPU, if a Direct3D manager has been provided, using Media Foundation's Video Processor MFT.
    • The CPU, if no Direct3D environment has been provided. In this case, the RGB to NV12 conversion is done using Media Foundation's Color Converter DSP.
    • If you want to force RGB32 mode, you can change the code in MediaStream constructor and set the media types array size to 1 (check comments in the code).

Tracing

The code output lots of interesting traces. It's quite important in this virtual camera environment because there's not just your process that's involved but at least 4: the VCamNetSample app, the Windows Frame Server, the Windows camera monitor, and the reader app (camera, etc.). They all load the media source COM object in-process.

The solution also contains a small DebuggerAttach project that can be ran to attach to the Windows Frame Server (hosted in svchost.exe). For it to run you must run Visual Studio and DebuggerAttach as administrator. You can also attach to the Frame Server using Visual Studio attach to process once it's been started.

Tracing here doesn't use OutputDebugString because it's 100% old, crappy, truncating text, slow, etc. Instead it uses Event Tracing for Windows ("ETW") in "string-only" mode (the mode where it's very simple and you don't have to register painfull traces records and use complex readers...).

So to read these ETW traces, use WpfTraceSpy you can download here https://github.com/smourier/TraceSpy. Configure an ETW Provider with the GUID set to 964d4572-adb9-4f3a-8170-fcbecec27467

vcamnetsample's People

Contributors

smourier avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.