NVIDIA RTX Broadcast Engine offers AI-based green screen

Posted on Friday, Sep 27 2019 @ 09:27 CEST by Thomas De Maesschalck
NVDA logo
NVIDIA teases RTX Broadcast Engine, a new SDK that will make it possible for developers to integrate new, AI-based effects in their apps. The RTX Broadcast Engine uses the Tensor Cores on the GeForce RTX GPUs to generate virtual greenscreens, style filters and augmented reality effects. You can check the video demonstration below, the AI-generated green screen definitely looks impressive.
The new SDKs include:
  • RTX Greenscreen, to deliver real-time background removal of a webcam feed, so only your face and body show up on the livestream. The RTX Greenscreen AI model understands which part of an image is human and which is background, so gamers get the benefits of a greenscreen without needing to buy one.
  • RTX AR, which can detect faces, track facial features such as eyes and mouth, and even model the surface of a face, enabling real-time augmented reality effects using a standard web camera. Developers can use it to create fun, engaging AR effects, such as overlaying 3D content on a face or allowing a person to control 3D characters with their face.
  • RTX Style Filters, which use an AI technique called style transfer to transform the look and feel of a webcam feed based on the style of another image. With the press of a hotkey, you can style your video feed with your favorite painting or game art.
  • XSplit already confirmed they'll be integrating RTX Broadcast Engine in a future release.

    About the Author

    Thomas De Maesschalck

    Thomas has been messing with computer since early childhood and firmly believes the Internet is the best thing since sliced bread. Enjoys playing with new tech, is fascinated by science, and passionate about financial markets. When not behind a computer, he can be found with running shoes on or lifting heavy weights in the weight room.

    Loading Comments