NVIDIA AI renders virtual world in real-time (video)

NVIDIA announced it has created a new AI model that can render a virtual world in real-time based on video input. Everything you see in the video below is generated in real-time on a NVIDIA TITAN V using its Tensor cores. It's still far from a shipping product, but NVIDIA predicts this will have applications in gaming, automotive, robotics, and virtual reality.

But the project is still a work in progress. As we can see from the image on the right, which was generated in real time on a Nvidia Titan V graphics card using its Tensor cores, the rendered scene isn't as crisp as we would expect in real life, and it isn't as clear as we would expect with a normal modeled scene in a 3D environment. However, the result is much more impressive when we see the real-time output in the YouTube video below. The key here is speed: The AI generates these scenes in real time.

More at Tom's Hardware