Facebook shows impressive hand tracking demo

Posted on Wednesday, December 16 2020 @ 11:47 CET by Thomas De Maesschalck
Hexus writes Facebook's Reality Labs (FRL) cooked up an impressive demonstration of high-fidelity hand tracking. FRL claims it has developed the first algorithm capable of tracking "high-fidelity hand deformations through highly self-contacting and self-occluding hand gestures, for both single hands and two hands."
Common hand interactions introduce many self-interactions and massive self occlusions, says the research team. However, it managed to create a robust algorithm by "constraining a vision-based tracking algorithm with a physically based deformable model". The moel has been tested against some of the most complicated interaction of human hands, and you can see the tracking quality and accuracy in the embedded video.
While it looks impressive, the system is far from being ready for consumer applications. The demonstration seen in the video below required a 124 camera system, six threads on an Intel E5-2698 Xeon 2.2GHz processor, and an NVIDIA Tesla V100 GPU to achieve accurate 30fps tracking.

Facebook tested various camera systems and concluded three cameras were not enough to reliable track input data. With 18 cameras the results started getting plausible and 43 cameras produced a result that was visually quite close to the 124 camera system.

About the Author

Thomas De Maesschalck

Thomas has been messing with computer since early childhood and firmly believes the Internet is the best thing since sliced bread. Enjoys playing with new tech, is fascinated by science, and passionate about financial markets. When not behind a computer, he can be found with running shoes on or lifting heavy weights in the weight room.

Loading Comments