Zuckerberg Shows Off VR Tech That Can Turn a Flat Surface Into a Keyboard

Aug 13, 2023

Meta CEO Mark Zuckerberg is teasing new VR technology that can turn any flat surface into a virtual keyboard.

Zuckerberg posted a video on his Instagram account demonstrating the VR keyboard tech, which comes from Meta’s VR-focused Reality Labs division. The clip shows Zuckerberg and Meta CTO Andrew Bosworth wearing Quest headsets while using the virtual keyboard. Most notable is the absence of hardware peripherals for their hands, like a wrist band, to record the finger strokes.

Instead, it looks like the headset itself is able to accurately track finger movements on the table and translate them into the virtual world.

According to Zuckerberg, Bosworth was able to type “at almost 120 words per minute” while Zuckerberg reached around 100 words per minute. This suggests the keyboard is quite functional since the average typing speed is 40 words per minute on a physical keyboard.

That said, we’re wondering about the possible drawbacks. Zuckerberg didn’t reveal how the technology works, but UploadVR notes that large fiducial markers have been placed on the table where Zuckerberg and Bosworth are typing. These fiducial markers can serve as an anchor to help the VR headset track the finger movements against the table.

The company will likely discuss more about the technology at Meta Connect, a two-day summit being held virtually on Sept. 27-28. Meta is expected to reveal more details about the Quest 3 VR headset, which will launch this fall starting at $499. Stay tuned for our coverage.