Tap ID: Rapid Touch Interaction in Virtual Reality using Wearable Sensing, VR

We bring rapid touch interaction on surfaces to Virtual Realitythe input modality that users have grown used to on tablets for continued use. We present TapID, a wristbased inertial sensing system that complements headsettracked hand poses to trigger input in VR. TapID reliably detects surface touch events and, more importantly, identifies the finger used for touch. We demonstrate a series of applications that complement hand tracking with touch input and that are uniquely enabled by TapID, including UI control, rapid keyboard typing and piano playing, as well as surface gestures. More information: full publication: Manuel Meier, Paul Streli, Andreas Fender, and Christian Holz. TapID: Rapid Touch Interaction in Virtual Reality using Wearable Sensing. In Proceedings of IEEE VR 2021. Sensing, Interaction Perception Lab Department of Computer Science ETH Zürich, Switzerland