Can I read Continuous Micro Finger Writing Recognition with a Commodity Smartwatch: Demo Abstract on EtoBox?

Continuous Micro Finger Writing Recognition with a Commodity Smartwatch: Demo Abstract by Chen, Wenqiang ;Chen, Lin ;Ma, Meiyi ;Parizi, Farshid Salemi ;Shwetak, Patel ;Stankovic, John is a scholarly article available to read on EtoBox.

What is Continuous Micro Finger Writing Recognition with a Commodity Smartwatch: Demo Abstract about?

Input is a significant problem for wearable devices, particularly for head-mounted virtual and augmented reality systems. Contemporary AR/VR systems use in-air gestures or handheld controllers for interactivity. However, mid-air handwriting provides a natural, subtle, and easy-to-use way to input commands and text. In this demo, we propose and investigate ViFin, a new technique for input commands and text entry which tracks continuous micro finger-level writing with a commodity smartwatch through vibrations. Inspired by the recurrent neural aligner and transfer learning, ViFin recognizes continuous finger writing and works across different users and achieves an accuracy of 90% and 91% for recognizing numbers and letters, respectively. Finally, a realtime writing system with two specific applications using AR smartglasses are implemented. CCS Concepts: • Computer systems organization → Embedded systems; wearable devices; vibration intelligence; • Text input → micro finger writing.

Author

Chen, Wenqiang ;Chen, Lin ;Ma, Meiyi ;Parizi, Farshid Salemi ;Shwetak, Patel ;Stankovic, John

Publisher

ACM

Published

2020

Language

EN