BeyondTouch: Extending the Input Language with Built-in Sensors on Commodity Smartphones

356.pic_hdWhile most smartphones today have a rich set of sensors that could be used to infer input (e.g., accelerometer, gyroscope, microphone), the primary mode of interaction is still limited to the front-facing touchscreen and several physical buttons on the case. To investigate the potential opportunities for interactions supported by built-in sensors, we present the implementation and evaluation of BeyondTouch, a family of interactions to extend and enrich the input experience of a smartphone. Using only existing sensing capabilities on a commodity smartphone, we offer the user a wide variety of additional tapping and sliding inputs on the case of and the surface adjacent to the smartphone. We outline the implementation of these interaction techniques and demonstrate empirical evidence of their effectiveness and usability. We also discuss the practicality of BeyondTouch for a variety of application scenarios.

This work was published on the Doctoral School of Ubicomp’13 [Paper] and  IUI ’15 Proceedings of the 20th International Conference on Intelligent User Interfaces(Acceptance Rate 23%). [Paper] [Video] .

Bookmark the permalink.

Comments are closed