IPLAB

A User-based Mid-air Hand Gesture Set for Spreadsheet

Yuta Takayama, Yuu Ichikawa, Buntarou Shizuki, Ikkaku Kawaguchi, Shin Takahashi

The spreadsheet is one of the most popular general user interfaces. Table manipulation, such as cell insertion and removal, is usually performed by selecting a menu command or using shortcut keys. However, the enormous number of shortcut keys makes them difficult to learn and remember. We sought to design a mid-air hand gesture-based interface for table manipulation in spreadsheet applications. As hand gestures and table manipulations are both spatial in nature, there should be a natural mapping between them. In this paper, we performed two user studies to derive a user-defined gesture set allowing 13 types of table manipulation. In the first study, we collected mid-air hand gestures devised by participants for manipulations implemented in existing spreadsheet software. In the second study, we asked other participants to vote for their most preferred gestures. We analyzed the characteristics of the collected gestures and votes, and created a final user-defined gesture set.

Download PDF

References

• Yuta Takayama, Yuu Ichikawa, Buntarou Shizuki, Ikkaku Kawaguchi, Shin Takahashi, A User-based Mid-air Hand Gesture Set for Spreadsheet, In Proceedings of the 2021 ACM CHI symposia on Asian CHI Symposium 2021 (Asian CHI Symposium 2021 ), May 7-13, 2021, Yokohama, Tokyo, ACM, pp. 122-128, DOI: https://doi.org/10.1145/3429360.3468193