Shaowei Chu

Interactive Programming Laboratory

University of Tsukuba, Japan

chushaowei at

Got PhD. at IPLAB, July 2013.
My research is Self-portrait Camera.

Motion Gesture Interface

Interacting with a Self-portrait Camera Using Motion-based Hand Gestures

Taking self-portraits with a digital camera is a popular way to present oneself through photography. Traditional techniques for taking self-portraits, such as use of self-timers or face detection, provide only a modest degree of interaction between the user and camera. In this paper, we present an interaction technique that make novel use of image-processing algorithm to recognize hand motion gestures and provides user a natural way to interact with camera for taking self-portraits. User can perform nature gestures to control essential functions of camera and take self-portraits effectively. Three types of gesture (i.e., waving, eight-direction selection, and circling) were identified and applied to develop a gesture user interface for controlling a Digital Single-Lens Reflex (DSLR) camera. Two experiments were conducted to evaluate the usability and performance of the gesture interface. The results confirmed that the usability of the gesture interface is superior to a self-timer and the proposed technique achieved about 80% accurate recognition of motion gestures.

S. Chu and J. Tanaka
"Interacting with a Self-portrait Camera Using Motion-based Hand Gestures"
The 11th Asia Pacific Conference on Computer Human Interaction (APCHI 2013). Bangalore, India, September 24-27, 2013. (to appear)
[pdf], [wmv]
Development of a Head Gesture Interface for a Self-portrait Camera

Most existing digital camera user interfaces place little emphasis on self-portrait options. Therefore, it is not always easy to take self-portraits using conventional user interfaces. This paper presents a vision-based head gesture interface for controlling a self-portrait camera that helps users to take self-portraits effectively and efficiently. Intuitive nodding and head-shaking gestures control the camera zoom in/out on the face, and a mouth-opening gesture triggers the camera to take a picture. We evaluated its usability factors (effectiveness, efficiency, and satisfaction) and compared it to a remote control in a user study. The results suggest that our interface is useful for taking self-portrait pictures.

S. Chu and J. Tanaka
"Development of a Head Gesture Interface for a Self-portrait Camera"
The Transactions of Human Interface Society, Vol.15, No.3, pp.1-13, 2013. (to appear)
Head Nod and Shake Gesture Interface for a Self-portrait Camera

In this research, we introduce a head gesture interface for a digital camera shooting self-portrait pictures. Natural head nodding and shaking gestures can be recognized in real-time, using optical-flow motion tracking. A double head nod triggers the camera shutter to take shots. Continuous nodding or shaking triggers a zooming interface to zoom the user’s face in or out. To make the recognition robust, a safe zone analysis of the head region was conducted to quickly exclude any insignificant head motion, and thresholds of moving direction and length of head motion were selected in a preliminary set-up step. A finite state machine was used to recognize head gestures. Our results show that the proposed head gesture recognition method is a promising interface for a self-portrait camera.

S. Chu and J. Tanaka
"Head Nod and Shake Gesture Interface for a Self-portrait Camera"
The Fifth International Conference on Advances in Computer-Human Interactions (ACHI 2012), Valencia, Spain, pp.112-117, January 30 to February 4, 2012
[pdf], [ppt], [wmv]
Hand Gesture for Taking Self Portrait

Digital camera is a way to take self portrait and to express ourself through photography. The self portrait pictures have various usefulness, such as sharing events in life, through life-log website (e.g. facebook, Blog, Twitter), etc.
We present a new interaction technique that use hand gesture to interact with camera for taking self portrait. Right figure shows the current prototype of system setup that user uses hand gesture to interact with the camera. The large display is used to give video feedback of camera and display gesture based GUI. The proposed system makes control of the PTZ camera, rotate, tilt and activate the shutter, completely in the air and in a distance, and makes self portrait taking process more effective.

S. Chu and J. Tanaka
"Hand Gesture for Taking Self Portrait"
Proceedings of 14th International Conference on Human-Computer Interaction (HCI International 2011), Human-Computer Interaction, Part II, LNCS 6762, pp.238-247, Orlando, Florida, USA, July 9-14, 2011
[pdf], [ppt], [wmv], Media: [newscientist], [youtube], [gizmag], [tokyotek],
Hand and Fingertip Detection

Skin color based hand and fingertip detection.

[wmv], [avi]

Last updated: 2013-7-30