Computer Graphics and Interactive Systems > SVCG > CS > JBI > FWN > RUG

Presenting using Two-Handed Interaction in Open Space

Description:

Based on Johnny Lee's original idea of finger tracking with a Wii Remote, we created a finger tracking system that uses the Wii Remote and gloves fitted with retro-reflective markers. The hardware setup consists of the Wii Remote, an array of infrared LEDs, and a bluetooth dongle, in addition to a laptop and projector presentation setup. The project aimed at enabling free-handed multi-touch interaction, where problems arise such as having to identify the fingers of each hand and to recognize pinching for interaction. The final system allows dual-»touch« interaction with videos, images, and slide decks, and is designed to be used for presentations. And it seems that Johhny Lee likes our project ... :-)

Paper download:  (1.4 MB)

Video:

Download the video as AVI-MPEG4 (15.9MB) or watch it on YouTube.

Demo:

Download a demo of the Two-Handed Interaction in Open Space (Win32, 28.3 MB) using the presentation we showed at Tabletop 2008 and try it out yourself. The source code of a rewritten C# version based on WPF (Win32, 126 kB) that contains only the recognition, pairing, and pinching part can also be downloaded. To be functional, however, both demos require some hardware (Wiimote, Bluetooth dongle, LED array, gloves with retro-reflective markers).

Additional material:

Main Reference:

Luc Vlaming, Jasper Smit, and Tobias Isenberg (2008) Presenting using Two-Handed Interaction in Open Space. In Sriram Subramaniam and Shahram Izadi, eds., Proceedings of the 3rd Annual IEEE Workshop on Horizontal Interactive Human-Computer Systems (Tabletop 2008, October 1–3, 2008, Amsterdam, The Netherlands). Los Alamitos. IEEE Computer Society, pages 31–34, 2008.   doi
pdf
video
url
url

Other Reference:

Luc Vlaming (2008) Human Interfaces – Finger Tracking Applications. Bachelor thesis, Department of Mathematics and Computing Science, University of Groningen, 2008.   pdf
url

This work was done at the University of Groningen, the Netherlands.