i*Chameleon: A Scalable and Extensible Framework for Multimodal Interation

 

i*Chameleon is a multimodal interaction framework that enables programmers to readily prototype and test new interactive devices or interaction modes. It allows users to customize their own desktop environment for interaction beyond the usual KVM devices, which would be particularly useful for users with difficulty using the keyboard and mouse, or for systems deployed in specialized environments. This is made possible with the engineering of an interaction framework that distills the complexity of control processing to a set of semantically-rich modal controls that are discoverable, composable and adaptable. The framework can also be used for developing new applications with multimodal interactions, for example, distributed applications in collaborative environments or robot control.

 

Awards:
  • HONG KONG ICT AWARDS 2011: BEST INNOVATION & RESEARCH (COLLEGE & UNDERGRADUATES)
  • Gold Award, 2010 Amway Pan-Pearl River Delta Region Universities IT Project Competition
  • CHAMPION, 2010 Amway Pan-Pearl River Delta Region Universities IT Project Competition (HKSAR Region)
i*Chameleon in the News:

 

IC-Framework

Figure 1. i*Chameleon Architecture

IC-Map

Figure 2. User controlling Bing Maps and Google Earth with hand gesture and voice command based on i*Chameleon.

IC-Multitouch

Figure 3. A multi-touch surface.

IC-iPadWii

Figure 4. A multi-user collaborative drawing application using iPad and WiiMote.

IC-Eyeballtrack

Figure 5. A user using eye tracking device in place of a mouse.