Multimodal Interface for Mobile Devices

This is a research project at NID – IBM Open Source Research Lab at National Institute of Design, Ahmedabad, India. The project investigates mobile as a multimodal interaction platform. It adopts a semiotic approach towards defining how it can lay the foundation for a multimodal construct. Collaborated in prototyping and development of the interaction frameworks, interface design that emerged from the initial research and conceptualizing, compositing and editing the concept video.

The design offers a new user interface paradigm that adopts objects and activities from everyday life we inhabit, breaking away from feature led design and iconic representations. Communication allows for diverse modalities of expression.

For example the urge to connect with people becomes an intent that motivates the activities of phoning, messaging, chatting, emailing or social networking.

Physical spaces or places, objects, people and their activities constitute the frame through which we perceive, make meaning and act. The design creates a backdrop that mimics this frame. The design takes an intent centric approach. The interface mirrors these actions in the real world

Principal Researcher: Dr Jignesh Khakhar, Senior Research Associate: Prachi Nagpal, Associate Designer: Promila Roychoudhury, Nikhil Bajpai.