Français Anglais
Accueil Annuaire Plan du site
Home > Research results > Dissertations & habilitations
Research results
Ph.D de

Group : Human-Centered Computing

Increasing the expressive power of gesture-based interaction on mobile devices

Starts on 01/10/2014
Advisor : MACKAY, Wendy

Funding :
Affiliation : Université Paris-Sud
Laboratory : LRI - HCC

Defended on 13/12/2017, committee :
Directeur de thèse :
Mme MACKAY Wendy, Université Paris-Sud

Président :
- M. CASIEZ Géry, Université Lille 1

Rapporteurs :
- M. ZHAI Shumin, Google, California, USA
- M. COCKBURN Andy, University of Canterbury, New Zealand

Examinateur :
- M. LECOLINET Eric, Telecom ParisTech / CNRS LTCI

Research activities :

Abstract :
Current mobile interfaces let users directly manipulate the objects displayed on the screen with simple stroke gestures, e.g. tap on soft buttons or menus or pinch to zoom. To access a larger command space, the users are often forced to go through long steps, making the interaction cumbersome and inefficient. More complex gestures offer a powerful way to access information quickly and to perform a command more efficiently [5]. However, they are more difficult to learn and control. Gesture typing [78] is an interesting alternative to input text: it lets users draw a gesture on soft keyboards to enter text, from the first until the final letter in a word. In this thesis, I increase the expressive power of mobile interaction by leveraging the gesture’s shape and dynamics and the screen space to produce rich output, to invoke commands, and to facilitate appropriation in different contexts of use. I design "Expressive Keyboard" that transforms the gesture variations into rich output, and demonstrate several applications in the context of textbased communication. As well, I propose "CommandBoard", a gesture keyboard that lets users efficiently select commands from a large command space while supporting the transition from novices to experts. I demonstrate different applications of "CommandBoard", each offers users a choice, based on their cognitive and motor skills, as well as the size and organization of the current command set. Altogether, these techniques give users more expressive power by leveraging human’s motor control and cognitive ability to learn, to control, and to appropriate.

Ph.D. dissertations & Faculty habilitations
Creative work has been at the core of research in Human-Computer Interaction (HCI). I describe the results of a series of studies that look at how creators work, where creators include artists with years of professional practice, as well as learners, or novices and casual makers. My research focuses on three creation activities: drawing, physical modeling, and music composition. For these activities, I examine how artists switch between representations and how these representations evolve throughout their creative process, from early sketches to fine-grained forms or structured vocabularies. I present interactive systems that enrich their workflow (i) by extending their computer tools with physical user interfaces, or (ii) by making physical materials interactive. I also argue that sketch-based representations can allow for user interfaces that are more personal and less rigid. My presentation will reflect on lessons and limitations of this work and discuss challenges for future design-support tools.

Interactive visualizations combine human computer interaction, visual design, perception theory, as well as data processing methods in order to propose visual data representations that amplify cognition, and aid data exploration and understanding. We can consider visualization as a communication medium or channel between humans and their data. The higher the communication bandwidth (the data that can be communicated and understood), the more effective the visualization is. My research attempts to increase the bandwidth of this communication channel in the following two ways. (i) First, by moving away from traditional desktops towards larger displays that can both render larger amounts of data and can accommodate multiple viewers. (ii) And second, by designing and studying appropriate visual representations that show salient information. In my presentation I will describe my work on these topics, the challenges it tries to address, and discuss the methodology and inspiration behind this research.