Direction des Relations Internationales (DRI)
Programme INRIA "Equipes Associées"
I. DEFINITION
|
EQUIPE ASSOCIEE |
SIRIUS |
|
sélection |
2009 |
|
Equipe-Projet INRIA : INSITU |
Organismes Etrangers partenaires : Stanford University and U.C. San Diego |
|
Centre de recherche
INRIA : INRIA, Saclay |
Pays : United States |
|
|
Coordinateur français |
Coordinateur étranger |
Coordinateur étranger |
|
Nom, prénom |
Wendy E. Mackay |
Scott Klemmer |
James D. Hollan |
|
Grade/statut |
Research Director |
Assistant Professor of Computer Science |
Professor of Cognitive Science and Computer Science |
|
Organisme
d'appartenance |
INRIA |
Stanford University |
University of California, San Diego |
|
Adresse postale |
Laboratoire de Recherche en Informatique, Building 490 Université Paris-Sud 91405 Orsay CEDEX, France |
Gates Computer Science 3B Room 384 Stanford University Stanford CA 94305-9035 USA |
Department of Cognitive Science, SSRB Suite 100 University of California, San Diego La Jolla, CA 92093-0515 USA |
|
URL |
insitu.lri.fr |
hci.stanford.edu |
hci.ucsd.edu |
|
Téléphone |
+33 1 69 15 69 08 |
+1 650 723 3692 |
+1 858 534 8156 |
|
Télécopie |
+33 1 69 15 65 86 |
+1 650 723 0033 |
+1 858 822 2476 |
|
Courriel |
mackay@inria.fr |
srk@cs.stanford.edu |
hollan@cogsci.ucsd.edu |
La proposition en bref
|
SIRIUS:
Situated Interaction Research at INRIA, UCSD and Stanford |
|
Based on
extensive mutual research interests among the three labs, we propose to
create SIRIUS, an INRIA Associate Team with three partners: Project in|situ|
at INRIA, the HCI group at Stanford University and the DCOG-HCI Lab at U.C.
San Diego. All three labs have international reputations in human-computer
interaction (HCI) and combine studies of real users in real settings with
innovative design mthods and technology. Their complementary strengths will
enhance a joint project, specifically Stanford’s focus on design, UCSD’s
focus on ethnography, and INRIA’s focus on situated interaction. Each lab
offers specific hardware and software assets of interest to the other labs
and all will benefit from working together on joint research projects. We
have identified four primary areas for collaboration: Interaction with
Wall-Sized Displays, Design Workbench, Interactive Paper and Video Analysis. |
Présentation détaillée de l'équipe Associée
1. Objectifs scientifiques de la proposition
The SIRIUS Joint Lab will involve three partners: INRIA’s In|Situ| Group,
the HCI group at Stanford University and the DCOG-HCI Lab at U.C. San Diego,
three internationally renowned
research groups in Human-Computer Interaction (HCI). All three groups place a
special emphasis on the situated nature of interaction, as we observe real
users in real settings, develop new design methods and tools, and create new
forms of interaction that take the user’s context into account. Each laboratory
has extensive experience working with diverse groups of users and developing
technologies that link physical and computer worlds. The specific strengths of
each group have influenced the others, specifically the design focus from
Stanford’s HCI group, the ethnographic approach from UCSD’s DCOG-HCI group and
the mixed reality approach from INRIA’s In|Situ| group. The groups have shared
ideas and technology over the years, and each lab has specific hardware assets
of interest to the other labs, specifically with respect to Wall-Sized displays
and Interactive Paper hardware and toolkits.
INRIA’s In|Situ| group explores situated interaction, which specifically
acknowledges the role of context in the understanding and subsequent design of
interactive systems. Their multi-discplinary approach draws from the social
sciences, computer science and design disciplines. They seek to understand
real-world user needs and develop innovative technologies, through observation
and participatory design with users. They have extensive experience in the
development of tools and toolkits that leverage the state-of-the-art in
interaction techniques. They have also explored generative design methods and
principles such as instrumental interaction to create novel forms of situated
interaction.
Stanford’s HCI group explores ‘enlightened trial and error’ — prototyping — as
the pivotal activity that structures design innovation, collaboration, and
creativity. Their research seeks to enable a broader community of users to
design interactive systems, and to enable expert designers to iterate more
quickly and effectively. To accomplish this, they have introduced — and
are actively researching — techniques for users to demonstrate
interactive behavior, sample existing design elements to create new ones, and
more tightly integrate the creation and evaluation aspects of design. They
explore these issues on mobile, desktop, and web platforms; and are
particularly excited about designing pervasive interactions that integrate our
physical and digital environments.
UCSD’s DCOG-HCI group views cognition as a property of systems that are
larger than isolated individuals. This extends the reach of cognition to
encompass interactions between people as well as interactions with resources in
the environment. Members of the Dcog-HCI lab are dedicated to developing the
theoretical and methodological foundations engendered by this broader view of
cognition and interaction. They use distributed cognition as a powerful
framework for designing and evaluating augmented environments and digital
artifacts, with a particular emphasis on environments in which people pursue
their activities in collaboration with the elements of of the social and
material world. Their core research efforts are directed at understanding such
environments: what we, as users, really do in them, how we coordinate our
activity in them, and what role technology should play in them.
The SIRIUS joint lab has identified four primary areas for collaboration:
Interaction with Wall-Sized Displays, Design Workbench, Interactive Paper and
Video Analysis.
1. Interaction with Wall-Sized Displays
All three groups have an interest
in studying interaction with large displays. Because of their unique software
and hardware architecture, large wall displays present unique challenges,
especially with respect to interaction. UCSD is home to the world’s largest
display wall, HIPerSpace, with 72 high-resolution monitors and has Stanford as
a partner in the project. Stanford is one of the pioneers in interacting with
large display walls, beginning with the iroom, and has extensive experience in
that area. In|Situ| is currently building WILD, a wall similar to HIPerSpace
with 32 high-resolution monitors and a 3D real-time motion capture system
(VICON) to explore enhanced interaction. Both walls will be integrated with
multi-touch tables and will act as experimental high-resolution, interactive
platforms for conducting research
on collaborative human-computer interaction and the visualization of large datasets. An important
distinguishing characteristic of these projects, compared to other explorations
of high resolution displays, is the emphasis on the user: all three labs are
working closely with natural scientists (biologists, geologists, physicists,
chemists) to display and interact with their data.
Very few other research labs have worked on interactive high-resolution wall
displays. In|Situ| has collaborated with the DGP group at the University of
Toronto, which has an interactive wall of similar size to WILD. Another group
working in this area is the LIVE lab at Virginia Tech. To our knowledge, no
other group focuses on direct interaction with such displays.
The three groups will work together to capitalize on their expertise in
interaction and visualization techniques for large displays and large datasets,
software tools and architectures for large displays and multi-surface
environments, and ethnographic studies of scientists dealing with large
datasets. The cross visits by PhD students and post-docs will allow us to
exchange software and build on each others’ expertise. We will also share the
results of our studies of scientists to better inform our respective design
processes. In the long run, we will also study the potential for linking our
walls together for long-distance collaboration among scientists.
2. Design Workbench
All three groups are interested
in the creative process and are developing both methods and tools to support
it. The Stanford HCI group leads this research area, contributing their work on
opportunistic programming, tools to support implicit interaction on an
electronic whiteboard and design tools, such as d.note, which support visual
interaction design. In|Situ| explores participatory design methods,
particularly techniques such as video prototyping and generative design
techniques, such as generative walkthroughs. They have also developed tools for
programmers, such as SwingStates, to enable programmers to create
state-of-the-art interaction techniques, and will be developing new technology
in the context of the ANR iStar project. The UCSD DCOG-HCI group takes an
ethnographic perspective, observing users and exploring how the use of
cognitive artifacts can support both creative and reflective activities.
The general problem of
supporting design is currently a hot research topic among HCI research groups
at Carnegie Mellon, Georgia Tech, MIT and various other labs in England and
Scandinavia. However, the Stanford HCI group is considered a pioneer in this
area and is one of the few, along with In|Situ|, that explores generative
design software (and hardware) tools for developers.
The goal of this research area
is to combine our complementary expertise and collaborate on tools to support
the design of interactive system. Olivier Bau, (Ph.D. student, In|Situ|) will
be developing a hardware prototyping toolkit that will allow designers to provide
different types and levels of dynamic feedforward and feedback in their
tangible interfaces He would like to visit Stanford to investigate possible
collaborations on this project. Similarly, Steven Dow (Stanford post-doc) has
expressed interest in visiting In|Situ| to collaborate on prototyping methods.
3. Interactive Paper
The goal of this research area
is to develop both tools and applications that reinvent our familiar ways to
work with paper. All three groups have explored various applications of interactive
paper. In|Situ| is a pionneer in this area, having developed the earliest
applications interactive paper applications for air traffic controllers, bridge
engineers, families and, most recently, biologists and contemporary music
composers. In the context of the ReActivity project, In|Situ| developed a
hybrid electronic notebook called Prism that helps biologists capture and
visualize diverse streams of activity, from paper notebooks or on-line
activity. Another project, MusInk, explores how to provide contemporary music
composers with a highly flexible paper interface to an electronic music
composition system, allowing them to develop their own language for expressing
musical ideas. The Stanford HCI group developed the Paper Toolkit, which was used
by In|Situ| to develop Prism, as well as their own paper-based tool for field
biologists, called ButterflyNet (a collaboration with the UCSD DCOG-HCI group).
Both UCSD and INRIA are beginning to explore the new LiveScribe technology and
would like to collaborate on new projects, to suppport both scientists and the
creative design process. Aurélien Tabard (Ph.D. Student, In|Situ|) has already
worked with the Stanford HCI group in this area and would like to visit for a
post-doc. In|Situ| also has funding to support students from UCSD and Stanford
to visit France and collaborate on the ReActivity project.
The other key research labs
that explore interactive paper are the University of Maryland’s HCIL group, ETH
in Switzerland, King’s College London and Microsoft Research. They have
established the CoPADD workshop series (Collaborating over Paper and Digital
Documents).
The goal of this research area
is to develop both tools and applications that reinvent our familiar ways to
work with paper. We will be exploring issues such as how to provide creative
users with extremely flexible methods for expressing ideas and controlling how
those are represented on the computer. We are also interested in providing
sophisticated personal information management methods that allow users to
effectively track and manage a highly diverse set of off-line as well as
on-line activities.
4. Ethnographer’s Workbench
All three groups have conducted ethnographic research, with extensive observation of users in real-world settings. The DCOG-HCI group leads this research area, with their influential work on distributed cognition. They have begun work on an 'ethnographer's workbench', with the goal of providing support to researchers who must analyze video and audio data. They have collaborated with Stanford's HCI group on VACA, a tool to support qualitative video analysis, with video annotations on a timeline and integrated external sensor data to improve analysis. The In|Situ| group developed the DIVA system, which provides a flexible approach to annotating and interacting with streams of temporal data, including video, and more recently, StreamLiner, a tool for analyzing the multi-media data in the Prism notebook. In|Situ| ran a 3-day invitation-only workshop in Paris under the ReActivity project, that focused on the 'capture, visualization and interaction with temporal data', which was attended by members of the UCSD DCOG-HCI group and all three partners plan to participate in the follow-on workshop, on the same subject, to be held at CHI'09 in Boston. (Wendy Mackay, Jim Hollan and Scott Klemmer are all on the program committee.)
In|Situ| and researchers at Xerox PARC were the first to create interactive video analysis tools in the 1980’s. Since then, a variety of research and commercial systems have been developed to meet diverse needs, however most current research concerns video as a medium, rather than as an analysis tool.
The goal of this research area
is to provide not only ethnographers but also multidisciplinary design teams
with effective tools that help them draw useful insights from observations from
users in real-world settings. One of the challenges is to provide a deeper
understanding of how to manage stream-based temporal data from both a
qualitative and quantitative perspective.
References (in|situ|, INRIA)
- Olivier Bau and Wendy Mackay (2008) OctoPocus: A
Dynamic Guide for Learning Gesture-Based Command Sets. In Proceedings
of ACM UIST 2008 User Interface Software and Technology. San Francisco, CA.
- Aurélien Tabard, Wendy Mackay and Evelyn Eastmond
(2008) From Individual to Collaborative: The Evolution of Prism, a Hybrid
Laboratory Notebook. In proceedings of ACM CSCW’08 Computer-Supported
Cooperative Work. San Diego, CA.
- Olivier Bau, AtauTanaka and Wendy Mackay (2008) The A20:
Musical Metaphors for Interface Design. In Proceedings of NIME’08 New
Interfaces for Musical Expression.
Genova, Italy. pp. 91-96.
- Emmanuel Pietriga and Caroline Appert. (2008) Sigma
lenses : Focus-context transitions combining space, time and translucence.
In Proceedings of CHI ’08 : Proceedings of the ACM/SIGCHI Conference on
Human Factors in Computing Systems,
New York, NY, USA, 2008. ACM.
- Catherine Letondal and Wendy Mackay (2007) Paperoles:
The Paperoles Project: An
analysis of paper use by music composers. In Proceedings of CoPADD,
Collaborating over Paper and Digital Documents, London, U.K.
- Wendy Mackay, Caroline Appert, Michel
Beaudouin-Lafon, Olivier Chapuis, Young Du, Jean-Daniel Fekete and Yves
Guiard (2007): Touchstone: exploratory design of experiments. In Proceedings
of ACM CHI 2007 Conference on Human Factors in Computing Systems 2007. pp. 1425-1434.
- Aurèlien Tabard, Wendy Mackay, Nicolas Roussel and
Catherine Letondal (2007) PageLinker: integrating contextual bookmarks
within a browser. In Proceedings of ACM CHI 2007 Conference on Human
Factors and Computing Systems, ACM
Press. pp. 337-346.
- Emmanuel Pietriga, Caroline Appert, and Michel
Beaudouin-Lafon. (2007) Pointing and beyond : an operationalization and
preliminary evaluation of multi-scale searching. In Proceedings of CHI
’07, Conference on Human factors in computing systems, pp. 1215–1224, NY: NY, USA, 2007. ACM Press.
- Wolfgang Stuerzlinger, Olivier Chapuis, D. Phillips
and Nicolas Roussel. (2006) User Interface Façades: Towards Fully
Adaptable User Interfaces. In Proceedings of UIST'06, the 19th ACM
Symposium on User Interface Software and Technology, pages 309-318, October 2006. ACM Press.
- Caroline Appert and Jean-Daniel Fekete. (2006)
OrthoZoom Scroller: 1D Multi-Scale Navigation. In Proceedings of ACM
CHI 2006 Conference on Human Factors and Computing Systems, pages 21–30. ACM Press.
- Olivier Chapuis and Nicolas Roussel. (2005) Metisse
is not a 3D desktop! In Proceedings of UIST'05, the 18th ACM Symposium
on User Interface Software and Technology,
pages 13-22. ACM Press.
References (Stanford University)
- Scott R.
Klemmer, Katherine M. Everitt, James A. Landay. (2008) Integrating
Physical and Digital Interactions on Walls. HCI Journal.
- Wendy Ju,
Brian Lee, and Scott R Klemmer (2008) Range: Exploring Implicit
Interaction through Electronic Whiteboard Design. In Proceedings of
Computer Supported Cooperative Work.
- Ron B.
Yeh, Andreas Paepcke, and Scott Klemmer (2008) Iterative Design and
Evaluation of an Event Architecture for Pen-and-Paper Interfaces In Proceedings
of UIST 2008: ACM Symposium on User Interface Software and Technology.
- Björn
Hartmann, Loren Yu, Abel Allison, Yeonsoo Yang, and Scott R. Klemmer. UIST
(2008) Design As Exploration: Creating Interface Alternatives through Parallel
Authoring and Runtime Tuning. In Proceedings of UIST 2008: ACM
Symposium on User Interface Software and Technology.
- Björn
Hartmann, Scott Doorley and Scott R. Klemmer. (2008) Hacking, Mashing,
Gluing: Understanding Opportunistic Design. In Proceedings of IEEE
Pervasive Computing.
- Joel
Brandt, Philip Guo, Joel Lewenstein, Scott R. Klemmer (2008) Opportunistic
Programming: How Rapid Ideation and Prototyping Occur in Practice Workshop
on End-User Software Engineering IV. ICSE 2008: 30th International
Conference on Software Engineering
- Scott
Carter, Jennifer Mankoff, Scott R. Klemmer, and Tara Matthews. (2008)
Exiting the Cleanroom: On Ecological Validity and Ubiquitous Computing. Human-Computer
Interaction
- Björn
Hartmann, Leslie Wu, Kevin Collins, Scott R. Klemmer. (2007) Programming
by a Sample: Rapidly Creating Web Applications with d.mix. In Proceedings
of UIST 2007: ACM Symposium on User Interface Software and Technology.
- Heidy
Maldonado, Brian Lee, Scott R Klemmer, Roy D Pea. (2007) Patterns of Collaboration
in Design Courses: Team dynamics affect technology appropriation, artifact
creation, and course performance. CSCL 2007: Conference on Computer Supported Collaborative
Learning
- Björn
Hartmann, Leith Abdulla, Manas Mittal, Scott R Klemmer. (2007) Authoring
Sensor-based Interactions by Demonstration with Direct Manipulation and
Pattern Recognition. In Proceedings of CHI 2007: ACM Conference on Human Factors in Computing
Systems
- Björn
Hartmann, Scott R Klemmer, Michael Bernstein, Leith Abdulla, Brandon Burr,
Avi Robinson-Mosher, Jennifer Gee. (2006) Reflective physical prototyping
through integrated design, test, and analysis, In Proceedings of UIST
2006: ACM Symposium on User Interface Software and Technology.
- Scott R
Klemmer, Björn Hartmann, Leila Takayama. (2006) How Bodies Matter: Five
Themes for Interaction Design. In Proceedings of DIS 2006: ACM Conference on Designing Interactive
Systems.
- Ron Yeh,
Chunyuan Liao, Scott R Klemmer, François Guimbretière, Brain Lee, Boyko
Kakaradov, Jeannie Stamberger, Andreas Paepcke. (2006) ButterflyNet: A
Mobile Capture and Access System for Field Biology Research. In Proceedings
of CHI 2006: ACM Conference on Human
Factors in Computing Systems
- Brandon Burr (2006) VACA: a tool for qualitative
video analysis. In Proceedings of CHI '06 Extended Abstracts on Human
Factors in Computing Systems. ACM, New
York, NY.
References (DCOG-HCI, UCSD)
- Chunyuan Liao, François Guimbretière, Ken Hinckley,
and James D. Hollan (2008) Papiercraft: A Gesture-Based Command System for
Interactive Paper. ACM Transactions on Computer-Human Interaction. 14, 4 (Jan. 2008), 1-27.
- Timothy Sohn, Kevin A. Li, William G. Griswold, and
James D. Hollan. (2008) A Diary Study of Mobile Information Needs. In Proceedings
of CHI 2008:
ACM Conference on Human Factors in Computing Systems, 2008, 433-442.
- Amaya Becvar, James Hollan, and Edwin Hutchins.
(2008) Representational Gestures as Cognitive Artifacts for Developing
Theories in a Scientific Laboratory. In Resources, Co-Evolution, and
Artifacts: Theory in CSCW, Ackerman,
M.S., Halverson, C.A., Erickson, T., and Kellogg, W.A. (Eds.), 2008,
117-143.
- Malte Weiss, Roger Jennings, Julie Wagner, Ramsin
Khoshabeh, Jan Borchers, and James D. Hollan. (2008) SLAP: Silicone
Illuminated Active Peripherals. IEEE Tabletops and Interactive Surfaces, October 1-3, 2008, Amsterdam, the Netherlands.
- Kevin A. Li, Patrick Baudisch, William G. Griswold,
and James D. Hollan. (2008) Tapping and Rubbing: Exploring New Dimensions
of Tactile Feedback with Voice Coil Motors. In Proceedings of UIST
2008: ACM Symposium on User Interface Software and Technology.
- Anne Marie Piper and James D. Hollan. (2008)
Supporting Medical Conversations Between Deaf and Hearing Individuals with
Tabletop Displays. In Proceedings of CSCW 2008: ACM Computer Supported
Cooperative Work.
2. Présentation des partenaires (1
page environ par partenaire)
Présentez les différentes équipes
participantes ;
The In|Situ| group, INRIA
The In|Situ| group (INRIA) develops
novel interaction techniques as well as new tools to develop these techniques,
and new methods to control the design process of interactive systems. The goal
is to develop situated interfaces, i.e. interfaces that are adapted (or
adaptable) to their contexts of use by taking advantage of the complementary
aspects of humans and computers. The long-term goal is to create a new
generation of interactive environments as an alternative to the current
generation of desktop environments.
In|Situ| has three main research themes: New interaction paradigms: creating novel interaction techniques such as
multi-scale (or zoomable) interfaces, interactive information visualization,
bimanual interaction, and the use of video and non-speech audio, as well as the
integration of these techniques within a consistent environment. The project
also addresses augmented reality, i.e. the integration of computation and
interaction within physical objects and environments. Finally the project
studies the integration of cooperative services to all aspects of interactive
systems.
Participatory design: involving users
at all stages of the design process. It turns users into innovators and helps
understand the situated aspect of the users' activity. The project develops
participatory design methods and techniques that make the role of context
explicit in the design process.
Engineering of interactive systems: developing
novel interaction techniques and interaction paradigms requires the development
of specific tools to facilitate their integration and adoption. The project
studies component-based architectures where components that implement, e.g.
interaction techniques, may be added, removed or substituted dynamically.
The INSITU group has received financial support from Digiteo, INRIA-Microsoft Research Lab, Agence
Nationale de la Recherche, France Telecom, RNTL, ACI Masses de Données,
MIT-France, EU Disappearing Computer, EU Network of Excellence.
The HCI Group, Stanford University
The Stanford HCI Group works across disciplines to understand the
intersection between humans and computers. Our research has explored ubiquitous
computing, alternative methods of input, tools for enhancing designers' ability
to create and explore their ideas, and rapid prototyping tools for the Web and
physical devices. The HCI Group is associated with the Stanford Graphics Lab.
Current projects that are relevant to the proposed collaboration include
d.tools, GIGAprints and iTable.
d.tools is a hardware and software system that enables designers to rapidly
prototype the bits (the form) and the atoms (the interaction model) of physical
user interfaces in concert. d.tools was built to support design thinking rather
than implementation tinkering. With d.tools, designers place physical
controllers (e.g., buttons, sliders), sensors (e.g., accelerometers), and
output devices (e.g., LEDs, LCD screens) directly onto form prototypes, and
author their behavior visually in our software workbench. The d.tools
architecure was inspired by fieldwork conducted at Bay Area design studios and
Stanford's graduate product design program. After building an initial prototype
with Flash and Phidgets, d.tools has now turned into a full-fledged plug-in for
Eclipse with its own dedicated hardware platform. D.tools has been used to
re-create existing devices, is currently being deployed at a professional
product design consultancy, and will be given to students in Stanford's HCI
Design Studio course this winter.
The Interactive Gigapixel Prints (GIGAprints) project is an experiment in
the future of collaborative workspaces, where printed visualizations are
augmented with projectors and mobile devices. We are currently designing,
building, and testing the interactions and visualizations that best suit these
large paper surfaces.
The iTable is a bottom-projected computer tabletop display with a
3-by-4-foot display screen embedded in a wooden rim of a conference table. It
is part of the iRoom, a prototype interactive workspace located in the Computer
Science Building at Stanford University. A physical table naturally affords
collaboration around a shared display; we are interested in exploring new
interaction styles, techniques, and metaphors for collaboration around
tabletops enhanced by technology. Areas of exploration included the issues of
image grouping, relationships, annotation, multi-tiered categorization,
ordering of images, visual representations, space usage, collaboration support,
control and contention among users, orientation, rotation, support for the
separation of private and public spaces, and special interactions to support
piles on a tabletop.
As part of our research on designing computer-based systems for organizing
materials, we have conducted several qualitative and quantitative
investigations of tabletop use both with and without technology. We are
interested in exploring more flexible metaphors for organizing materials, such
as an informal "pile"-based metaphor, in a collaborative setting around
a tabletop. Our goal is to provide more casual, flexible systems for everyday
users.
The HCI Group has financial support from the National Science Foundation,
Wallenberg Global Learning Foundation, Microsoft, Media X, Sloan Foundation,
Nokia, Adobe, Intel, and Ricoh Innovations.
The DCOG-HCI Group, U.C. San Diego
Currently there is a shift in cognitive science toward a view of cognition
as a property of systems that are larger than isolated individuals. This
extends the reach of cognition to encompass interactions between people as well
as interactions with resources in the environment. Members of the Dcog-HCI lab
are dedicated to developing the theoretical and methodological foundations
engendered by this broader view of cognition and interaction.
We are united in the belief that distributed cognition promises to be a
particularly fertile framework for designing and evaluating augmented
environments and digital artifacts. A central image for us is environments in
which people pursue their activities in collaboration with the elements of of
the social and material world. Our core research efforts are directed at
understanding such environments: what we really do in them, how we coordinated
our activity in them, and what role technology should play in them.
An ongoing project particularly relevant with the proposed collaboration is
a multiscale framework for analyzing activity dynamics, funded by an NSF Grant. We propose
to integrate video and multiscale visualization facilities with computer vision
techniques to create a flexible open framework to radically
advance analysis of time-based records of human activity. We will
combine automatic annotation with multiscale visual representations to
allow events from multipledata streams to be juxtaposed on the same
timeline so that co-occurrence, precedence, and other previously invisible
patterns can be observed as analysts explore data relationships at
multiple temporal and spatial scales. Dynamic lenses and annotation tools
hwill provide interactive visualizations and flexible organizations of data. Our
goals are to (1) accelerate analysis by employing vision-based pattern
recognition capabilities to pre-segment and tag data records, (2) increase
analysis power by visualizing multimodal activity and macro-micro relationships,
and coordinating analysis and annotation across multiple scales, and (3)
facilitate shared use of our developing framework with collaborators.
The DCOG-HCI group has financial support from the National Science
Foundation (NSF), Microsoft Research, the UC MICRO Program, and the
Chancellor's Interdisciplinary Collaboratories Program. Recently completed
research has been funded by California's Digital Media Innovation Program,
Darpa, Intel, Microsoft, Nissan, NSF, and Sony.
Donnez, pour chaque partenaire,
la liste des chercheurs impliqués dans la proposition ainsi qu'un bref CV du
responsable ;
The In|Situ| Group, INRIA: Faculty
participants: Caroline Appert (CR, CNRS), Michel Beaudouin-Lafon (Profesor, U.
Paris-Sud), Olivier Chapuis (CR, CNRS), Stéphane Huot (MC, U. Paris-Sud), Wendy
Mackay (DR, INRIA), Emmanuel Pietriga (CR, INRIA).
CV of group leader: Wendy Mackay
(Ph.D., MIT 1990) is a Research Director at INRIA Saclay – Île-de-France and
also Vice President of Research for the Computer Science Department at the
University of Paris-Sud, France. She heads the In|Situ| research group in
Human-Computer Interaction, which includes 7 faculty and 16 Ph.D. students and
research staff from INRIA, CNRS and the University of Paris-Sud. She received
her Ph.D. in Management of Technological Innovation and has managed software
development groups at Digital Equipment Corporation and research groups at
Digital, MIT, Xerox, CENA and University of Aarhus. Her current research
interests include multidisciplinary research methods, mixed reality and
augmented paper, co-adaptive systems and multimedia. She served as Chair of
ACM/SIGCHI, among other executive positions, as well as member of the ACM
Publications Board and SIGBoard.
She has published over a hundred research articles in the area of
human-computer interaction and has served as program chair or on the program committees
of ACM CHI, ACM UIST, ACM CSCW, ACM DIS and ACM Multimedia, among other
conferences.
The HCI Group, Stanford University:
Faculty participants: Scott Klemmer (Professor), Roy Pea (Professor), Terry
Winograd (Professor).
CV of group leader: Scott Klemmer is
an Assistant Professor of Computer Science at Stanford University, where he
co-directs the Human-Computer Interaction Group. He collaborates with
Stanford's Institute of Design, and serves on the steering committee of the
Symbolic Systems program. He received a dual BA in Art-Semiotics and Computer
Science from Brown University, and an MS and PhD in Computer Science from UC
Berkeley. Several of his (along with many colleagues) research systems have had
commercial impact: his speech design tool has been used and extended by dozens
of companies; a system for vision-based capture of walls inspired current
commercial product features; and the handheld augmentation of books fueled
advanced development in industry. He is a co-recipient of the UIST 2006 and CHI
2007 Best Paper Awards, 2006 Microsoft Research New Faculty Fellowship, and
2008 Sloan Fellowship.
The DCOG-HCI Group, UCSD: Faculty
participants: Falko Kuester (Professor), James Hollan (Professor) and Ed Hutchins (Professor).
CV of group leader: James Hollan is a
Professor of Cognitive Science and Computer Science. His research explores the
cognitive consequences of computationally-based media. It is motivated by a
belief that we are at the beginning of a paradigm shift in thinking about
representational media, one that is starting to appreciate the importance of
representations that are not only dynamic and interactive but that also adapt
to the structure of tasks, the context of activities, and even our
relationships with others. The goal is to understand the cognitive,
computational, and social ecology of dynamic interactive adaptive media.His
interests span across cognitive ethnography, distributed and embodied
cognition, human-computer interaction, multiscale information visualization,
multimodal interaction, and software tools for visualization and interaction.
His current work involves four intertwined activities: developing theory and
methods, designing representations, implementing prototypes, and evaluating the
effectiveness of systems and understanding the broader design space in which
they are situated.
Indiquez, pour chaque
partenaire, les étudiants impliqués dans la proposition. Donnez une estimation
de leur nombre et précisez si des thèses en cotutelle sont prévues ;
The In|Situ| Group, INRIA: Ph.D.
students: Olivier Bau, Emilien Ghomi, Mathieu Nancel.
The HCI Group, Stanford University:
Ph.D. students and post-doctoral Fellows: Dave Ackers, Steven Dow, Wendy Ju and
Ron Yeh.
The DCOG-HCI Group, UCSD: Ph.D.
students and post-doctoral fellows: Amaya Becvar, Gaston Cangiano, Adam Fouse and
Anne Marie Piper.
In|Situ| has funding from the INRIA-Microsoft ReActivity project and from
the ANR iStar project that will allow us to hire Ph.D. students from UCSD and
Stanford as interns in these specific research areas and we hope, a post-doc.
We are also considering whether Aurélien Tabard, an INSITU Ph.D. student, can
do a post-doc at Stanford and will discuss other possibilities if the joint
team is accepted.
Présentez
l’historique de la collaboration entre les équipes ;
Faculty and student visits to France:
Jim Hollan, Adam Fouse (Ph.D. student UCSD) and Gaston Cangiano (Ph.D. student UCSD) came to InSitu in
June, 2008, to participate in the INRIA-Microsoft ReActivty workshop. Scott
Klemmer came to InSitu as a Visiting Professor for two weeks in July, 2008.
Faculty and student visits to Stanford and UCSD: Wendy Mackay gave a talk at UCSD in June 2007 and
will be visiting San Diego in November 2008, along with Nicolas Roussel (MC
U.Paris-Sud InSitu) and Aurèlien Tabard (Ph.D. student InSitu) in conjunction
with the CSCW conference. Wendy Mackay gave a talk at Stanford in June 2007,
Wendy Mackay and Michel Beaudouin-Lafon participated in a jury at Stanford in
December 2007, the visit included Aurélien Tabard and Caroline Appert (CR CNRS
InSitu). Wendy Mackay, Michel Beaudouin-Lafon, Aurélien Tabard and Olivier Bau (Ph.D. student InSitu)
will visit Stanford next week (October 2008), in conjunction with the UIST
conference in Monterey, California. Wendy Mackay worked with Dave Ackers (Ph.D.
student, Stanford) on Touchstone, and Aurélien Tabard worked extensively with
Ron Yeh (Ph.D. student, Stanford), using Ron’s interactive paper toolkit to
create the Prism Hybrid Notebook. The design of the UCSD HiPERspace wall
influenced the design of InSitu’s WALL project (funded by Digiteo and the
INRIA-Microsoft lab). Jim Hollan spent a sabbatical year at Stanford.
Liens
vers les pages des personnes, laboratoires, organismes;
In|Situ|, INRIA: http://insitu.lri.fr
· Wendy Mackay: http://www.lri.fr/~mackay
· Michel Beaudouin-Lafon: http://www.lri.fr/~mbl
· iStar project (ANR): http://www.i-star.fr
HCI Group, Stanford: http://hci.stanford.edu
· Scott Klemmer http://hci.stanford.edu/srk
· NSF grant: http://www.nsf.gov/awardsearch/showAward.do?AwardNumber=0534662
· NSF grant: http://www.nsf.gov/awardsearch/showAward.do?AwardNumber=0745320
DCOG-HCI Group, UCSD: http://hci.ucsd.edu/
· James
Hollan http://hci.ucsd.edu/hollan/
· NSF grant: A Multiscale Framework for Analyzing Activity Dynamics
· NSF grant: Visualizing and Anayzing Activity Data:
Initiating Collaboration with TDLC, LIFE, and Calit2
3. Impact (1 page maximum)
Indiquez l'impact de cette collaboration sur :
- les objectifs scientifiques des équipes participantes ;
- les relations entre les partenaires et entre les instituts (par exemple discutez de la complémentarité, de la
similarité pour un effet de masse critique, de la répartition des tâches pour
un gros développement, etc.)
The partners share a similar scientific vision and use similar technologies,
such as augmented paper or large interactive surfaces. This collaboration will
help reach critical mass in certain areas that are at the forefront of HCI
research: wall-sized displays, interactive paper, video analysis, design
workbench. It will allow us to collaborate on design methods, to share tools
and infrastructure, and to develop common data formats to exchange data. In the
mid- to long-term it will very likely lead to joint research projects and joint
publications
Although all three labs are well served with research grants, both from
industry and research foundations, creating an INRIA associate team will be an
opportunity to strengthen our existing research ties and create new links among
the faculty and research staff at both labs. We also feel that students from
both labs will benefit from the increased access to researchers and research
projects from a lab that specialises in their domain. The funding will be
particularly beneficial for allowing short visits for doctoral and
post-doctoral researchers and letting us pursue research ideas that might not
otherwise be feasible.
From INRIA’s perspective, this joint lab provides a leading edge collection
of research projects that speak directly to the Interaction theme in the new
4-year stategic plan. One major benefit of the technologies, systems and
methods developed by the three parteners is that they offer an important source
of technology transfer, to valorise the research conducted in each lab.
4. Divers : toute autre
information que vous jugerez utile d'ajouter.
II. PREVISIONS 2009
Programme de travail
Description du programme
scientifique de travail (1 à 2 pages maximum)
The work programme for 2009 will initiate actions in all 4 areas of the
collaboration. For this first year, the focus will be on exchanging information
and getting acquainted with each others’ software tools through cross visits.
This will provide a solid basis for initiating concrete collaborations and
joint projects in years 2 and 3. In addition, we expect that some student
visits will result in research articles that will be submitted in the fall of
2009 to conferences such as CHI.
1. Interaction with wall-sized display
In|Situ| will be setting up their WILD interactive wall. In order to benefit
from the partners’ expertise on large displays, In|Situ| members will visit
UCSD and Stanford. At UCSD, we will visit the HIPerWall project to gain
insights in setting up the display wall, the visualization cluster and
associated software. At Stanford, we will get acquainted with the software
(iROS, PointRight, Event Heap) that could be of interest to the WILD project.
At both sites, In|Situ| will present its technologies (Metisse Window System
and the ZVTM toolkit) and the various interaction techniques (Orthozoom,
Octopocus, Sigma lenses) that it has developed which are relevant to improving
interaction on large walls. This initial exchange of information will form the
basis for more direct collaborations and joint projects in years 2 and 3.
2. Design workbench
In|Situ| members will visit Stanford in October 2008 to discuss specific
links between the two groups’ approaches to developing design tools. In|Situ|
will present the SwingStates toolkit and Bau’s physical prototyping
toolkit and Stanford will present
its ‘enlightened prototyping’ tools. Our goal will be to identify specific
points of collaboration and to identify which students and faculty will visit
the other lab. We will test each other’s tools and methods in our respective
HCI courses and in project workshops and explore how we can collaborate in the
future on common design tools.
3. Interactive paper
All three groups have developed toolkits and applications that are directly
relevant to current interactive paper projects in each group, including
PaperToolkit, PapierCraft and Prism. UCSD has acquired 20 LiveScribe pens (not
currently available in France), and will share their expertise with In|Situ|,
when the latter acquires them in early 2009 for the ReActivity project. The
goal in the first year will be to identify a project on which we can
collaborate and design a novel interactive paper interface that pushes the
limits of this promising technology.
4. Ethnographer’s workbench
Members of all three groups will meet at the CHI’09 conference, for the workshop on ‘Capture, Visualization and Interaction with Temporal Data’, to share insights about their respective video analysis tools, to develop a common data exchange format, and to explore concrete proposals for specific research collaborations. The goal of this workshop will be to produce either a book or a special issue of a journal such as ACM Transactions on Human-Computer Interaction. We will also plan for a follow-on workshop to be held in conjunction with the UIST 2009 conference. We anticipate that students from either UCSD or Stanford will visit In|Situ| as interns, for the ReActivity project, and we expect to produce at least one research article for the CHI’10 conference.
Programme d'échanges avec budget prévisionnel
1. Echanges
Décrivez les échanges prévus
dans les deux sens : invitations de chercheurs de votre partenaire et missions
INRIA vers votre partenaire ;
In|Situ| will invite Jim Hollan (Professor, UCSD) and Scott Klemmer
(Professor, Stanford) as well as Dave Ackers (Stanford Ph.D. student) and Adam
Fouse and Gaston Cangiano (UCSD Ph.D. students) to visit INRIA. Wendy Mackay,
Michel Beaudouin-Lafon and Stéphane Huot, as well as Mathieu Nancel, Olivier
Bau and Emilien Ghomi (INRIA Ph.D. students) plan to visit Stanford and U.C.
San Diego in 2009.
Motivez,
si possible, les raisons scientifiques (travail
commun, workshop,..) et précisez la
durée prévue ;
As part of In|Situ|’s ReActivity project, we ran a
workshop on the Capture, Visualization and Interaction with Temporal Data, held
in Paris, 2008. We plan to meet at the UIST 2008 conference this year
(to be held in Monterery, California) to continue our discussions. We proposed
a workshop for CHI’09, for which the senior faculty are all on the program
committee, which was accepted and will bring us all together in Boston in the
spring of 2009. We also plan to organize a similar workshop in conjunction with
UIST’09 in the fall of 2009. Our visits to each
others’ labs will enable us to work with each others’ wall-sized displays and
collaborate on our design prototyping and video analysis tools. We also hope to
observe and work with users in each lab, providing all three groups with a much
wider range of feedback, for little extra cost. Finally, we plan to continue to
exchange technical information and tools with respect to the interactive paper
projects, particularly with respect to LiveScribe technology.
Résumez
ensuite ces informations dans les tableaux 1 et 2 ci-dessous en faisant une
estimation budgétaire :
|
1. ESTIMATION DES DEPENSES EN MISSIONS INRIA VERS LE PARTENAIRE |
Nombre de personnes |
Coût estimé |
|
Chercheurs confirmés |
3 |
7.5 K€ |
|
Post-doctorants |
0 |
|
|
Doctorants |
2 |
5 K€ |
|
Stagiaires |
0 |
|
|
Autre (précisez) : |
|
|
|
Total |
5 |
12.5 K€ |
|
2. ESTIMATION DES DéPENSES EN INVITATIONS DES PARTENAIRES |
Nombre de personnes |
Coût estimé |
|
Chercheurs confirmés |
2 |
5 K€ |
|
Post-doctorants |
|
|
|
Doctorants |
3 |
7.5 K€ |
|
Stagiaires |
|
|
|
Autre (précisez) : |
|
|
|
Total |
5 |
12.5 K€ |
2. Cofinancement
Cette coopération bénéficie-t-elle déjà d'un soutien financier de la part
de l'INRIA, de l'organisme étranger partenaire ou d'un organisme tiers (projet européen, NSF, ...) ?Indiquez
ces éléments et donnez les montants associés. Dans le cas où votre proposition
serait retenue, vous parait-il probable d'obtenir de l'organisme étranger
partenaire un soutien financier symétrique ? De quel montant ?
The U.S. partners have two NSF grants each (see the links above), which will
provide a relatively simple mechanism for obtaining additional financial
support. UCSD has already received an augmentation from one of their NSF grants
to collaborate with Stanford, which is why the amount listed, 5,000 k€, is a
conservative estimate. If the SIRIUS joint lab is approved, we will apply for
additional funding from NSF in 2009, although this takes some time. One of the
goals of the collaboration is to establish the foundations for new projects
that build upon our work together and to propose new projects that involve the
three projects.
3. Demande
budgétaire
Indiquez, dans le tableau ci-dessous, le coût global estimé de la
proposition et le budget demandé à la DRI dans le cadre de cette Equipe
Associée (maximum 20 K€).
|
Commentaires |
Montant |
|
A. Coût global de la proposition (total des tableaux 1 et 2 : invitations, missions, ...) |
25 K€ |
|
B. Cofinancements utilisés (financements autres que Equipe Associée) |
5 K€ |
|
Financement "Equipe Associée" demandé
(A.-B.) |
20 K€ |
_ INRIA - mise _ jour le 11/08/2008