M2 HCID • Fundamentals of Situated Interaction

2016-2017

Lectures: building 640 (PUIO), room B109 (Fridays 1:30-4:30pm, Mondays 9:30am-12:30pm)
Instructors: Wendy Mackay mackay@lri.fr and Michel Beaudouin-Lafon mbl@lri.fr

This page and its content are solely for students enrolled in the 2016-2017 HCID Masters at Université Paris-Saclay. It contains instructors' material (slides and audio recordings) that are not to be distributed without the author's written consent, and copyrighted materials (such as articles) that are only made available under the fair use exception to copyright law.

Schedule

Lecture 1: Friday 16 September, 1:30-4:30pm, B109
Lecture 2: Friday 23 September, 1:30-4:30pm, B109
Lecture 3: Monday 26 September, 9:30am-12:30pm, B109
Lecture 4: Friday 30 September, 1:30-4:30pm, B109
Lecture 5: Friday 7 October, 1:30-4:30pm, B109
Lecture 6: Friday 14 October, 1:30-4:30pm, B109
Lecture 7: Monday 24 October, 9:30am-12:30pm, B109

Presentations

Monday 26 September:

• PhD students: Marianela Ciolfi (StickyLines), Jessalyn Alvina (Expressive keyboards), Michael Wessely (Stretchis)

Friday 30 September:

• Master students: Tom Hutman, Daniel Meusburger, Linghua Lai
• PhD students: Carla Griggio, Nacho Avelino

Friday 7 October:

• Master students: Yuxi Zhu, Tianqi Hao, Haoyu Yuan
• PhD students: Nolwenn Maudet, Germán Leiva

Friday 14 October:

• Master students: Chengcheng Qu, Chuan Qin, Mengyang Wang
• PhD students: Stacy Hsueh, Philip Tchernavskij

Monday Oct 24:

• PhD students: Abby Liu

List of papers

The list of papers is available on this page

Grading

20% - Class participation
30% - Seminar presentation
50% - Final report and iMuseum entry

Format of final report:

• A. Describe 3 interaction techniques and analyze them in terms of:
  • Instruments (reified? polymorphic? supports reuse?)
  • Substrates
  • Co-adaptation (user adapts/adapts to system? system adapts/adapts to user?)
• B. Innovate!
  Create a new technique or extend one or more techniques from part A and show how it uses the principles of coadaptive instruments to increase power and maintain simplicity.
• C. Create 3 entries in the Interaction Museum
  (Login information will be sent by email.)

Lecture 1 — 16 September 2016 — Instrumental Interaction

Handouts

• Introduction
• Instrumental Interaction
• Power and Simplicity

Audio recordings

• Part 1
• Part 2

Videos shown in class

• SketchPad
• StickyLines
• Webstrates

Assignment

1. Read these two papers:

• Instrumental Interaction: An Interaction Model for Designing Post-WIMP Interfaces, Beaudouin-Lafon, ACM CHI 2000.
• Reification, Polymorphism and Reuse: Three Design Principles for Designing Visual Interfaces, Beaudouin-Lafon & Mackay, AVI 2000.

2. Deconstruct one or two pieces of software that you are familiar with in terms of instruments and substrates.

Other readings

• The Architecture and Implementation of CPN2000, A Post-WIMP Graphical Application, Beaudouin-Lafon & Lassen, ACM UIST 2000. CPNtools web site.
• Webstrates: Shareable Dynamic Media, Klokmose, Eagan, Baader, Mackay & Beaudouin-Lafon, ACM UIST 2015. Webstrates web site

Lecture 2 — 23 September 2016 — Co-adaptation

Handouts

• Co-adaptation

Assignment

Read these papers:

• Responding to cognitive overload: Co-adaptation between users and technology. Mackay, W.E. (2000). Intellectica. Vol. 30 (1), pp. 177-193.
• From Gaia to HCI: On Multi-disciplinary Design and Co-adaptation. Mackay, W.E (2007). In Erickson, T. & McDonald, D. (Eds) HCI Remixed, reflections on notable HCI papers. MIT Press.

Lecture 3 — 26 September 2016 — PhD student presentations

• Marianela Ciolfi - StickyLines
• Jessalyn Alvina - Expressive Keyboards
• Michael Wessely - Stretchis

Lecture 4 — 30 September 2016 — Master and PhD student presentations

Master students

• Daniel Meusburger
  • RouteLens -
    Jessalyn Alvina, Caroline Appert, Olivier Chapuis, Emmanuel Pietriga. 2014. RouteLens: easy route following for map applications. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces (AVI '14). ACM, New York, NY, USA, 125-128.
  • JellyLens - -
    Cyprien Pindat, Emmanuel Pietriga, Olivier Chapuis, Claude Puech. 2012. JellyLens: content-aware adaptive lenses. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). ACM, New York, NY, USA, 261-270.
  • Aurigo -
    Alexandre Yahi, Antoine Chassang, Louis Raynaud, Hugo Duthil, Duen Horng (Polo) Chau. 2015. Aurigo: an Interactive Tour Planner for Personalized Itineraries. In Proceedings of the 20th International Conference on Intelligent User Interfaces (IUI '15). ACM, New York, NY, USA, 275-285.
• Tom Hutman
  • Drawing Assistant - - - web
    Emmanuel Iarussi, Adrien Bousseau, Theophanis Tsandilas. The drawing assistant: automated drawing guidance and feedback from photographs. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13). ACM, 2013, 183-192.
  • iCanDraw - -
    Daniel Dixon, Manoj Prasad, Tracy Hammond. iCanDraw: using sketch recognition and corrective feedback to assist a user in drawing human faces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, 2010, 897-906.
  • SnipShape
• Linghua Lai
  • Smarties - - - web
    Olivier Chapuis, Anastasia Bezerianos, Stelios Frantzeskakis. Smarties: an input system for wall display development. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, 2014, 2763-2772.
  • Dynaspot - -
    Olivier Chapuis, Jean-Baptiste Labrune, Emmanuel Pietriga. DynaSpot: speed-dependent area cursor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM. 2014, 1391-1400.
  • Dwell-and-Spring - - - web
    Caroline Appert, Olivier Chapuis, Emmanuel Pietriga. Dwell-and-spring: undo for direct manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 2012, 1957-1966.

PhD students

• Carla Griggio - Video player for conference previews
• Nacho Avelino - Telepresence across wall-sized displays

Brainstorming

Split into five groups with a mix of Master and PhD students in each group. Brainstorm

Lecture 5 — 7 October 2016 — Master and PhD student presentations

Master students

• Yuxi (Ceci) Zhu
  • Body-centric interaction - -
    Julie Wagner, Mathieu Nancel, Sean G. Gustafson, Stéphane Huot, Wendy E. Mackay. A Body-centric Design Space for Multi-surface Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, 2013, 1299-1308.
  • Rythmic Patterns - -
    Emilien Ghomi, Guillaume Faure, Stéphane Huot, Olivier Chapuis, Michel Beaudouin-Lafon. Using Rhythmic Patterns as an Input Method. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12. ACM, 2012, 1253-1262.
  • Tactile snowboarding -
    Daniel Spelmezan. An Investigation into the Use of Tactile Instructions in Snowboarding. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services (MobileHCI '12). ACM, 2012, 417-426.
• Tianqi Hao
  • SPad - -
    Cédric Foucault, Manfred Micaux, David Bonnet, Michel Beaudouin-Lafon. SPad: A Bimanual Interaction Technique for Productivity Applications on Multi-touch Tablets. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. ACM, 2014, 1879-1884.
  • Whizz -
    Stéphane Chatty. Extending a Graphical Toolkit for Two-Handed Interaction. In ACM Symposium on User Interface Software and Technology (UIST'94), Marina del Rey, California, USA. ACM.
  • Tilt and touch - -
    Theophanis Tsandilas, Caroline Appert, Anastasia Bezerianos, David Bonnet. Coordination of Tilt and Touch in One- and Two-Handed Use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Pages (CHI '14). ACM, 2014, 2001-2004.
• Hoayu (Howie) Yuan
  • BiPad - - web
    Julie Wagner, Stéphane Huot, Wendy Mackay. BiTouch and BiPad: Designing Bimanual Interaction for Hand-held Tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 2012, 2317-2326.
  • Pen+Touch - -
    Ken Hinckley, Michel Pahud, Hrvoje Benko, Pourang Irani, François Guimbretière, Marcel Gavriliu, Xiang 'Anthony' Chen, Fabrice Matulic, William Buxton, Andrew Wilson. Sensing Techniques for Tablet+Stylus Interaction. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14). ACM, 2014, 605-614.
  • Bimanual Browsing -
    Ross McLachlan, Stephen Brewster. Can You Handle It? Bimanual Techniques for Browsing Media Collections on Touchscreen Tablets, In CHI '13 Extended Abstracts on Human Factors in Computing Systems. ACM, 2013, 3095-3098.

PhD students

• Nolwenn Maudet
• Germán Leiva

Lecture 6 — 14 October 2016 — Master and PhD student presentations

Master students

• Chengcheng (Elise) Qu
  • Webstrates - - - web
    Clemens N. Klokmose, James R. Eagan, Siemen Baader, Wendy Mackay, Michel Beaudouin-Lafon. Webstrates: Shareable Dynamic Media. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, 2015, 280-290.
  • Hydrascope -
    Björn Hartmann, Michel Beaudouin-Lafon, Wendy E. Mackay. Hydrascope: Creating Multi-Surface Meta-Applications Through View Synchronization and Input Multiplexing. In Proceedings of the 2nd ACM International Symposium on Pervasive Displays (PerDis '13). ACM, 2013, 43-48.
  • Scotty -
    James R. Eagan, Michel Beaudouin-Lafon, Wendy E. Mackay. Cracking the Cocoa Nut: User Interface Programming at Runtime. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, 2011, 225-234 .
• Chuan (Thibault) Qin
  • Side pressure -
    Daniel Spelmezan, Caroline Appert, Olivier Chapuis, Emmanuel Pietriga. Side pressure for bidirectional navigation on small devices. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services (MobileHCI '13). ACM, 2013, 11-20.
  • HoloDesk - -
    Otmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, Andrew Wilson. HoloDesk: direct 3d interactions with a situated see-through display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 2012, 2421-2430.
  • Pen grips - -
    Song, Hyunyoung, et al. Grips and gestures on a multi-touch pen. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, 2011, 1323-1332.
• Mengyang Wang
  • PaperComposer -
    Jérémie Garcia, Theophanis Tsandilas, Carlos Agon, Wendy Mackay. PaperComposer: Creating Interactive Paper Interfaces for Music Composition. In Actes 26e conférence francophone sur l'Interaction Homme-Machine (IHM '14). ACM, 2014, 1-8.
  • Musink -
    Theophanis Tsandilas, Catherine Letondal, Wendy E. Mackay. Musink: Composing Music through Augmented Drawing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, 2009, 819-828.
  • InkSplorer -
    Jérémie Garcia, Theophanis Tsandilas, Carlos Agon, Wendy Mackay. InkSplorer: Exploring Musical Ideas on Paper and Computer. In Proceedings New Interfaces for Musical Expression (NIME '11). 2011, 361-366.

PhD students

• Stacy Hsueh
• Philip Tchernavskij

Lecture 7 — 24 October 2016 — PhD student presentation

PhD students

• Abby Liu