CSE4443 Mobile User Interfaces. Gesture Recognition. Scott MacKenzie. York University. Map

Size: px
Start display at page:

Download "CSE4443 Mobile User Interfaces. Gesture Recognition. Scott MacKenzie. York University. Map"

Transcription

1 CSE4443 Mobile User Interfaces Gesture Recognition Scott MacKenzie York University Map Gestures are everywhere Android gestures Unistrokes / Graffiti recognition Android (revisited) 2

2 Map Gestures are everywhere Android gestures Unistrokes / Graffiti Android (revisited) in life 3 ASL (American Sign Language) 2

3 Copy Editing Traffic Control 3

4 Piazza Venezia Semaphore Signaling 4

5 N U J V Map Gestures are everywhere Android gestures Unistrokes / Graffiti Android (revisited) in computing 0 5

6 Lightpen on CRT Sutherland, I. E. (963). Sketchpad: A man machine graphical communication system. Proceedings of the AFIPS Spring Joint Computer Conference, New York: ACM. Finger(s) on CRT Herot, C. F., & Weinzapfel, G. (978). One point touch input of vector information for computer displays. Proceedings of SIGGRAPH 978, New York: ACM. 6

7 Pointing Bolt, R. (980). Put that there: Voice and gesture at the graphics interface. Computer Graphics, 4(3), Finger Gestures Minsky, M. R. (984). Manipulating simulated objects with real world gestures using a force and position sensitive screen. Proceedings of SIGGRAPH 984, New York: ACM. 7

8 Virtual Devices and Templates Buxton, W., Hill, R., & Rowley, P. (985). Issues and techniques in touch sensitive tablet input. Proceedings of SIGGRAPH '85, New York: ACM. Hand Gestures Zimmerman, T. G., Lanier, J., Blanchard, C., Bryson, S., & Harvill, Y. (987). A hand gesture interface device. Proceedings of CHI+GI 987,

9 Pie Menus Callahan, J., Hopkins, D., Weiser, M., & Shneiderman, B. (988). An empirical comparison of pie vs. linear menus. Proceedings of CHI '88, New York: ACM. Pen based Computing (early 990s) GRiDPad (Grid Systems) Pilot (Palm) 325 Point (Fujitsu) MessagePad 200 (Apple) 9

10 EO Personal Communicator Marking Menus Staples Misc Meat Junk Bread Fruit & Veg Auto Groceries Clothing House Kurtenbach, G., & Buxton, W. (993). The limits of expert performance using hierarchic marking menus. Proceedings of the INTERCHI '93, New York: ACM. 0

11 Marking Menus Kurtenbach, G., & Buxton, W. (993). The limits of expert performance using hierarchic marking menus. Proceedings of the INTERCHI '93, New York: ACM. GEdit Kurtenbach, G., & Buxton, W. (99). GEdit: A testbed for editing by contiguous gesture. SIGCHI Bulletin, 23(2),

12 Today Gestures for text entry 24 2

13 Unistrokes Goldberg, D., & Richardson, C. (993). Touch typing with a stylus. Proceedings INTERCHI '93, New York: ACM. Graffiti % accuracy after five minutes MacKenzie, I. S., & Zhang, S. (997). The immediate usability of Graffiti. Proceedings of Graphics Interface '97, pp Toronto: Canadian Information Processing Society. 3

14 Graffiti Research 2 3 Enns, N., & MacKenzie, I. S. (998). Touch based remote control devices.ext Abstracts of CHI '98, New York: ACM. 2 MacKenzie, I. S., Chen, J., & Oniszczak, A. (2006). Unipad: Single stroke text entry with languagebased acceleration. Proceedings of NordiCHI 2006, New York: ACM. 3 Tinwala, H., & MacKenzie, I. S. (2009). Eyes free text entry on a touchscreen phone. Proceedings of TIC STH 2009, New York: IEEE. RollPad Oniszczak, A., & MacKenzie, I. S. (2004). A comparison of two input methods for keypads on mobile devices. Proceedings of NordiCHI 2004, New York: ACM.. 4

A THREE-STATE MODEL OF GRAPHICAL INPUT *+1

A THREE-STATE MODEL OF GRAPHICAL INPUT *+1 1 A THREE-STATE MODEL OF GRAPHICAL INPUT *+1 William A.S. BUXTON Computer Systems Research Institute, University of Toronto, Toronto, Ontario, Canada M5S 1A4 A model to help characterize graphical input

More information

Mensch-Maschine-Interaktion 2 Übung 5

Mensch-Maschine-Interaktion 2 Übung 5 Mensch-Maschine-Interaktion 2 Übung 5 Ludwig-Maximilians-Universität München Wintersemester 2012/2013 Alexander De Luca, Aurélien Tabard Ludwig-Maximilians-Universität München Mensch-Maschine-Interaktion

More information

Design and Engineering of Software Applications for Touch Input Collection on Mobile Devices

Design and Engineering of Software Applications for Touch Input Collection on Mobile Devices Design and Engineering of Software Applications for Touch Input Collection on Mobile Devices Bogdan Gheran MintViz Lab MANSiD Research Center University Ștefan cel Mare of Suceava, ROMANIA E-mail: bogdan.gheran[at]gmail.com

More information

UniGest: Text Entry Using Three Degrees of Motion

UniGest: Text Entry Using Three Degrees of Motion UniGest: Text Entry Using Three Degrees of Motion Steven J. Castellucci Department of Computer Science and Engineering York University 4700 Keele St. Toronto, Ontario M3J 1P3 Canada stevenc@cse.yorku.ca

More information

ISSUES IN COMBINING MARKING AND DIRECT MANIPULATION TECHNIQUES. Gordon Kurtenbach and William Buxton. Computer Systems Research Institute,

ISSUES IN COMBINING MARKING AND DIRECT MANIPULATION TECHNIQUES. Gordon Kurtenbach and William Buxton. Computer Systems Research Institute, ISSUES IN COMBINING MARKING AND DIRECT MANIPULATION TECHNIQUES Gordon Kurtenbach and William Buxton Computer Systems Research Institute, University of Toronto, Toronto, Canada ABSTRACT The direct manipulation

More information

COMS W4170 Interaction Devices 2

COMS W4170 Interaction Devices 2 COMS W4170 Interaction Devices 2 Steven Feiner Department of Computer Science Columbia University New York, NY 10027 October 31, 2017 1 Stimulus Response (S R) Compatibility Whether mapping of user stimulus

More information

Input. Managing text and positional input

Input. Managing text and positional input Input Managing text and positional input ipod Wheel Macbook Wheel (The Onion) http://www.youtube.com/watch?v=9bnlbv6qyca Classifying Computer Input Sensing Method mechanical (e.g., switch, potentiometer)

More information

Interface for Digital Notes Using Stylus Motions Made in the Air

Interface for Digital Notes Using Stylus Motions Made in the Air Interface for Digital Notes Using Stylus Motions Made in the Air Yu Suzuki Kazuo Misue Jiro Tanaka Department of Computer Science, University of Tsukuba {suzuki, misue, jiro}@iplab.cs.tsukuba.ac.jp Abstract

More information

The Design and Evaluation of a High-Performance Soft Keyboard

The Design and Evaluation of a High-Performance Soft Keyboard CHI 99 15-20 MAY 1999 Papers The Design and Evaluation of a High-Performance Soft Keyboard I. Scott MacKenzie Dept. Computing and Information Science University of Guelph Guelph, ON NlG 2Wl Canada +15198244120x8268

More information

A Directional Stroke Recognition Technique for Mobile Interaction in a Pervasive Computing World

A Directional Stroke Recognition Technique for Mobile Interaction in a Pervasive Computing World Please reference this paper as Kostakos, V. and O'Neill, E. (2003) A Directional Stroke Recognition Technique for Mobile Interaction in a Pervasive Computing World, People and Computers XVII, Proceedings

More information

Pen- and Touch-Based Computing

Pen- and Touch-Based Computing Pen- and Touch-Based Computing Agenda Natural data types Pen, Audio, Video Pen-based topics Technology Ink as data Recognition Related: Gestures (on surfaces) iphone, MS Surface Technology sometimes similar

More information

EVALUATING DIFFERENT TOUCH-BASED INTERACTION TECHNIQUES IN A PUBLIC INFORMATION KIOSK

EVALUATING DIFFERENT TOUCH-BASED INTERACTION TECHNIQUES IN A PUBLIC INFORMATION KIOSK EVALUATING DIFFERENT TOUCH-BASED INTERACTION TECHNIQUES IN A PUBLIC INFORMATION KIOSK Roope Raisamo Department of Computer Science University of Tampere P.O. Box 607 (Pinninkatu 53B) FIN-33101 Tampere,

More information

Property Sensed, Order of Control. Position (graphics tablet, touchpad, touchscreen) Displacement (mouse, joystick) Force (joystick)

Property Sensed, Order of Control. Position (graphics tablet, touchpad, touchscreen) Displacement (mouse, joystick) Force (joystick) Property Sensed, Order of Control Property sensed Position (graphics tablet, touchpad, touchscreen) Displacement (mouse, joystick) Force (joystick) Order of control (property of display controlled) Position

More information

LetterScroll: Text Entry Using a Wheel for Visually Impaired Users

LetterScroll: Text Entry Using a Wheel for Visually Impaired Users LetterScroll: Text Entry Using a Wheel for Visually Impaired Users Hussain Tinwala Dept. of Computer Science and Engineering, York University 4700 Keele Street Toronto, ON, CANADA M3J 1P3 hussain@cse.yorku.ca

More information

Wave Menus: Improving the Novice Mode of Hierarchical Marking Menus

Wave Menus: Improving the Novice Mode of Hierarchical Marking Menus Wave Menus: Improving the Novice Mode of Hierarchical Marking Menus Gilles Bailly 1,2, Eric Lecolinet 2, Laurence Nigay 1, 1 LIG University of Grenoble 1, Grenoble, France 2 GET/ENST CNRS UMR 5141, Paris,

More information

Gathering Text Entry Metrics on Android Devices

Gathering Text Entry Metrics on Android Devices Proceedings of the International Conference on Multimedia and Human Computer Interaction Toronto, Ontario, Canada, July 18-19 2013 Paper No. 120 Gathering Text Entry Metrics on Android Devices Steven J.

More information

Pen-Based Interface Using Hand Motions in the Air

Pen-Based Interface Using Hand Motions in the Air IEICE TRANS. INF. & SYST., VOL.E91 D, NO.11 NOVEMBER 2008 2647 PAPER Special Section on Knowledge, Information and Creativity Support System Pen-Based Interface Using Hand Motions in the Air Yu SUZUKI

More information

Shadow Buttons: Exposing WIMP Functionality While Preserving the Inking Surface in Sketch-Based Interfaces

Shadow Buttons: Exposing WIMP Functionality While Preserving the Inking Surface in Sketch-Based Interfaces EUROGRAPHICS Symposium on Sketch-Based Interfaces and Modeling (2009) C. Grimm and J. J. LaViola Jr. (Editors) Shadow Buttons: Exposing WIMP Functionality While Preserving the Inking Surface in Sketch-Based

More information

PDA and Gesture Use in Practice: Insights for Designers of Pen-based User Interfaces

PDA and Gesture Use in Practice: Insights for Designers of Pen-based User Interfaces PDA and Gesture Use in Practice: Insights for Designers of Pen-based User Interfaces Allan Christian Long, Jr., James A. Landay, Lawrence A. Rowe Electrical Engineering and Computer Science Department

More information

Design av brukergrensesnitt på mobile enheter

Design av brukergrensesnitt på mobile enheter Design av brukergrensesnitt på mobile enheter Tutorial på Yggdrasil Lillehammer, 12 oktober 2009 Erik G. Nilsson SINTEF IKT ICT Agenda 13:15 Introduction, user interfaces on mobile equipment, important

More information

Input Devices Matter

Input Devices Matter Input Devices 1 Input Devices Matter Etch-A-Sketch Skedoodle 2 Images from http://research.microsoft.com/en-us/um/people/bibuxton/buxtoncollection/browse.aspx Tektronix 4010 http://www.pdp8.net/tek4010/tek4010.shtml

More information

An Imprecise Mouse Gesture for the Fast Activation of Controls

An Imprecise Mouse Gesture for the Fast Activation of Controls Human Computer Interaction INTERACT 99 Angela Sasse and Chris Johnson (Editors) Published by IOS Press, cfl IFIP TC.13, 1999 1 An Imprecise Mouse Gesture for the Fast Activation of Controls Martin S Dulberg,

More information

Continuous marking menus for learning cursive pen-based gestures

Continuous marking menus for learning cursive pen-based gestures Continuous marking menus for learning cursive pen-based gestures Adrien Delaye, Rafik Sekkal, Eric Anquetil To cite this version: Adrien Delaye, Rafik Sekkal, Eric Anquetil. Continuous marking menus for

More information

2. Mobile and Ubiquitous User Interfaces

2. Mobile and Ubiquitous User Interfaces 2. Mobile and Ubiquitous User Interfaces 2.1 Mobile Computing 2.2 Design Guidelines for Mobile Devices 2.3 Input and Output on Mobile Devices 2.4 System Architectures for Mobile Devices 2.5 Example Applications

More information

Gesture-Based 3D Mesh Modeler

Gesture-Based 3D Mesh Modeler Gesture-Based 3D Mesh Modeler Roland Carlos 1, Clarence Dalan 1, Aaron Sanchez 1, Kevin Tolentino 1 and Florante R. Salvador 1, * 1De La Salle University, Manila *Corresponding Author: florante.salvador@dlsu.edu.ph

More information

Input Techniques. CS376 6 May 2008

Input Techniques. CS376 6 May 2008 Input Techniques CS376 6 May 2008 Sites to Visit http://mrl.nyu.edu/projects/quikwriting/ Quikwrite2.html http://www.dontclick.it/ Explore > The Button Lab Explore > The Experiments Explore > The MouseCamp

More information

What is a good pen based application? HCI For Pen Based Computing. What is a good UI? Keystroke level model. Targeting

What is a good pen based application? HCI For Pen Based Computing. What is a good UI? Keystroke level model. Targeting What is a good pen based application? HCI For Pen Based Computing The windows desktop and browser are NOT good pen based apps! Richard Anderson CSE 481 B Winter 2007 What is a good UI? How do you measure

More information

Don Hopkins, The Design and Implementation of Pie Menus', Dr. Dobb's Journal, Dec. 1991, pp. 16, 18, 22, Appl. No.

Don Hopkins, The Design and Implementation of Pie Menus', Dr. Dobb's Journal, Dec. 1991, pp. 16, 18, 22, Appl. No. USOO5926178A United States Patent (19) 11 Patent Number: 5,926,178 Kurtenbach (45) Date of Patent: Jul. 20, 1999 54) DISPLAY AND CONTROL OF MENUS WITH Gordon Kurtenbach and William Buxton, The Limits Of

More information

ALTERNATIVE PERSPECTIVES

ALTERNATIVE PERSPECTIVES Alternative Perspectives 3.1 Chapter 3: ALTERNATIVE PERSPECTIVES Extending Our Understanding of the Relationships Among Devices In the previous chapter, the grain at which we looked at input devices was

More information

Input Models. Jorge Garza & Janet Johnson COGS 230 / CSE 216

Input Models. Jorge Garza & Janet Johnson COGS 230 / CSE 216 Input Models Jorge Garza & Janet Johnson COGS 230 / CSE 216 User Technology: From Pointing to Pondering Stu Card Thomas Moran User technology and Pointing devices Understand The Personal part of personal

More information

COMS W4170 Scaling Up and Down 2: From Wall-Sized to Hand-Held

COMS W4170 Scaling Up and Down 2: From Wall-Sized to Hand-Held COMS W4170 Scaling Up and Down 2: From Wall-Sized to Hand-Held Steven Feiner Department of Computer Science Columbia University New York, NY 10027 December 6, 2018 1 Large Displays: Automated Warping of

More information

Command composition approach in crossing interfaces. with more than two continuous goals

Command composition approach in crossing interfaces. with more than two continuous goals Some Student November 30, 2010 CS 5317 Command composition approach in crossing interfaces with more than two continuous goals 1. INTRODUCTION Over the last decade, pen and touch-based interactions began

More information

Page 1. Interface Input Modalities. Lecture 5a: Advanced Input. Keyboard input. Keyboard input

Page 1. Interface Input Modalities. Lecture 5a: Advanced Input. Keyboard input. Keyboard input Interface Input Modalities Lecture 5a: Advanced Input How can a user give input to an interface? keyboard mouse, touch pad joystick touch screen pen / stylus speech other more error! harder! (?) CS 530:

More information

COMS W4170 Case Study: Marking Menus 2

COMS W4170 Case Study: Marking Menus 2 COMS W4170 Case Study: Marking Menus 2 Steven Feiner Department of Computer Science Columbia University New York, NY 10027 October 23, 2018 1 Pie Menus vs. Linear Menus D. Hopkins, The Design and Implementation

More information

Interaction Design. Recap Session (Previous lecture April 21, 2016, 9am-12pm): Process Models, Elements and Usability

Interaction Design. Recap Session (Previous lecture April 21, 2016, 9am-12pm): Process Models, Elements and Usability Interaction Design Recap Session (Previous lecture April 21, 2016, 9am-12pm): Process Models, Elements and Usability 1 Recap Day 2: LMU München Medieninformatik Alexander Wiethoff Interaction Design SS2016

More information

Interaction Design. Chapter 3 (May 11, 2017, 9am-12pm): Approaches to IxD Recap Session (Previous lecture): Process Models, Elements and Usability

Interaction Design. Chapter 3 (May 11, 2017, 9am-12pm): Approaches to IxD Recap Session (Previous lecture): Process Models, Elements and Usability Interaction Design Chapter 3 (May 11, 2017, 9am-12pm): Approaches to IxD Recap Session (Previous lecture): Process Models, Elements and Usability 1 Bill Verplank http://rpmedia.ask.com/ts?u=/wikipedia/commons/thumb/9/9b/billverplank_ciid_2010.jpg/180px-billverplank_ciid_2010.jpg

More information

VISION BASED SINGLE STROKE CHARACTER RECOGNITION FOR WEARABLE COMPUTING

VISION BASED SINGLE STROKE CHARACTER RECOGNITION FOR WEARABLE COMPUTING VISION BASED SINGLE STROKE CHARACTER RECOGNITION FOR WEARABLE COMPUTING Oğuz ÖZÜN 1, Ö. Faruk ÖZER, C. Öncel TÜZEL 1, Volkan ATALAY 1, A. Enis ÇETİN,3 1 Dept. of Computer Engineering, Middle East Technical

More information

Device Independent Text Input: A Rationale and an Example

Device Independent Text Input: A Rationale and an Example Device Independent Text Input: A Rationale and an Example Poika Isokoski and Roope Raisamo Department of Computer Science University of Tampere P.O. Box 607 (Pinninkatu 53B) FIN-33101 Tampere, Finland

More information

Development of Computer Graphics. mid 1950s SAGE air defense system command & control CRT, light pens

Development of Computer Graphics. mid 1950s SAGE air defense system command & control CRT, light pens 1951 Whirlwind, Jay Forrester (MIT) CRT displays mid 1950s SAGE air defense system command & control CRT, light pens late 1950s Computer Art, James Whitney Sr. Visual Feedback loops 1962 Sketchpad, Ivan

More information

Physical Input and Tangible Computing

Physical Input and Tangible Computing stanford hci group cs147 Physical Input and Tangible Computing Björn Hartmann (bjoern@cs) 08 November 2006 http://cs147.stanford.edu Learning Goals Be familiar with the space of input devices, their properties

More information

The Design and Evaluation of a Flick Gesture for Back and Forward in Web Browsers

The Design and Evaluation of a Flick Gesture for Back and Forward in Web Browsers The Design and Evaluation of a Flick Gesture for Back and Forward in Web Browsers Michael Moyle Andy Cockburn Human-Computer Interaction Lab Department of Computer Science University of Canterbury Christchurch,

More information

Model for Unistroke Writing Time

Model for Unistroke Writing Time Model for Unistroke Writing Time Poika Isokoski Computer-Human Interaction Group Dept. of Computer and Information Sciences FIN-3314 University of Tampere Finland poika@cs.uta.fi ABSTRACT Unistrokes are

More information

ISO9241 Part 9. What is ISO

ISO9241 Part 9. What is ISO ISO9241 Part 9 I. Scott MacKenzie York University 1 What is ISO 9241-9 ISO 9241 Ergonomic design of visual display terminals (VDTs) used for office work Seventeen parts Part 9: Requirements for non-keyboard

More information

The Effects of Menu Parallelism on Visual Search and Selection

The Effects of Menu Parallelism on Visual Search and Selection Proc. 9th Australasian User Interface Conference (AUIC2008), Wollongong, Australia The Effects of Menu Parallelism on Visual Search and Selection Philip Quinn Andy Cockburn Department Computer Science

More information

Human-Computer Interaction Design Methods, Iterative DTE & I/O Devices BSc/CQU Lecture 2

Human-Computer Interaction Design Methods, Iterative DTE & I/O Devices BSc/CQU Lecture 2 Human-Computer Interaction Design Methods, Iterative DTE & I/O Devices BSc/CQU Lecture 2 (November 29, 2001) Tralvex (Rex) Yeap MAAAI MSCS Outline Quick Review of Lecture 1 Internet Search Tutorial M3.

More information

Usability & User Centered Design. SWE 432, Fall 2018 Design and Implementation of Software for the Web

Usability & User Centered Design. SWE 432, Fall 2018 Design and Implementation of Software for the Web Usability & User Centered Design SWE 432, Fall 2018 Design and Implementation of Software for the Web Review: Mental models Only single temperature sensor. Controls not independent, need to adjust both.

More information

A $-Family Friendly Approach to Prototype Selection

A $-Family Friendly Approach to Prototype Selection A $-Family Friendly Approach to Prototype Selection Corey Pittman cpittman@knights.ucf.edu Eugene M. Taranta II etaranta@gmail.com Joseph J. LaViola Jr. jjl@cs.ucf.edu ABSTRACT We explore the benefits

More information

A Technique to Improve Freehand Sketches of Multi-touch Interactions

A Technique to Improve Freehand Sketches of Multi-touch Interactions A Technique to Improve Freehand Sketches of Multi-touch Interactions Gil Barros, Leandro Velloso, and Luis Carli FAU-USP: Faculty of Architecture and Urbanism, University of São Paulo Rua do Lago, 876-05508.080

More information

A Context-Aware Keyboard Generator for Smartphone Using Random Forest and Rule-Based System

A Context-Aware Keyboard Generator for Smartphone Using Random Forest and Rule-Based System A Context-Aware Keyboard Generator for Smartphone Using Random Forest and Rule-Based System Sang-Muk Jo and Sung-Bae Cho (&) Department of Computer Science, Yonsei University, Seoul, South Korea {sangmukjo,sbcho}@yonsei.ac.kr

More information

Doonesbury. The Tablet PC overview. Topics. Homework Assignments. Richard Anderson CSE 481 B Winter 2007

Doonesbury. The Tablet PC overview. Topics. Homework Assignments. Richard Anderson CSE 481 B Winter 2007 Doonesbury The Tablet PC overview 8-24-1993 Richard Anderson CSE 481 B Winter 2007 8-27-1993 Topics Tablet PC introduction What and why Usability issues Hardware requirements Display Homework Assignments

More information

EECS 4441 / CSE 5351 Human-Computer Interaction. Topic #3 The Computer

EECS 4441 / CSE 5351 Human-Computer Interaction. Topic #3 The Computer EECS 4441 / CSE 5351 Human-Computer Interaction Topic #3 The Computer I. Scott MacKenzie York University, Canada 1 The Computer A computer system is made up of various elements Each affects the interaction

More information

Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices

Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Tovi Grossman 1,2 Ken Hinckley 1 Patrick Baudisch 1 Maneesh Agrawala 1,3 Ravin Balakrishnan 2 1 Microsoft Research

More information

Jump Desktop Mobile Device Access to Cornerstone

Jump Desktop Mobile Device Access to Cornerstone Jump Desktop Mobile Device Access to Cornerstone You can have your Cornerstone database at your fingertips (literally!) when you are out of your office through an ipad, iphone, Android mobile phones, and

More information

Menu Designs for Note-taking Applications

Menu Designs for Note-taking Applications 148 Menu Designs for Note-taking Applications Atsushi Kitani and Takako Nakatani Tablet devices have become popular and various note-taking applications are now available. We can manipulate those applications

More information

Predictive Model Examples. Keystroke-Level Model (KLM) 1 2

Predictive Model Examples. Keystroke-Level Model (KLM) 1 2 Predictive Model Examples Linear prediction equation Fitts law Choice reaction time Keystroke-level model (KLM) Skill acquisition More than one predictor 62 Keystroke-Level Model (KLM) 1 2 One of the earliest

More information

Too Hidden Features of the Windows CE Graphical Keyboard

Too Hidden Features of the Windows CE Graphical Keyboard Too Hidden Features of the Windows CE Graphical Keyboard Bill Buxton Microsoft Research One Microsoft Way Redmond, WA, 98052 bill.buxton@microsoft.com Unpublished Manuscript First Draft: April 15, 2013

More information

2/22/12. CS160: User Interface Design. Prototyping 02/2 2/12. Berkeley UNIVERSITY OF CALIFORNIA

2/22/12. CS160: User Interface Design. Prototyping 02/2 2/12. Berkeley UNIVERSITY OF CALIFORNIA CS160: User Interface Design Prototyping 02/2 2/12 Berkeley UNIVERSITY OF CALIFORNIA 1 Due Today: Contextual Inquiry printout due now Individual heuristic evaluation due online now Results: IPA2 Stats:

More information

History of Human Computer Interaction. History of HCI: Input/output devices

History of Human Computer Interaction. History of HCI: Input/output devices History of Human Computer Interaction Where did HCI innovations and philosophy come from? Who were the major personalities? What were the important systems? How did ideas move from the laboratory to the

More information

User-Centered Design. SWE 432, Fall 2017 Design and Implementation of Software for the Web

User-Centered Design. SWE 432, Fall 2017 Design and Implementation of Software for the Web User-Centered Design SWE 432, Fall 2017 Design and Implementation of Software for the Web In class exercise As you come in and take a seat Write down at least 3 characteristics that makes something usable

More information

Tailor: Creating Custom User Interfaces Based on Gesture

Tailor: Creating Custom User Interfaces Based on Gesture Tailor: Creating Custom User Interfaces Based on Gesture Randy Pausch & Ronald D, Williams University of Virginia Thornton Hall Charlottesville, VA 22903 (pausch@virginia.edu) 804-982-2211 Abstract Physical

More information

Evaluation of the handwriting function of an "on-door" communication system

Evaluation of the handwriting function of an on-door communication system Evaluation of the handwriting function of an "on-door" communication system Norihisa Segawa sega@iwate-pu.ac.jp Yuko Murayama murayama@iwate-pu.ac.jp Yasunari Nakamoto Hiroshima City University uni@nlp.its.hiroshima-cu.ac.jp

More information

Step 4 "Windows 7" Control Issues

Step 4 Windows 7 Control Issues Built into Windows 7 are features that traditionally are dormant, or are never used by the user. However, once the SMART Notebook TM Software is installed, these features will activate. Known as the "Pen

More information

http://uu.diva-portal.org This is an author s version of a paper presented at Academic MindTrek 2012 International Conference on Media of the Future, October 03-05, 2012, Tampere, Finland. Citation for

More information

The Design and Evaluation of a Text Editing Technique for Stylus-Based Tablets

The Design and Evaluation of a Text Editing Technique for Stylus-Based Tablets The Design and Evaluation of a Text Editing Technique for Stylus-Based Tablets Gennaro Costagliola, Mattia De Rosa, Vittorio Fuccella Dipartimento di Informatica, University of Salerno Via Giovanni Paolo

More information

Mobile UI. Device, Input, Interaction Characteristics. Mobile UI 1

Mobile UI. Device, Input, Interaction Characteristics. Mobile UI 1 Mobile UI Device, Input, Interaction Characteristics Mobile UI 1 Desktop and Mobile Mobile UI 2 Why touch? Space optimization! Touch screens combine input and output, which optimizes the display/output

More information

Development of Computer Graphics

Development of Computer Graphics 1951 Whirlwind, Jay Forrester (MIT) CRT displays mid 1950s SAGE air defense system command & control CRT, light pens late 1950s Computer Art, James Whitney Sr. Visual Feedback loops 1962 Sketchpad, Ivan

More information

ACCESSIBLE HANDHELD AND DESKTOP TEXT ENTRY FOR PEOPLE WITH MOTOR IMPAIRMENTS Jacob O. Wobbrock and Brad A. Myers Carnegie Mellon University

ACCESSIBLE HANDHELD AND DESKTOP TEXT ENTRY FOR PEOPLE WITH MOTOR IMPAIRMENTS Jacob O. Wobbrock and Brad A. Myers Carnegie Mellon University ACCESSIBLE HANDHELD AND DESKTOP TEXT ENTRY FOR PEOPLE WITH MOTOR IMPAIRMENTS Jacob O. Wobbrock and Brad A. Myers Carnegie Mellon University ABSTRACT In recent years there has been much effort to make desktop

More information

Taxonomy of Input Devices. Lecture 8-1: Input Devices. Keyboard Design Considerations

Taxonomy of Input Devices. Lecture 8-1: Input Devices. Keyboard Design Considerations : Input Devices Taxonomy of Input Devices Taxonomy ( Design Space ) Keyboards Pointing Devices Matching Devices to Work Keyboards QWERTY and Dvorak keyboards Chorded keyboards Pointing Devices Mice, trackballs,

More information

Supporting Transitions to Expertise in Hidden Toolbars

Supporting Transitions to Expertise in Hidden Toolbars Supporting Transitions to Expertise in Hidden Toolbars Katherine Schramm 1, Carl Gutwin 1, and Andy Cockburn 2 1 Computer Science, University of Saskatchewan 2 Computer Science, University of Canterbury

More information

Disconnecting the application from the interaction model

Disconnecting the application from the interaction model Disconnecting the application from the interaction model Ing-Marie Jonsson, Neil Scott, Judy Jackson Project Archimedes, CSLI Stanford University {ingmarie,ngscott,jackson}@csli.stanford.edu Abstract:

More information

CRISTAL Design and Implementation of a Remote Control System Based on a Multi-touch Display

CRISTAL Design and Implementation of a Remote Control System Based on a Multi-touch Display CRISTAL Design and Implementation of a Remote Control System Based on a Multi-touch Display Thomas Seifried 1, Michael Haller 1, Stacey D. Scott 2, Florian Perteneder 1, Christian Rendl 1, Daisuke Sakamoto

More information

INTERACTIVE 3D ANIMATION SYSTEM BASED ON TOUCH INTERFACE AND EFFICIENT CREATION TOOLS. Anonymous ICME submission

INTERACTIVE 3D ANIMATION SYSTEM BASED ON TOUCH INTERFACE AND EFFICIENT CREATION TOOLS. Anonymous ICME submission INTERACTIVE 3D ANIMATION SYSTEM BASED ON TOUCH INTERFACE AND EFFICIENT CREATION TOOLS Anonymous ICME submission ABSTRACT Recently importance of tablet devices with touch interface increases significantly,

More information

Homeschool Enrichment. Input & Output

Homeschool Enrichment. Input & Output Homeschool Enrichment Input & Output Overview This chapter covers: Different types of keyboards and pointing devices Types of scanners, readers, and digital cameras What audio input is Types of display

More information

ipad How to use the ipad Getting Started with the basics FHS Gabriel Hill 3/31/2011

ipad How to use the ipad Getting Started with the basics FHS Gabriel Hill 3/31/2011 2011 ipad How to use the ipad Getting Started with the basics FHS Gabriel Hill 3/31/2011 Contents at a Glance 1. How to start up your IPAD 2. How to connect and configure IPAD to the schools network 3.

More information

Premium Series. Excellence Series. V Series

Premium Series. Excellence Series. V Series Premium Series Excellence Series V Series i3touch PREMIUM P11&12 Premium design the perfect match in every state-of-the-art environment Intuitive user interface Intuitive user interface Integrated & always

More information

ITU-T Kaleidoscope Conference Innovations in NGN

ITU-T Kaleidoscope Conference Innovations in NGN ITU-T Kaleidoscope Conference Innovations in NGN Positional Gesture for Advanced Smart Terminals: Simple Gesture Text Input for Syllabic Scripts Like Myanmar, Khmer and Bangla Ye Kyaw Thu GITS, Waseda

More information

Mission-Critical Mobile Mapping. Paul Wilson

Mission-Critical Mobile Mapping. Paul Wilson Mission-Critical Mobile Mapping Paul Wilson UCSB 29 November 2012 Overview The Drive to Mobility A Personal Mobile Mapping Timeline Thinking about Mobility Early Mobile Applications Into the Mainstream

More information

An Evaluation of Stylus-Based Text Entry Methods on Handheld Devices in Stationary and Mobile Settings

An Evaluation of Stylus-Based Text Entry Methods on Handheld Devices in Stationary and Mobile Settings An Evaluation of Stylus-Based Text Entry Methods on Handheld Devices in Stationary and Mobile Settings Koji Yatani and Khai N. Truong University of Toronto Department of Computer Science Toronto, ON M5S

More information

98.2% 85.5% 93.8% Graduate School of Information Science and Technology, Osaka University

98.2% 85.5% 93.8% Graduate School of Information Science and Technology, Osaka University 1 1 1 1 1 98.2% 85.5% 93.8% 1. 1 Graduate School of Information Science and Technology, Osaka University 62 2. 2.1 Yeo RadarCat random forest classifier [1] Laput [2] Baudisch Lumino [3] 2.2 Ament The

More information

CPE/CSC 486: Human-Computer Interaction

CPE/CSC 486: Human-Computer Interaction CPE/CSC 486: Human-Computer Interaction Franz J. Kurfess Computer Science Department California Polytechnic State University San Luis Obispo, CA, U.S.A. Course Overview Introduction Cognitive Foundations

More information

AAA CENTER FOR DRIVING SAFETY & TECHNOLOGY

AAA CENTER FOR DRIVING SAFETY & TECHNOLOGY AAA CENTER FOR DRIVING SAFETY & TECHNOLOGY 2017 TESLA MODEL S 75 INFOTAINMENT SYSTEM* DEMAND RATING Very High Demand The Tesla Model S 75 infotainment system generated a very high demand rating in the

More information

Introduction. (Thanks to Professions Andries van Dam and John Hughes) CMSC 635 January 15, 2013 Introduction # /16

Introduction. (Thanks to Professions Andries van Dam and John Hughes) CMSC 635 January 15, 2013 Introduction # /16 Introduction (Thanks to Professions Andries van Dam and John Hughes) What is Computer Graphics? Computer graphics generally means creation, storage and manipulation of models and images Such models come

More information

LiquidKeyboard: An Ergonomic, Adaptive QWERTY Keyboard for Touchscreens and Surfaces

LiquidKeyboard: An Ergonomic, Adaptive QWERTY Keyboard for Touchscreens and Surfaces LiquidKeyboard: An Ergonomic, Adaptive QWERTY Keyboard for Touchscreens and Surfaces Christian Sax School of computing and communications University of Technology Sydney UTS Sydney, Australia sax@it.uts.edu.au

More information

Swipeboard: A Text Entry Technique for Ultra-Small Interfaces That Supports Novice to Expert Transitions

Swipeboard: A Text Entry Technique for Ultra-Small Interfaces That Supports Novice to Expert Transitions Swipeboard: A Text Entry Technique for Ultra-Small Interfaces That Supports Novice to Expert Transitions Xiang Anthony Chen 12, Tovi Grossman 1, George Fitzmaurice 1 1 User Interface Group Autodesk Research

More information

The Implementation of a Glove-Based User Interface

The Implementation of a Glove-Based User Interface The Implementation of a Glove-Based User Interface Chris Carey January 26, 2010 Abstract Multi-touch interfaces have been rising in usage because of how their multiple points of input simplify the execution

More information

Input. Scott Klemmer. HCI Design. with materials from Bjoern Hartmann, Stu Card, Pat Hanrahan

Input. Scott Klemmer. HCI Design. with materials from Bjoern Hartmann, Stu Card, Pat Hanrahan Input Scott Klemmer HCI Design. with materials from Bjoern Hartmann, Stu Card, Pat Hanrahan A7 Example Xu Li, Hans Yuan, Brian Nguyen, Input 4 Input! How do these devices work for getting information into

More information

User Interfaces for Web Sites and Mobile Devices. System and Networks

User Interfaces for Web Sites and Mobile Devices. System and Networks User Interfaces for Web Sites and Mobile Devices System and Networks Computer Systems and Networks: Device-Aware Interfaces Interfaces must take into account physical constraints of computers and networks:

More information

Alternative GUI for Interaction in Mobile Environment

Alternative GUI for Interaction in Mobile Environment Alternative GUI for Interaction in Mobile Environment Juraj Švec * Department of Computer Science and Engineering Czech Technical University in Prague Prague / Czech Republic Abstract Standard personal

More information

The Design and Evaluation of Multi-Finger Mouse Emulation Techniques

The Design and Evaluation of Multi-Finger Mouse Emulation Techniques The Design and Evaluation of Multi-Finger Mouse Emulation Techniques Justin Matejka, Tovi Grossman, Jessica Lo, George Fitzmaurice Autodesk Research 210 King St. East, Toronto, Ontario, Canada, M5A 1J7

More information

INTERACTION DEVICES. Keyboard Layouts. Keyboard Layouts

INTERACTION DEVICES. Keyboard Layouts. Keyboard Layouts INTERACTION DEVICES 1-1 8-1 Keyboard Layouts QWERTY layout 1870 Christopher Latham Sholes good mechanical design and a clever placement of the letters that slowed down the users enough that key jamming

More information

Dual Device User Interface Design: PDAs and Interactive Television

Dual Device User Interface Design: PDAs and Interactive Television Dual Device User Interface Design: PDAs and Interactive Television Scott Robertson, Cathleen Wharton, Catherine Ashworth, Marita Franzke Applied Research U S WEST Advanced Technologies 4001 Discovery Dr.

More information

Pen-Based Interaction

Pen-Based Interaction 75 Pen-Based Interaction Michael Haller Overview Motivation Technology 3D-approach 2D-approach Applications ButterflyNet ModelCraft Shared Design Space / INTOI 76 Motivation Background A digital world

More information

CMP 477 Computer Graphics Module 2: Graphics Systems Output and Input Devices. Dr. S.A. Arekete Redeemer s University, Ede

CMP 477 Computer Graphics Module 2: Graphics Systems Output and Input Devices. Dr. S.A. Arekete Redeemer s University, Ede CMP 477 Computer Graphics Module 2: Graphics Systems Output and Input Devices Dr. S.A. Arekete Redeemer s University, Ede Introduction The widespread recognition of the power and utility of computer graphics

More information

History of Ubicomp. Page 1. Agenda. Why study history? Paradigms. Shwetak Patel. Review history of Ubicomp

History of Ubicomp. Page 1. Agenda. Why study history? Paradigms. Shwetak Patel. Review history of Ubicomp CSE 599U Advanced Topics in Ubicomp History of Ubicomp Shwetak Patel Computer Science & Engineering Electrical Engineering Agenda Review history of Ubicomp Review the history of Human-Computer Interaction

More information

Digital Literacy. Identify types of computers, how they process information, and the purpose and function of different hardware components

Digital Literacy. Identify types of computers, how they process information, and the purpose and function of different hardware components Digital Literacy Identify types of computers, how they process information, and the purpose and function of different hardware components Computer Basics 1.01 Types of Computers Input and Output Devices

More information

Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques

Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques Shaun K. Kane, 1 Jeffrey P. Bigham 2 and Jacob O. Wobbrock 1 1 The Information School DUB Group

More information

Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques

Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques Shaun K. Kane,1 Jeffrey P. Bigham2 and Jacob O. Wobbrock1 2 1 The Information School DUB Group

More information

HoverLink: Joint Interactions using Hover Sensing Capability

HoverLink: Joint Interactions using Hover Sensing Capability HoverLink: Joint Interactions using Hover Sensing Capability Takuro Kuribara University of Tsukuba 1-1-1 Tennodai, Ibaraki, 305-8573, Japan kuribara@iplab.cs.tsukuba.ac.jp Buntarou Shizuki University of

More information

Designing Interaction Styles for a Mobile Use Context

Designing Interaction Styles for a Mobile Use Context Designing Interaction Styles for a Mobile Use Context Steinar Kristoffersen 1 and Fredrik Ljungberg 2 1 Norwegian Computing Centre, Postboks 114 Blindern, N-0314 Oslo, Norway steinar@nr.no 2 Viktoria Institute,

More information

How to input text on smartwatches? When the screen is tiny, a 3-key keypad is better than a full keyboard

How to input text on smartwatches? When the screen is tiny, a 3-key keypad is better than a full keyboard How to input text on smartwatches? When the screen is tiny, a 3-key keypad is better than a full keyboard Franck Poirier To cite this version: Franck Poirier. How to input text on smartwatches? When the

More information