Unit III Human Computer Interaction. Ubiquitous computing: smart devices, environments and interaction

Transcription

1 Unit III Human Computer Interaction Ubiquitous computing: smart devices, environments and interaction 1

2 HCI: Overview Part A: ehci Use in some common smart device types Part B ihci for accompanied smart devices Part C: ihci for wearable & implanted smart devices Part D: Human Centred Design Part E: User Models and ihci Design Ubiquitous computing: smart devices, environments and interaction 2

3 HCI: Overview HCI, ehci & ihci ehci use in 4 Widely Used Devices ihci use in accompanied smart devices ihci use in wearable and implanted smart devices Human Centred Design (HCD) User Models: Acquisition & Representation ihci Design Ubiquitous computing: smart devices, environments and interaction 3

4 Smart Devices Mobile Devices ihci with Devices Smart Services Games Console Handheld WIMPS Basic Device ehci Video Recorder Softtap multitap T9 etc Multi-modal WIMPS Gesture Input Auditory Touchscreen Organic Natural Language Output Tangible Reflective Hidden ihci Wearables & Implants HUD VRD Eyetap Telepresence VR&AR Clothes Neural Implants HCD Usability Interaction Design ihci Design patterns User Modelling Goals versus Situation User Context Affective Personalisation (in)direct stereotype Ubiquitous computing: smart devices, environments and interaction 4

5 HCI: Introduction Term HCI, widely used, since onset of Personal Computing era in 1980s. However groundwork for field of HCI started earlier, during onset of the industrial revolution Tasks became automated and powered-assisted -> triggers an interest in studying human-machine interaction Some tasks require little human interaction during operation, e.g., clothes-, dish- washing etc Other tasks are very interactive, e.g., face washing, playing the violin, etc Ubiquitous computing: smart devices, environments and interaction 5

6 H,C & I Basic concepts of HCI are: Humans: single or multiple users, with diverse physical and mental abilities, interacting cooperatively or competitively Computers / devices: not just PCs but also a range of embedded computing devices and a range of device sizes such as dust, tabs, pads and boards Interaction: may be directed via a command or by manipulating virtual objects (windows, desktop) but it can also involve more natural interaction such as speech interaction, gestures, etc Ubiquitous computing: smart devices, environments and interaction 6

7 HCI: Motivation Machines (systems) aid human performance, but systems that interact poorly with humans will be a poor human aid. Need design models & process that are (user) interactive The motivation for HCI is clear; to support more effective use in three ways Useful: a User task that user requires to be done. Usable: Do the task easily, naturally, safely Be used: enrich the user experience by making it attractive, engaging, fun etc. Ubiquitous computing: smart devices, environments and interaction 7

8 Explicit HCI ehci is complex for UbiCom scenarios even if it is well designed for individual devices because we need to use tasks as part of activities that require access to services across multiple devices, because devices can be used by different types of people, because users are engaged in multiple concurrent activities, 7/29/2016 Ubiquitous computing: smart devices, environments and interaction

9 Explicit HCI because users are engaged in activities which may occur across multiple physical environments, because activities may be shared between participants, and because activities on occasion need to be suspended and resumed 7/29/2016 Ubiquitous computing: smart devices, environments and interaction

10 Explicit HCI (ehci) ehci design: explicit interaction during a device s normal operation. What are the Dominant ehci UIs Pure ehci Context-free Focus on H2C (Human-to-Computer) Interaction Ubiquitous computing: smart devices, environments and interaction 10

11 ihci Concept of implicit HCI (ihci) : Proposed by Schmidt (2000) Defined as an action, performed by the user that is not primarily aimed to interact with a computerized system but which such a system understands as input. Implicit interaction can allow some of the interaction to be hidden from users and hence for the device to become invisible Our definition of ihci bit different: inputs with an implicit or implied context, Ubiquitous computing: smart devices, environments and interaction 11

12 ihci To differentiate between ehci and ihci : consider a person entering a very dark room to retrieve an object There are some obvious challenges in supporting implicit interaction Implicit interaction is also introduced as we seek to design systems with which we can interact with in a more natural way For example, if we use hand gestures, such as a clap, to control a device to switch it on and off Ubiquitous computing: smart devices, environments and interaction 12

13 Overview HCI, ehci & ihci ehci use in 4 Widely Used Devices ihci use in accompanied smart devices ihci use in wearable and implanted smart devices Human Centred Design (HCD) User Models: Acquisition & Representation ihci Design Ubiquitous computing: smart devices, environments and interaction 13

14 Four of the most commonly used networked ICT devices PC like laptop, desktop Mobile Phone Games Console Remote controlled AV devices like TV / Projectors Ubiquitous computing: smart devices, environments and interaction 14

15 Diversity of ICT Device Interaction size: hand sized, centimetre sized, decimetre sized versus micro sized versus body sized or larger; haptic input: two handed versus one handed versus hands free operation; interaction modalities: single versus multiple; single user versus shared interaction: in personal space, friends space or public space;. posture for human operator: lying, sitting, standing, walking, running, etc.; 7/29/2016 Ubiquitous computing: smart devices, environments and interaction

16 Diversity of ICT Device Interaction distance of output display to input control: centimetres to metres; position during operation: fixed versus mobile; connectivity: stand alone versus networked, wired versus wireless; tasking: single task devices versus multi task devices; multimedia content access: voice and text communication oriented, alpha numeric data or text oriented, AV content access; integrated: embedded integrated devices versus 7/29/2016 dynamically Ubiquitous interoperable computing: smart devices, environments devices. and interaction

17 UI Type: Personal Computer Interface MEMEX System On the top are slanting translucent screens, on which material can be projected for convenient reading. There is a keyboard, and sets of buttons and levers. Otherwise it looks like an ordinary desk. Ubiquitous computing: smart devices, environments and interaction 17

18 UI Type: Personal Computer Interface Command Line Visual Interface WIMPS (Windows, Icons, Menu and Pointer device) Interface / Direct Manipulation interface 7/29/2016 Ubiquitous computing: smart devices, environments and interaction

19 PC UI use in Mobiles Using a conventional PC UI approach won t be optimum for mobile computing & ubiquitous computing - need a different approach, because of Smaller Display Area Variety of Resource constrained input and output Devices Handling limited key input : Multitap,T9, FastTap, Soft keys Handling limited output Audible outputs Vehicle navigation System Ubiquitous computing: smart devices, environments and interaction 19

20 UI Type: Games Console Interfaces Games consoles: an important driver and can contribute to UbiCom in a number of ways More Natural interface Many different types of Games Console Interface Forsters (2005) Seven different generation of Game Consoles 7 th generation includes Nintendo Wii - replacement of D- pad Ubiquitous computing: smart devices, environments and interaction 20

21 UI Type: Localised Remote Control Characteristics Interfaces Input controller and device separation Input device interfaces Wireless link between input control device and device Ubiquitous computing: smart devices, environments and interaction 21

22 Radio TV DVD-W Play channel Channel 5 Record channel Channel 4 Radio 17:38 1 GHI 4 PQR 7 ABC 2 JKL 5 STU 8 DEF 3 MNO 6 WXYZ 9 * 0 + # Ubiquitous computing: smart devices, environments and interaction 22