Emergeables. Deformable Displays for Continuous Eyes-Free Mobile Interaction

Transcription

1 Emergeables Simon Robinson Céline Coutrix Jennifer Pearson Juan Rosso Matheus Fernandes Torquato Laurence Nigay Matt Jones 1 Deformable Displays for Continuous Eyes-Free Mobile Interaction

2 Mobile UIs lack tangibility 2

3 Mobile UIs lack tangibility 3

4 Mobile UIs lack tangibility 4

5 Mobile UIs lack tangibility 5

6 Mobile UIs lack tangibility Low preference Low performance Low safety 6

7 Emergeables 7

8 Emergeables 8

9 Emergeables 9

10 Emergeables 10

11 Emergeables 11

12 Emergeables 12

13 Emergeables 13

14 Emergeables 14

15 Emergeables 15

16 Emergeables 16

17 Emergeables 17

18 Emergeables 18

19 Benefits of Emergeables vs. new interaction Karrer et al., 2011 Serrano et al., 2014 Ramakers et al., 2014 known tangible control 19

20 Benefits of Emergeables vs. additional controls Jansen et al Florian Born, 2013 no additional articulatory task 20

21 Benefits of Emergeables vs. discrete control Harrison and Hudson, continuous control 21

22 Benefits of Emergeables for eyes-free mobile tasks + known tangible controls + no additional articulatory task + continuous control 22

23 Difficulty: technology 23

24 Technology: current approach Poupyrev et al., 2004 Follmer et al., 2013 Taher et al.,

25 Our approach 25

26 Manipulation 26

27 Manipulation: Translation 27

28 Manipulation: Rotation 28

29 Resolution 29

30 How far are we today? Is it worth the effort? 30

31 Prototype simulating high-resolution: tailored for experiment 31

32 High-resolution: Simulation prototype 32

33 High-resolution: Simulation prototype 33

34 Is it worth the effort? 34

35 How far are we today? Is it worth the effort? 35

36 How far are we today? 36

37 Low-resolution prototype 38

38 Design 39

39 Design 39

40 Design 39

41 Design 39

42 Components 40

43 Components 40

44 Prototype 41

45 Prototype 41

46 Controls 42

47 Experiment 43

48 Experiment Within-subjects design Three interfaces: High-resolution prototype Low-resolution prototype Graphical comparison interface 44

49 Experiment Within-subjects design Three interfaces: High-resolution prototype Low-resolution prototype Graphical comparison interface 44

50 Experiment Three independent variables Resolution: GUI, low-resolution, highresolution Complexity: 1 or 2 widgets (controlled simultaneously) Widget: dial or slider 45

51 Setting 46

52 Pursuit Tasks Solid white line: user s controller Blue shaded areas: target region 47

53 Pursuit Tasks 48

54 Experimental Design 18 participants; 50 minute sessions Format: Concept design video Training Tasks Structured interview 49

55 Measures Pursuit accuracy Visual attention required Perceived usability Ease of use (1 10) Rank interfaces in order of perceived visual attention required 50

56 Results 51

57 Pursuit error Mean pursuit error (% of range) GUI Low-res Hi-res 52 1 slider 1 dial

58 Pursuit error Mean pursuit error (% of range) GUI Low-res Hi-res 53 1 slider 1 dial

59 Pursuit error Mean pursuit error (% of range) GUI Low-res Hi-res 54 1 slider 1 dial

60 Pursuit error Mean pursuit error (% of range) GUI Low-res Hi-res 55 1 slider 1 dial

61 Pursuit error Mean pursuit error (% of range) GUI Low-res Hi-res 56 1 slider 1 dial

62 Visual Attention Mean number of times gaze averted per 60s trial slider 1 dial GUI Low-res High res 57

63 Visual Attention Mean number of times gaze averted per 60s trial slider 1 dial GUI Low-res High res 58

64 Visual Attention Mean number of times gaze averted per 60s trial slider 1 dial GUI Low-res High res 59

65 Users preferences Hi-res most preferred (8.8 / 10) Low-res promising (4.8 / 10) GUI least preferred (3.4 / 10) 60

66 Summary Accuracy Dial Slider Visual Attention Perceived Usability 61

67 Conclusions We have presented emergable surfaces for eyesfree control of continuous widgets Future Work: How to do higher resolution emergeable dials? How to improve interaction with emergeable sliders? 62

68 Thank you Emergeables: Deformable Displays for Continuous Eyes-Free Mobile Interaction Simon Robinson Céline Coutrix Jennifer Pearson Juan Rosso Matheus Fernandes Torquato Laurence Nigay Matt Jones 63