ACSD Evaluation Methods. and Usability Labs

Size: px
Start display at page:

Download "ACSD Evaluation Methods. and Usability Labs"

Transcription

1 ACSD Evaluation Methods and Usability Labs Department of Information Technology Uppsala University

2 Why Evaluation? Finding out problems Checking for quality of task support Changing design 2/24/11 #2

3 Three main types of methods Testing methods Representative users work on typical tasks using the system (or prototype) evaluators check the outcome: How supportive is the interface? Usability problems? Other problems? 2/24/11 #3

4 Three main types of methods Inspection methods Usability experts (sometimes other categories) examine the application for usability problems 2/24/11 #4

5 Three main types of methods Methods based on inquiries Usability evaluators interview the users for: likes, dislikes, needs, understanding of system. Also observation studies (of real work) 2/24/11 #5

6 Usability testing methods Teaching Method Thinking Aloud Protocol Coaching Method Co-discovery Learning Performance Measurement Question-asking Protocol Remote Testing Retrospective Testing Shadowing Method 2/24/11 #6

7 Usability Inspection Methods Cognitive Walkthroughs Feature Inspection Heuristic Evaluation Pluralistic Walkthrough Perspective-based Inspection 2/24/11 #7

8 Usability Inquiry Methods Field Observation Focus Groups Interviews Logging Actual Use Proactive Field Study Questionnaires 2/24/11 #8

9 Usability Study Process 1. Plan test (tasks, scope, etc.) 2. Prepare materials (user profiles, prototype, instructions, forms, etc.) 3. Prepare location 4. Run a Pilot Test Test the test 5. Recruit users based on your user profiles (advertise, select, schedule) 6. Conduct Test (briefing, user debriefing, questionnaires) 7. Analyze Results 8. Fix user interface and Retest 2/24/11 #9

10 Important parts of most tests Briefing, debriefing (why did we test?) Personal data (even for anonymous tests) Background data can be used for categorizing, statistics 2/24/11 #10

11 While conducting a usability test: 1. Don t praise the subject. 2. Don t prompt with Like/dislike. 3. Don t ask about Easy to use. 4. Don t ask about expectations. 5. Don t give instructions. 2/24/11 #11

12 Wizard of Oz-testing Controlled experiment Testing non-existent technology Subject believes it is real Surprisingly simple method. 2/24/11 #12

13 Wizard of Oz Made big displays through cheating The experiments cheats computer intelligence is replaced by human control Many uses for simulation of intelligent applications We can test concept without protoype 2/24/11 #13

14 Wizard of Oz studies Often performed in Usability labs Ghost operator is hidden behind one-way reflecting mirror TV-cameras and audio recordings Operator monitors and responds to user activities Observer observes 2/24/11 #14

15 Usability Laboratories Artificial setting for conducting usability studies Technically advanced environments Mostly used for observation studies Simulated or real applications 2/24/11 #15

16 Sample laboratory layout 2/24/11 #16

17 Test room 2/24/11 #17

18 Control room 2/24/11 #18

19 Controlled environments Advantages Good data recording facilities Large amounts of co-ordinated data Repeatable experiments Relatively easy to make variations in conditions 2/24/11 #19

20 Disadvantages Dependent on technology Expensive Artificial environment Unnatural conditions for the experiment Overkill? 2/24/11 #20

21 Working scene An alternative to Usability Lab A complete model of the work space (e.g., a bank office) is built for the testing purpose Real customers are enacting their tasks with real bank clerques Environment is a copy of the real implementation Good for testing secondary and tertiary users 2/24/11 #21

22 A bank office 2/24/11 #22

23 Supplies Working scenes contextual information realistic usage situations Real user problems Requires Massive effort Detail scenario planning Money 2/24/11 #23

24 Chit-chatting Warming up the user Joking (has to be from the heart, though) Pre-tests Informal interview 2/24/11 #24

25 Turing test If the computer succeeds in the Turing test, it will be considered intelligent! But what about a human that fails it? 2/24/11 #25

26 Purpose? It is important to ask the right questions! The wrong questions give bad answers. Have you stopped beating your dog? What is the proper answer here? Yes or No? 2/24/11 #26

Goals of Usability Evaluation

Goals of Usability Evaluation Goals of Usability Evaluation Formative Evaluation: What and how to re-design? Design Construction Summative Evaluation: How well did we do? 1 Formative and Summative Goals Formative: during development,

More information

Concepts of Usability. Usability Testing. Usability concept ISO/IS What is context? What is context? What is usability? How to measure it?

Concepts of Usability. Usability Testing. Usability concept ISO/IS What is context? What is context? What is usability? How to measure it? Concepts of Usability Usability Testing What is usability? How to measure it? Fang Chen ISO/IS 9241 Usability concept The extent to which a product can be used by specified users to achieve specified goals

More information

Usability Testing Essentials

Usability Testing Essentials Usability Testing Essentials Ready, Set...Test! Carol M. Barnum ELSEVIER Amsterdam Boston Heidelberg London New York Oxford Paris San Diego San Francisco Singapore Sydney Tokyo Morgan Kaufmann is an imprint

More information

CS-5200 Design Project

CS-5200 Design Project CS-5200 Design Project 20.3.2017 User testing Mika P. Nieminen Based on Sirpa Riihiaho Definition of Usability The extent to which a product can be used by specified users to achieve specified goals with

More information

Programmiersprache C++ Winter 2005 Operator overloading (48)

Programmiersprache C++ Winter 2005 Operator overloading (48) Evaluation Methods Different methods When the evaluation is done How the evaluation is done By whom the evaluation is done Programmiersprache C++ Winter 2005 Operator overloading (48) When the evaluation

More information

Evaluation in Information Visualization. An Introduction to Information Visualization Techniques for Exploring Large Database. Jing Yang Fall 2005

Evaluation in Information Visualization. An Introduction to Information Visualization Techniques for Exploring Large Database. Jing Yang Fall 2005 An Introduction to Information Visualization Techniques for Exploring Large Database Jing Yang Fall 2005 1 Evaluation in Information Visualization Class 3 2 1 Motivation What are the advantages and limitations

More information

Usability of interactive systems: Current practices and challenges of its measurement

Usability of interactive systems: Current practices and challenges of its measurement Usability of interactive systems: Current practices and challenges of its measurement Δρ. Παναγιώτης Ζαχαριάς Τμήμα Πληροφορικής Πανεπιστήμιο Κύπρου 23/2/2010 Concepts and Definitions Usability engineering

More information

CS 315 Intro to Human Computer Interaction (HCI)

CS 315 Intro to Human Computer Interaction (HCI) 1 CS 315 Intro to Human Computer Interaction (HCI) 2 3 Acceptance Tests Set goals for performance Objective Measurable Examples Mean time between failures (e.g. MOSI) Test cases Response time requirements

More information

User Testing & Automated Evaluation. Product Hall of Shame! User Testing & Automated Evaluation. Visual Design Review. Outline. Visual design review

User Testing & Automated Evaluation. Product Hall of Shame! User Testing & Automated Evaluation. Visual Design Review. Outline. Visual design review landay 1 USER INTERFACE DESIGN + PROTOTYPING + EVALUATION Product Hall of Fame or Shame? User Testing & Automated Evaluation Prof. James A. Landay University of Washington Apple One Button Mouse Autumn

More information

MTAT : Software Testing

MTAT : Software Testing MTAT.03.159: Software Testing Lecture 03: Black-Box Testing (advanced) Part 2 Dietmar Pfahl Spring 2018 email: dietmar.pfahl@ut.ee Black-Box Testing Techniques Equivalence class partitioning (ECP) Boundary

More information

Usability Testing Methods An Overview

Usability Testing Methods An Overview Usability Testing Methods An Overview Usability Examples of user interfaces that you like or dislike Are you the only one? What about other audiences? Have your preferences changed over time? Are there

More information

Evaluation techniques 1

Evaluation techniques 1 IMS5302 Human-computer interaction Lecture 6 Other Evaluation Techniques Overview Other evaluation methods Expert reviews Field studies Developing scenarios Selecting an evaluation method IMS5302 2 Scenarios

More information

Evaluation techniques 1

Evaluation techniques 1 IMS5302 Human- computer interaction Lecture 6 Other Evaluation Techniques Overview Other evaluation methods Expert reviews Field studies Developing scenarios Selecting an evaluation method IMS5302 2 Scenarios

More information

evaluation techniques goals of evaluation evaluation by experts cisc3650 human-computer interaction spring 2012 lecture # II.1

evaluation techniques goals of evaluation evaluation by experts cisc3650 human-computer interaction spring 2012 lecture # II.1 topics: evaluation techniques usability testing references: cisc3650 human-computer interaction spring 2012 lecture # II.1 evaluation techniques Human-Computer Interaction, by Alan Dix, Janet Finlay, Gregory

More information

CS 160: Evaluation. Outline. Outline. Iterative Design. Preparing for a User Test. User Test

CS 160: Evaluation. Outline. Outline. Iterative Design. Preparing for a User Test. User Test CS 160: Evaluation Professor John Canny Spring 2006 2/15/2006 1 2/15/2006 2 Iterative Design Prototype low-fi paper, DENIM Design task analysis contextual inquiry scenarios sketching 2/15/2006 3 Evaluate

More information

CS 160: Evaluation. Professor John Canny Spring /15/2006 1

CS 160: Evaluation. Professor John Canny Spring /15/2006 1 CS 160: Evaluation Professor John Canny Spring 2006 2/15/2006 1 Outline User testing process Severity and Cost ratings Discount usability methods Heuristic evaluation HE vs. user testing 2/15/2006 2 Outline

More information

..in a nutshell. credit: Chris Hundhausen Associate Professor, EECS Director, HELP Lab

..in a nutshell. credit:   Chris Hundhausen Associate Professor, EECS Director, HELP Lab ..in a nutshell credit: https://www.youtube.com/watch?v=6mczkwhjr9o Chris Hundhausen Associate Professor, EECS Director, HELP Lab Human-Centered Design in a Nutshell Key topics for this talk 1. User-centered

More information

EVALUATION OF THE USABILITY OF EDUCATIONAL WEB MEDIA: A CASE STUDY OF GROU.PS

EVALUATION OF THE USABILITY OF EDUCATIONAL WEB MEDIA: A CASE STUDY OF GROU.PS EVALUATION OF THE USABILITY OF EDUCATIONAL WEB MEDIA: A CASE STUDY OF GROU.PS Turgay Baş, Hakan Tüzün Hacettepe University (TURKEY) turgaybas@hacettepe.edu.tr, htuzun@hacettepe.edu.tr Abstract In this

More information

User-centered design in technical communication

User-centered design in technical communication User-centered design in technical communication Information designer & information architect Sharing knowledge is better than having it. Tekom - TC Europe November 19-20, 2003 Nov. 19-20, 2003 User-centered

More information

Carbon IQ User Centered Design Methods

Carbon IQ User Centered Design Methods Carbon IQ User Centered Design The effort of designing usable, targeted, desirable and efficient products involves acquiring and analyzing user data. Selecting exactly the right method for this can be

More information

3 Prototyping and Iterative Evaluations

3 Prototyping and Iterative Evaluations 3 Prototyping and Iterative Evaluations Viktoria Pammer-Schindler March 15, 2016 Prototyping and Iterative Evaluations 1 Days and Topics March 1 March 8 March 15 April 12 April 19/21 April 26 (10-13) April

More information

Page 1. Ideas to windows. Lecture 7: Prototyping & Evaluation. Levels of prototyping. Progressive refinement

Page 1. Ideas to windows. Lecture 7: Prototyping & Evaluation. Levels of prototyping. Progressive refinement Ideas to windows Lecture 7: Prototyping & Evaluation How do we go from ideas to windows? Prototyping... rapid initial development, sketching & testing many designs to determine the best (few?) to continue

More information

Foundation Level Syllabus Usability Tester Sample Exam

Foundation Level Syllabus Usability Tester Sample Exam Foundation Level Syllabus Usability Tester Sample Exam Version 2017 Provided by German Testing Board Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged.

More information

Analytical &! Empirical Evaluation

Analytical &! Empirical Evaluation Analytical &! Empirical Evaluation Informatics 132 5/22/2012 TODAY Evaluation Due: A3 Paper Prototyping UPCOMING Friday: Group Project Time Monday: Memorial Day, No Class Wednesday: HCI in the Real World

More information

CUE-10: Moderation Page 1. Comparative Usability Evaluation 10. Moderation. Observing usability test moderators

CUE-10: Moderation Page 1. Comparative Usability Evaluation 10. Moderation. Observing usability test moderators CUE-10: Moderation Page 1 Comparative Usability Evaluation 10 Moderation Observing usability test moderators Workshop: Boston, MA, USA, Wednesday 9 May 2018 CUE-10: Moderation Page 2 Call For Participation

More information

COSC 341 Human Computer Interaction. Dr. Bowen Hui University of British Columbia Okanagan

COSC 341 Human Computer Interaction. Dr. Bowen Hui University of British Columbia Okanagan COSC 341 Human Computer Interaction Dr. Bowen Hui University of British Columbia Okanagan 1 Recall: Learning About Your User Common ways to elicit user feedback: Interviews Focus groups Expert reviews

More information

Chapter 4. Evaluating Interface Designs

Chapter 4. Evaluating Interface Designs Chapter 4 Evaluating Interface Designs 1 Introduction Designers may fail to evaluate their designs adequately. Experienced designers know that extensive testing is a necessity. Few years ago, evaluation

More information

HCI: THE DESIGN PROCESS. Dr Kami Vaniea

HCI: THE DESIGN PROCESS. Dr Kami Vaniea HCI: THE DESIGN PROCESS Dr Kami Vaniea 1 First, the news Make Your UX Design Process Agile Using Google s Methodology https://www.interactiondesign.org/literature/article/make-your-ux-designprocess-agile-using-google-s-methodology

More information

CPSC 444 Project Milestone III: Prototyping & Experiment Design Feb 6, 2018

CPSC 444 Project Milestone III: Prototyping & Experiment Design Feb 6, 2018 CPSC 444 Project Milestone III: Prototyping & Experiment Design Feb 6, 2018 OVERVIEW... 2 SUMMARY OF MILESTONE III DELIVERABLES... 2 1. Blog Update #3 - Low-fidelity Prototyping & Cognitive Walkthrough,

More information

Introducing Evaluation

Introducing Evaluation Chapter 12 Introducing Evaluation 1 The aims Explain the key concepts used in evaluation. Introduce different evaluation methods. Show how different methods are used for different purposes at different

More information

Contextual Inquiry in Practice

Contextual Inquiry in Practice Contextual Inquiry in Practice User-Centered Design Choi, Jinchul spiders22v@gmail.com Young Kitak gms107@gmail.com 9 th February 2009 1 Contextual Inquiry p Collection of detailed information about customer

More information

Chapter 15: Analytical evaluation

Chapter 15: Analytical evaluation Chapter 15: Analytical evaluation Aims: Describe inspection methods. Show how heuristic evaluation can be adapted to evaluate different products. Explain how to do doing heuristic evaluation and walkthroughs.

More information

Integrating Usability Design and Evaluation: Training Novice Evaluators in Usability Testing

Integrating Usability Design and Evaluation: Training Novice Evaluators in Usability Testing Integrating Usability Design and Evaluation: Training Novice Evaluators in Usability Testing Mikael B. Skov and Jan Stage Department of Computer Science Aalborg University Aalborg Øst, Denmark +45 9635

More information

SOFTWARE REQUIREMENTS ENGINEERING LECTURE # 7 TEAM SKILL 2: UNDERSTANDING USER AND STAKEHOLDER NEEDS REQUIREMENT ELICITATION TECHNIQUES-IV

SOFTWARE REQUIREMENTS ENGINEERING LECTURE # 7 TEAM SKILL 2: UNDERSTANDING USER AND STAKEHOLDER NEEDS REQUIREMENT ELICITATION TECHNIQUES-IV 1 SOFTWARE REQUIREMENTS ENGINEERING LECTURE # 7 TEAM SKILL 2: UNDERSTANDING USER AND STAKEHOLDER NEEDS REQUIREMENT ELICITATION TECHNIQUES-IV 12 th June, 2013 Instructor Information 2 Course Instructor:

More information

Usability Testing! Hall of Fame! Usability Testing!

Usability Testing! Hall of Fame! Usability Testing! HCI+D: USER INTERFACE DESIGN + PROTOTYPING + EVALUATION Hall of Fame or Shame? Usability Testing Computer Science Department Apple One Button Mouse Autumn 2014 November 4, 2014 Hall of Shame Hall of Fame

More information

Foundation Level Syllabus Usability Tester Sample Exam Answers

Foundation Level Syllabus Usability Tester Sample Exam Answers Foundation Level Syllabus Usability Tester Sample Exam s Version 2017 Provided by German Testing Board Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged.

More information

Heuristic evaluation is a usability inspection technique developed by Jakob Nielsen. The original set of heuristics was derived empirically from an

Heuristic evaluation is a usability inspection technique developed by Jakob Nielsen. The original set of heuristics was derived empirically from an Heuristic evaluation is a usability inspection technique developed by Jakob Nielsen. The original set of heuristics was derived empirically from an analysis of 249 usability problems (Nielsen, 1994). -Preece

More information

Learnability of software

Learnability of software Learnability of software Aim: Evaluating learnability Writing on-line help Basis for Assignment 2 1 Qualities of IT applications Learnability From novice to expert user Time from first encounter to use

More information

Introduction on Usability

Introduction on Usability Introduction on Usability Courtesy of Luca Triacca (luca.triacca@lu.unisi.ch) TEC-Lab University of Lugano www.tec-lab.ch Agenda Introduction on Usability MiLE+: a systematic method for usability evaluation

More information

3 Evaluating Interactive Systems

3 Evaluating Interactive Systems 3 Evaluating Interactive Systems Viktoria Pammer-Schindler March 23, 2015 Evaluate 1 Android Sensing Tutorial Day on April 23 Save the Date!!! Evaluate 2 Days and Topics March 11 March 16 Intro Designing

More information

MIT GSL week 4 Wednesday. User Interfaces II

MIT GSL week 4 Wednesday. User Interfaces II MIT GSL 2018 week 4 Wednesday User Interfaces II User Centered Design Prototyping! Producing cheaper, less accurate renditions of your target interface! Essential in spiral design process, useful in later

More information

Anirudha Joshi IDC, IIT Bombay

Anirudha Joshi IDC, IIT Bombay Anirudha Joshi IDC, IIT Bombay HCI design process (AJ) Garret s model (JJG) Contextual design process (HB/KH) Usability engineering lifecycle (DM) Goal driven design (AC/RR) Inherent resistance to change

More information

Software Development and Usability Testing

Software Development and Usability Testing Software Development and Usability Testing Shneiderman, Chapter 4 Preece et al, Ch 9, 11-15 Krug, Rocket Surgery Made Easy Rubin, Handbook of Usability Testing Norman Neilsen Group www HCI in Software

More information

EVALUATION OF PROTOTYPES USABILITY TESTING

EVALUATION OF PROTOTYPES USABILITY TESTING EVALUATION OF PROTOTYPES USABILITY TESTING CPSC 544 FUNDAMENTALS IN DESIGNING INTERACTIVE COMPUTATION TECHNOLOGY FOR PEOPLE (HUMAN COMPUTER INTERACTION) WEEK 9 CLASS 17 Joanna McGrenere and Leila Aflatoony

More information

Information Systems Interfaces (Advanced Higher) Information Systems (Advanced Higher)

Information Systems Interfaces (Advanced Higher) Information Systems (Advanced Higher) National Unit Specification: general information NUMBER DV51 13 COURSE Information Systems (Advanced Higher) SUMMARY This Unit is designed to develop knowledge and understanding of the principles of information

More information

Rapid Research. For 2.0 Development. Presented by Kelly Goto

Rapid Research. For 2.0 Development. Presented by Kelly Goto Rapid Research For 2.0 Development Presented by Kelly Goto kelly@gotomedia.com "Successful user experiences deliver a firm's value proposition -- the brand promise -- to customers in the most effective

More information

MAKING YOUR GATEWAY EASY AND PLEASANT TO USE

MAKING YOUR GATEWAY EASY AND PLEASANT TO USE MAKING YOUR GATEWAY EASY AND PLEASANT TO USE AN INTRODUCTION TO USABILITY AND USER-CENTERED DESIGN Paul Parsons November 8, 2017 SGCI Webinar Background PhD, Computer Science Specialty: Human-Computer

More information

IEC/TR : (E)

IEC/TR : (E) IEC/TR 62366-2:2016-04 (E) Medical devices - Part 2: Guidance on the application of usability engineering to medical devices Contents Page FOREWORD... 6 INTRODUCTION... 8 1 Scope and purpose... 9 1.1 Scope...

More information

BETTER TIPS FOR TAPS LIBRARY TECHNOLOGY CONFERENCE 2017 JUNIOR TIDAL WEB SERVICES & MULTIMEDIA LIBRARIAN NEW YORK CITY COLLEGE OF TECHNOLOGY, CUNY

BETTER TIPS FOR TAPS LIBRARY TECHNOLOGY CONFERENCE 2017 JUNIOR TIDAL WEB SERVICES & MULTIMEDIA LIBRARIAN NEW YORK CITY COLLEGE OF TECHNOLOGY, CUNY BETTER TIPS FOR TAPS LIBRARY TECHNOLOGY CONFERENCE 2017 JUNIOR TIDAL WEB SERVICES & MULTIMEDIA LIBRARIAN NEW YORK CITY COLLEGE OF TECHNOLOGY, CUNY OVERVIEW MOBILE USABILITY TESTING MOBILE VS DESKTOP SETTING

More information

10 Best Design Practices

10 Best Design Practices 10 Best Design Practices Heather Winkle Product Manager of User Experience FileMaker, Inc. Session Agenda 10 Best Design Practices Your Ideas for Improving FileMaker 1. Don t start at the computer It is

More information

Cognitive Disability and Technology: Universal Design Considerations

Cognitive Disability and Technology: Universal Design Considerations Cognitive Disability and Technology: Universal Design Considerations Clayton Lewis Coleman Institute for Cognitive Disabilities RERC-ACT clayton.lewis@colorado.edu Prepared for AUCD Training Symposium,

More information

esign an ser mterrace Evaluation TheOpen University DEBBIE STONE The Open University, UK CAROLINE JARRETT Effortmark Limited

esign an ser mterrace Evaluation TheOpen University DEBBIE STONE The Open University, UK CAROLINE JARRETT Effortmark Limited ser mterrace Evaluation esign an DEBBIE STONE The Open University, UK CAROLINE JARRETT Effortmark Limited MARK W O O D R O F F E The Open University, UK SHAILEY MINOCHA The Open University, UK 9 TheOpen

More information

Homework Set 2. A brief discussion

Homework Set 2. A brief discussion Homework Set 2 A brief discussion Homework Set 2 A brief discussion (#%" (#$" ("!#'"!#&"!#%"!#$"!"!" )" (!" ()" $!" $)" *!" *)" %!" Problem 4 Hick s Law or Fitt s Law? MT = a + b ID ID = log 2 ( A W +

More information

(Milano Lugano Evaluation Method) A systematic approach to usability evaluation. Part I LAB HCI prof. Garzotto - HOC-POLITECNICO DI MILANO a.a.

(Milano Lugano Evaluation Method) A systematic approach to usability evaluation. Part I LAB HCI prof. Garzotto - HOC-POLITECNICO DI MILANO a.a. (Milano Lugano Evaluation Method) A systematic approach to usability evaluation Part I LAB HCI prof. Garzotto - HOC-POLITECNICO DI MILANO a.a. 04-05 1 ABOUT USABILITY 1. WHAT IS USABILITY? Ë Usability

More information

Assignment 5 is posted! Heuristic evaluation and AB testing. Heuristic Evaluation. Thursday: AB Testing

Assignment 5 is posted! Heuristic evaluation and AB testing. Heuristic Evaluation. Thursday: AB Testing HCI and Design Topics for today Assignment 5 is posted! Heuristic evaluation and AB testing Today: Heuristic Evaluation Thursday: AB Testing Formal Usability Testing Formal usability testing in a lab:

More information

Engineering Human Computer Interaction

Engineering Human Computer Interaction Engineering Human Computer Interaction Gaëlle Calvary Professor in Computer Science Institut polytechnique de Grenoble Laboratoire d Informatique de Grenoble G. Calvary 1 Core principles G. Calvary 2 Global

More information

CSc 238 Human Computer Interface Design Chapter 5 Designing the Product: Framework and Refinement. ABOUT FACE The Essentials of Interaction Design

CSc 238 Human Computer Interface Design Chapter 5 Designing the Product: Framework and Refinement. ABOUT FACE The Essentials of Interaction Design BBuckley - 1 CSc 238 Human Computer Interface Design Chapter 5 Designing the Product: Framework and Refinement ABOUT FACE The Essentials of Interaction Design Cooper, Reimann, Cronin, and Noessel Requirements

More information

MMI 2. Tutorials. Winter Term 2017/18. LMU München - LFE Medieninformatik. Prof. Andreas Butz Renate Häuslschmid Christina Schneegaß

MMI 2. Tutorials. Winter Term 2017/18. LMU München - LFE Medieninformatik. Prof. Andreas Butz Renate Häuslschmid Christina Schneegaß MMI 2 Tutorials Winter Term 2017/18 Prof. Andreas Butz Renate Häuslschmid Christina Schneegaß LMU München - LFE Medieninformatik Project 1: Phases & Dates Phase Presentation Phase 1: 7.11-28.11 05.12.2017

More information

Folsom Library & RensSearch Usability Test Plan

Folsom Library & RensSearch Usability Test Plan Folsom Library & RensSearch Usability Test Plan Eric Hansen & Billy Halibut 1 Table of Contents Document Overview!... 3 Methodology!... 3 Participants!... 3 Training!... 4 Procedure!... 4 Roles!... 4 Ethics!5

More information

Addition about Prototypes

Addition about Prototypes Vorlesung Mensch-Maschine-Interaktion Evaluation Ludwig-Maximilians-Universität München LFE Medieninformatik Heinrich Hußmann & Albrecht Schmidt WS2003/2004 http://www.medien.informatik.uni-muenchen.de/

More information

Product Development for Medical, Life Sciences, and Consumer Health

Product Development for Medical, Life Sciences, and Consumer Health Product Development for Medical, Life Sciences, and Consumer Health Fundamentals of Usability Testing for FDA Validation MassMEDIC April 8, 2010 Beth Loring Director of Research and Usability 2 Topics

More information

Usable Privacy and Security Introduction to HCI Methods January 19, 2006 Jason Hong Notes By: Kami Vaniea

Usable Privacy and Security Introduction to HCI Methods January 19, 2006 Jason Hong Notes By: Kami Vaniea Usable Privacy and Security Introduction to HCI Methods January 19, 2006 Jason Hong Notes By: Kami Vaniea Due Today: List of preferred lectures to present Due Next Week: IRB training completion certificate

More information

Firstname Lastname. Contents. User Experience Design Portfolio - Selected Samples. Updated February 2014

Firstname Lastname. Contents. User Experience Design Portfolio - Selected Samples. Updated February 2014 Firstname Lastname User Experience Design Portfolio - Selected Samples Updated February 2014 Contents About Me... 2 My Experience... 2 My Work Style... 3 Large Project Name... 4 Mobile App Name... 7 Contact

More information

Design Thinking: Design Review Workshop

Design Thinking: Design Review Workshop Design Thinking: Design Review Workshop Introductions Guliz Sicotte Director of Product Design Magento Commerce @gsicotte Eric Erway Sr. UX Manager Magento Commerce @ericerway Ann Hudspeth UX Manager Magento

More information

UX Research in the Product Lifecycle

UX Research in the Product Lifecycle UX Research in the Product Lifecycle I incorporate how users work into the product early, frequently and iteratively throughout the development lifecycle. This means selecting from a suite of methods and

More information

Methods: Deciding What To Design

Methods: Deciding What To Design Methods: Deciding What To Design Usability 3 Evaluation Licínio Roque lir@dei.uc.pt Founded 1297 AC Licínio Roque PhD in Information Systems Development Methodology Research in Interaction Design, Digital

More information

Design Heuristics and Evaluation

Design Heuristics and Evaluation Design Heuristics and Evaluation Rapid Evaluation Selected material from The UX Book, Hartson & Pyla Heuristic Evaluation Another method for finding usability problems in a UI design Validation during

More information

Questions? Project #1 due today Project #2 out today Grad project due in a week Remember: mid-term on 10/29

Questions? Project #1 due today Project #2 out today Grad project due in a week Remember: mid-term on 10/29 Questions? Project #1 due today Project #2 out today Grad project due in a week Remember: mid-term on 10/29 User centered design and prototyping Two approaches to design System centered design Design what

More information

IPM 15/16 T2.1 Prototyping

IPM 15/16 T2.1 Prototyping IPM 15/16 T2.1 Prototyping Miguel Tavares Coimbra Acknowledgements: Most of this course is based on the excellent course offered by Prof. Kellogg Booth at the British Columbia University, Vancouver, Canada.

More information

Choosing the Right Usability Tool (the right technique for the right problem)

Choosing the Right Usability Tool (the right technique for the right problem) Choosing the Right Usability Tool (the right technique for the right problem) User Friendly 2005 December 18, Shanghai Whitney Quesenbery Whitney Interactive Design www.wqusability.com Daniel Szuc Apogee

More information

Course Outline. Department of Computing Science Faculty of Science. COMP 3450 Human Computer Interaction Design (3,1,0) Fall 2015

Course Outline. Department of Computing Science Faculty of Science. COMP 3450 Human Computer Interaction Design (3,1,0) Fall 2015 Course Outline Department of Computing Science Faculty of Science COMP 3450 Human Computer Interaction Design (3,1,0) Fall 2015 Instructor: Office: Phone/Voice Mail: E-Mail: Course Description Students

More information

University of Maryland. fzzj, basili, Empirical studies (Desurvire, 1994) (Jeries, Miller, USABILITY INSPECTION

University of Maryland. fzzj, basili, Empirical studies (Desurvire, 1994) (Jeries, Miller, USABILITY INSPECTION AN EMPIRICAL STUDY OF PERSPECTIVE-BASED USABILITY INSPECTION Zhijun Zhang, Victor Basili, and Ben Shneiderman Department of Computer Science University of Maryland College Park, MD 20742, USA fzzj, basili,

More information

Prototyping. SWE 432, Fall Web Application Development

Prototyping. SWE 432, Fall Web Application Development Prototyping SWE 432, Fall 2018 Web Application Development Conceptual design Goal: match users mental model Tool: Metaphor - analogies from existing system Offers expectations about what system does &

More information

evision Review Project - Engagement Simon McLean, Head of Web & IT Support Information & Data Services.

evision Review Project - Engagement Simon McLean, Head of Web & IT Support Information & Data Services. evision Review Project - Engagement Monitoring Simon McLean, Head of Web & IT Support Information & Data Services. What is Usability? Why Bother? Types of usability testing Usability Testing in evision

More information

HCI and Design SPRING 2016

HCI and Design SPRING 2016 HCI and Design SPRING 2016 Topics for today Heuristic Evaluation 10 usability heuristics How to do heuristic evaluation Project planning and proposals Usability Testing Formal usability testing in a lab

More information

UX Research. research methods overview. UX Research research methods overview. KP Ludwig John

UX Research. research methods overview. UX Research research methods overview. KP Ludwig John Usability testing Usability (Benutzbarkeit) - what does it mean? Usability assesses how easy user interfaces are to use Usability refers to methods for improving ease-of-use during the design process Reference:

More information

UX, UI, Product Design

UX, UI, Product Design UX, UI, Product Design for mobile app development Empathize https://www.nngroup.com/articles/design-thinking/ Research Methods Qualitative: Interviews Observation Quantitative: Survey User Interviews Contextual

More information

cs465 principles of user interface design, implementation and evaluation

cs465 principles of user interface design, implementation and evaluation cs465 principles of user interface design, implementation and evaluation Karrie G. Karahalios 24. September 2008 1. Heuristic Evaluation 2. Cognitive Walkthrough 3. Discuss Homework 3 4. Discuss Projects

More information

SFU CMPT week 11

SFU CMPT week 11 SFU CMPT-363 2004-2 week 11 Manuel Zahariev E-mail: manuelz@cs.sfu.ca Based on course material from Arthur Kirkpatrick, Alissa Antle and Paul Hibbits July 21, 2004 1 Analytic Methods Advantages can be

More information

A short introduction to. designing user-friendly interfaces

A short introduction to. designing user-friendly interfaces A short introduction to designing user-friendly interfaces Usability is often ignored until it becomes a problem Introduction This booklet is about Usability and User Experience design. It is aimed at

More information

Improving the Usability of the University of Rochester River Campus Libraries Web Sites

Improving the Usability of the University of Rochester River Campus Libraries Web Sites River Campus Libraries Improving the Usability of the University of Rochester River Campus Libraries Web Sites Susan K. Cardinal April 6, 2008 New Orleans ACS Meeting Outline What is Usability? Why is

More information

Introducing Evaluation

Introducing Evaluation Chapter 12 Introducing Evaluation 1 The aims Explain the key concepts used in evaluation. Introduce different evaluation methods. Show how different methods are used for different purposes at different

More information

SYSTEM REQUIREMENTS SPECIFICATIONS

SYSTEM REQUIREMENTS SPECIFICATIONS 2013 Leş Koding Baran Küçükgüzel Batuhan Taşdöven Ali Barış Uzuner Bekir Öztürk SYSTEM REQUIREMENTS SPECIFICATIONS This document is prepared by Leş Koding s members; the document is about system requirements

More information

15/16 CSY2041 Quality and User-Centred Systems

15/16 CSY2041 Quality and User-Centred Systems 15/16 CSY2041 Quality and User-Centred Systems INTERACTION DESIGN 1 Heuristic evaluation and walkthroughs 2 1 Aims: Describe the key concepts associated with inspection methods. Explain how to do heuristic

More information

8.1 Goals of Evaluation 8.2 Analytic Evaluation 8.3 Empirical Evaluation 8.4 Comparing and Choosing Evaluation Techniques

8.1 Goals of Evaluation 8.2 Analytic Evaluation 8.3 Empirical Evaluation 8.4 Comparing and Choosing Evaluation Techniques 8 Evaluation 8.1 Goals of Evaluation 8.2 Analytic Evaluation 8.3 Empirical Evaluation 8.4 Comparing and Choosing Evaluation Techniques Ludwig-Maximilians-Universität München Prof. Hußmann Mensch-Maschine-Interaktion

More information

Interaction Design. Chapter 7 (June 22nd, 2011, 9am-12pm): Evaluation and Testing

Interaction Design. Chapter 7 (June 22nd, 2011, 9am-12pm): Evaluation and Testing Interaction Design Chapter 7 (June 22nd, 2011, 9am-12pm): Evaluation and Testing 1 Evaluation and Testing Intro to evaluation and testing analytical methods empirical methods choosing a method intuitive

More information

Usability Study of the Taverna Scientific Workflow Workbench

Usability Study of the Taverna Scientific Workflow Workbench UNIVERSITY OF MANCHESTER SCHOOL OF COMPUTER SCIENCE COMP 60990: Research Methods and Professional Skills Usability Study of the Taverna Scientific Workflow Workbench Progress Report Student Name: Kymbat

More information

UX Research. test scenarios. UX Research test scenarios. KP Ludwig John

UX Research. test scenarios. UX Research test scenarios. KP Ludwig John UX Research Usability Test Preconditions Already existing Personas Definition of target groups Context of use where, when, how long, equipment! Test goals What do we want to learn? Usability-Test Predefinitions

More information

Introducing Evaluation

Introducing Evaluation Chapter 12 Introducing Evaluation 1 The aims Explain the key concepts used in evaluation. Introduce different evaluation methods. Show how different methods are used for different purposes at different

More information

8.1 Goals of Evaluation 8.2 Analytic Evaluation 8.3 Empirical Evaluation 8.4 Comparing and Choosing Evaluation Techniques

8.1 Goals of Evaluation 8.2 Analytic Evaluation 8.3 Empirical Evaluation 8.4 Comparing and Choosing Evaluation Techniques 8 Evaluation 8.1 Goals of Evaluation 8.2 Analytic Evaluation 8.3 Empirical Evaluation 8.4 Comparing and Choosing Evaluation Techniques Ludwig-Maximilians-Universität München Prof. Hußmann Mensch-Maschine-Interaktion

More information

Stream Features Application Usability Test Report

Stream Features Application Usability Test Report Stream Features Application Usability Test Report Erin Norton and Katelyn Waara HU 4628: Usability and Instruction Writing Michigan Technological University April 24, 2013 Table of Contents Executive Summary

More information

dt+ux Design Thinking for User Experience Design, Prototyping & Evaluation Autumn 2016 Prof. James A. Landay Stanford University

dt+ux Design Thinking for User Experience Design, Prototyping & Evaluation Autumn 2016 Prof. James A. Landay Stanford University DESIGN THINKING FOR USER EXPERIENCE DESIGN + PROTOTYPING + EVALUATION Hall of Fame or Shame? Early Stage Prototyping Computer Science Department October 20, 2016 Paper ipad App By 53 2 Hall of Fame or

More information

Usability Tests and Heuristic Reviews Planning and Estimation Worksheets

Usability Tests and Heuristic Reviews Planning and Estimation Worksheets For STC DC Usability SIG Planning and Estimation Worksheets Scott McDaniel Senior Interaction Designer 26 February, 2003 Eval_Design_Tool_Handout.doc Cognetics Corporation E-mail: info@cognetics.com! Web:

More information

Analytical evaluation

Analytical evaluation Chapter 15 Analytical evaluation 1 Aims: Describe the key concepts associated with inspection methods. Explain how to do heuristic evaluation and walkthroughs. Explain the role of analytics in evaluation.

More information

CH 13 APPLICATION ANALYSIS

CH 13 APPLICATION ANALYSIS CH 13 APPLICATION ANALYSIS APPLICATION INTERACTION MODEL Steps: Determine system boundary Find actors Find use case Find initial & final events Prepare a normal scenario Add exception scenario Prepare

More information

A Step-Wise Evaluation of Three Commonly used Statistical Packages in Institutional Research

A Step-Wise Evaluation of Three Commonly used Statistical Packages in Institutional Research A Step-Wise Evaluation of Three Commonly used Statistical Packages in Institutional Research Introduction Over the course of summer 2014, a conversation regarding statistical software packages emerged

More information

PRESIDENTIAL ELECTIONS GAME

PRESIDENTIAL ELECTIONS GAME Informatics 231 October 18, 2011 PRESIDENTIAL ELECTIONS GAME Team Members: Mingming Fan Adithya Gajulapally Michael Gould William Lawrence Benjamin McDowd Udita Sharma Cathy Tran Xin Wang Presentation

More information

UI Evaluation: Cognitive Walkthrough. CS-E5220 User Interface Construction

UI Evaluation: Cognitive Walkthrough. CS-E5220 User Interface Construction UI Evaluation: Cognitive Walkthrough CS-E5220 User Interface Construction Usability Testing With users Usability test Without users Heuristic evaluation Cognitive walkthrough Nielsen s Ten Heuristic Rules

More information

Capgemini employ 30,000+ (2010) people in India with offices in Mumbai, Bangalore, Kolkata, Pune, Hyderabad, Chennai and Delhi/NCR.

Capgemini employ 30,000+ (2010) people in India with offices in Mumbai, Bangalore, Kolkata, Pune, Hyderabad, Chennai and Delhi/NCR. Project: Interact Release 2.0 Client: Vonage (NYSE:VG) Duration: February 2008 to June 2009 Employer: Capgemini India Pvt. Ltd. Website: www.capgemini.com About Capgemini: Capgemini is a major French company,

More information

Supporting Usability Studies in Uganda

Supporting Usability Studies in Uganda Supporting Usability Studies in Uganda A case study contributing to the planning phase of usability facilities Att främja användbarhetsstudier i Uganda Bidrag till planeringen av ett resurscenter för användbarhetsstudier

More information