Usability Testing. November 14, 2016

Size: px
Start display at page:

Download "Usability Testing. November 14, 2016"

Transcription

1 Usability Testing November 14, 2016

2 Announcements Wednesday: HCI in industry VW: December 1 (no matter what) 2

3 Questions? 3

4 Today Usability testing Data collection and analysis 4

5 Usability test A usability test is a formal method for evaluating whether a design is learnable, efficient, memorable, can reduce errors, meets users expectations, etc. users are not being evaluated the design is being evaluated 5

6 Usability test Rough Outline Bring in real users Have them complete tasks with your design, while you watch (ideally with your entire team) Measure and record things task completion, task time, error rates satisfaction, problem points, etc. use a think-aloud protocol, so you can hear what they are thinking 6

7 Usability test Rough outline Use the data to identify problems (major ones minor ones) provide design suggestions to design/engineering team iterate on the design, repeat 7

8 Important Considerations Usually takes place in a usability lab or other controlled space Major emphasis is on selecting representative users developing representative tasks 5-10 users typically selected Tasks usually last no more than 30 minutes The test conditions should be the same for every participant Informed consent form explains ethical issues 8

9 Case Study: Testing MEDLINEplus Five tasks were developed Wanted to check categorization and navigation support Task 1: Find information about whether a dark bump on your shoulder might be skin cancer Task 2: Find information about whether its safe to use Prozac during pregnancy Task 3: Find information about whether there is a vaccine for hepatitis C Task 4: Find recommendations about the treatment of breast cancer Task 5: Find information about the dangers associated with drinking alcohol during pregnancy 9

10 Creating tasks A task is designed to probe a problem Tasks should be straightforward and require the user to find certain items, or do certain operations They can be more complex such as solving particular problems Sample tasks for a weather network web site: What is the forecasted weather for Winnipeg? What is air quality in Los Angeles today? What is the level of humidity in Winnipeg? What is the forecast for Ottawa for the upcoming weekend? 10

11 Case Study: Testing MEDLINEplus Selection of participants 9 participants from health care practices in DC area 7 Female, 2 Male 11

12 How many participants is enough for usability testing? The number is largely a practical issue Depends on: schedule for testing availability of participants cost of running tests Typical 5-10 participants Some experts argue that testing should continue until no new insights are gained 12

13 Activity You are developing a user test for a new CS web page. Identify 6 tasks for the test: Task 1: Identify the instructor for Comp 3020 Task 2: Find the address of the Comp 3020 prof Task 3: Find the admission requirements for the M.Sc. Program Task 4: Find out the first day of classes next term Task 5: Locate the requirements for being a Co-op student Task 6: Identify whether the graduate Graphics course is a fundamentals course 13

14 Activity You are developing a user test for a new CS web page. Who are your participants: Students (CS, or interested) Faculty? 14

15 Data Analysis Qualitative data Collected from interviews, some types of questionnaires, observation notes Interpreted & used for telling a story about what was observed (difficult!) Quantitative data Collected from interaction & video logs Presented as values, tables, charts, graphs and treated statistically (safe!) Fall 2016 COMP

16 Making Sense of Your Data Affinity diagrams 16

17 Making Sense of Your Data discussion with others who watched with you 17

18 Elements of Usability Testing Identify practical issues select typical users make sure you have appropriate representation i.e. e-recipe primarily for families but 90% sample are single people Identify practical issues prepare testing conditions Lab preferably Identify practical issues plan to run tests Have scripts in place Test equipment Have recording material prepared Deal with ethical issues Consent form 18

19 Elements of Usability Testing Evaluate, analyze, and present data Report on times to complete task, number of errors Provide simple statistical measures: mean, median, std dev. Describe interaction patterns e.g., four ways that people may use the interface 19

20 Usability Testing: Presenting the Results Rank issues in terms of severity Not only a list of problems and issues! Provide small suggestions on how to address Provide evidence (video, quotes, examples) of people encountering issues ITERATE ON THE DESIGN!!?!?!? 20

21 More on data collection

22 Questionnaires Earlier in the term we discussed questionnaire design for gathering requirements Most user satisfaction questionnaires consist primarily of closed questions Participants encouraged to leave their comments in space provided on the page, or in the margins More on designing closed questions 22

23 Question and response format Likert scales Likert scales are used for measuring opinions, attitudes, beliefs E.g., Evaluating color on a web site can have the following forms The use of color is excellent: (where 1 represents strongly disagree and 5 represents strongly agree) The use of color is excellent: strongly disagree ok agree strongly disagree agree 23

24 Question and response format Likert scales Steps for designing Likert scales: Gather a pool of short statements about the features of the product that are to be evaluated Divide the items into groups containing the same amount of positive and negative statements Create logical/conceptual groups Decide on the scale (5-point/3-point/9-point) Select items for the final questionnaire and reword as necessary 24

25 Odd/Even Likert scales response options If possible to have 'neutral' response, then use odd number of options (central = neutral place) If judging something is good/bad, male/female then look at two response options Even numbers 'force' respondents in one way or another end up with random responses between middle items How wide (1 to 3, 1 to 5, or even 1 to 12?) How will the majority distinguish between the different levels If majority fairly uninformed about the topic, then use small number If dealing with experts, then you can use a much larger set 25

26 Anchors Anchors are the verbal comments above the numbers ('strongly agree', etc.) How many to include? In factual statements (or smaller scales) considered good to use anchors above all options will give you accurate results News: Daily Weekly Monthly Never Larger scales Helpful to indicate the central (neutral) point if meaningful, having numerous anchors may not be so important The content in the website is clear (1-10): 1 (strongly disagree) 5 (neutral) 10 (strongly agree) 26

27 Guidelines for questionnaire design See notes on from earlier in the term (recall) Conciseness: questions should be clear and specific e.g. should the system include a users manual? (YES/NO) Closed questions: when possible ask closed questions and offer a range of answers e.g. How often do you print checks? (1: very often 5: never) Alternate option: Consider including a no-opinion option for questions that seek opinions e.g. the payroll module is essential ( N/A) Order: think about the ordering of questions. General questions should precede specific ones e.g. a question about a specific feature say in a payroll module should come after asking whether the payroll module is essential 27

28 Guidelines for questionnaire design Break up multiple questions: Avoid complex multiple questions e.g. is the payroll system and attendance manager efficient? Proper scales: when scales are used make sure the range is appropriate and do not overlap e.g , 31 40,. Language: avoid jargon e.g. should the display be based on bezier curves? Instructions: provide clear instructions on how to complete the questionnaire e.g. please rate the performance of the following items Compactness: a balance must be struck between white space and the need to keep the questionnaire as compact as possible 28

29 factual Designing questionnaires Participant #: Please circle the most appropriate selection Age Range: Gender: Male Female Different typeface used for instructions on the questionnaire Internet/Web Experience News Daily Weekly Monthly Never Research, Information gathering Daily Weekly Monthly Never Top stories usage Daily Weekly Monthly Never Please rate (i.e. check the box) agreement or disagreement with the following statements Question The navigation on the links is clear The website contains information that is useful to me Strongly Agree Agree Neutral Disagree Strongly Disagree 29

30 Analyzing questionnaire data Helps to think of analysis of questionnaire even before its design Present results clearly - tables can be used for proper structure Simple statistics can say a lot, e.g., mean, median, mode, standard deviation Percentages are useful but give population size Bar graphs show categorical data well More advanced statistics can be used if needed 30

31 Observing People The majority of evaluations with users involve some form of observation Simple form of observation: user is given a set of tasks, and the evaluator simply watches the user So...? what do you watch? what do you do? what do you record? 31

32 Think-Aloud Gives insight into what the user is thinking Awkward/uncomfortable for subject May alter the way people perform their task Hard to talk when they are concentrating User s personality may not align with thinking aloud Fall 2016 COMP

33 Participatory Observation (co-discovery learning) Main idea: remove the awkwardness of think-aloud Two people sit down to complete tasks Only one person is allowed to touch the interface Variation: use a semi-knowledgeable coach and a novice (only the novice gets to touch the design) Creates a natural social situation Novice subject asking questions Semi-knowledgeable coach giving little feedback but not much The activity provides insights into thinking process of both subjects Fall 2016 COMP

34 Indirect tracking of activities Direct observation can be obtrusive or impossible Alternatives: Interaction logging: Recording key presses, mouse buttons, interface changes Difficulty: need to correlate specific action with the appropriate tasks and meaning (hard) Diaries / experience sampling What users did, when they did it, and what they thought about their interactions Provide templates for users to fill in Fall 2016 COMP

35 Observations: Obtrusive vs. Unobtrusive How people behave and how they explain are different, e.g., as with LOOK vs ASK Observation techniques can range from being unobtrusive to obtrusive Unobtrusive: Observe test users but refrain from interacting with them; want to avoid influencing or encouraging questions Obtrusive: Fall 2016 interact with users by asking questions, explain design decisions, engage user in a discussion COMP

Usability Testing. November 9, 2016

Usability Testing. November 9, 2016 Usability Testing November 9, 2016 Announcements Milestone III Average: 77/90 (86%) Most marks lost for not following instructions (e.g. missing sections) 2 Questions? 3 Today More analytical evaluation

More information

Overview of Today s Lecture. Analytical Evaluation / Usability Testing. ex: find a book at Amazon.ca via search

Overview of Today s Lecture. Analytical Evaluation / Usability Testing. ex: find a book at Amazon.ca via search Overview of Today s Lecture Analytical Evaluation / Usability Testing November 17, 2017 Analytical Evaluation Inspections Recapping cognitive walkthrough Heuristic evaluation Performance modelling 1 2

More information

Usability Report for Online Writing Portfolio

Usability Report for Online Writing Portfolio Usability Report for Online Writing Portfolio October 30, 2012 WR 305.01 Written By: Kelsey Carper I pledge on my honor that I have not given or received any unauthorized assistance in the completion of

More information

Web Evaluation Report Guidelines

Web Evaluation Report Guidelines Web Evaluation Report Guidelines Graduate Students: You are required to conduct a usability test for your final project in this course. Please review the project description and the evaluation rubric on

More information

Usability Testing! Hall of Fame! Usability Testing!

Usability Testing! Hall of Fame! Usability Testing! HCI+D: USER INTERFACE DESIGN + PROTOTYPING + EVALUATION Hall of Fame or Shame? Usability Testing Computer Science Department Apple One Button Mouse Autumn 2014 November 4, 2014 Hall of Shame Hall of Fame

More information

How to Add Usability Testing to Your Evaluation Toolbox

How to Add Usability Testing to Your Evaluation Toolbox How to Add Usability Testing to Your Evaluation Toolbox Christine Andrews Paulsen, Ph.D. Concord Evaluation Group cpaulsen@ Presented at AEA, 11/5/11, Anaheim, CA 1 Goals Develop an understanding of usability

More information

Evaluation studies: From controlled to natural settings

Evaluation studies: From controlled to natural settings Chapter 14 Evaluation studies: From controlled to natural settings 1 The aims: Explain how to do usability testing Outline the basics of experimental design Describe how to do field studies 2 1. Usability

More information

Foundation Level Syllabus Usability Tester Sample Exam

Foundation Level Syllabus Usability Tester Sample Exam Foundation Level Syllabus Usability Tester Sample Exam Version 2017 Provided by German Testing Board Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged.

More information

Folsom Library & RensSearch Usability Test Plan

Folsom Library & RensSearch Usability Test Plan Folsom Library & RensSearch Usability Test Plan Eric Hansen & Billy Halibut 1 Table of Contents Document Overview!... 3 Methodology!... 3 Participants!... 3 Training!... 4 Procedure!... 4 Roles!... 4 Ethics!5

More information

Lafayette College Technology Clinic An Analysis of Communications at Lafayette College

Lafayette College Technology Clinic An Analysis of Communications at Lafayette College Lafayette College Technology Clinic An Analysis of Communications at Lafayette College -Midyear Report Spring 2018- 2 3 4 1. Meet The Team. 5 2. Charge........ 7 3. Clients...... 9 4. Project Significance..

More information

03 Usability Engineering

03 Usability Engineering CS -213 Human Computer Interaction Spring 2016 03 Usability Engineering Imran Ihsan Assistant Professor (CS) Air University, Islamabad www.imranihsan.com www.opuseven.com opuseven iimranihsan imranihsan

More information

Analytical &! Empirical Evaluation

Analytical &! Empirical Evaluation Analytical &! Empirical Evaluation Informatics 132 5/22/2012 TODAY Evaluation Due: A3 Paper Prototyping UPCOMING Friday: Group Project Time Monday: Memorial Day, No Class Wednesday: HCI in the Real World

More information

2005 University of California Undergraduate Experience Survey

2005 University of California Undergraduate Experience Survey 2005 University of California Undergraduate Experience Survey This year's survey has three parts: I. Time use and overall satisfaction II. Your background III. Rotating modules PART I: TIME USE and OVERALL

More information

h(p://ihm.tumblr.com/post/ /word- cloud- for- hci- human- computer- interacbon CS5340 Human-Computer Interaction ! January 31, 2013!

h(p://ihm.tumblr.com/post/ /word- cloud- for- hci- human- computer- interacbon CS5340 Human-Computer Interaction ! January 31, 2013! h(p://ihm.tumblr.com/post/105778492/word- cloud- for- hci- human- computer- interacbon CS5340 Human-Computer Interaction January 31, 2013 Today s Class Administrivia User-centered Design Establishing Requirements

More information

Usability and Evaluation of BCKOnline PORTAL Prototype Early breast cancer Recurrent Advanced

Usability and Evaluation of BCKOnline PORTAL Prototype Early breast cancer Recurrent Advanced Usability and Evaluation of BCKOnline PORTAL Prototype Web Site URL: http://130.194.38.233:3400/index.html Participant No: Demographics 1. Please indicate your gender - Male Female 2. Please indicate your

More information

Introducing Evaluation

Introducing Evaluation Chapter 12 Introducing Evaluation 1 The aims Explain the key concepts used in evaluation. Introduce different evaluation methods. Show how different methods are used for different purposes at different

More information

Course Outline. Department of Computing Science Faculty of Science. COMP 3450 Human Computer Interaction Design (3,1,0) Fall 2015

Course Outline. Department of Computing Science Faculty of Science. COMP 3450 Human Computer Interaction Design (3,1,0) Fall 2015 Course Outline Department of Computing Science Faculty of Science COMP 3450 Human Computer Interaction Design (3,1,0) Fall 2015 Instructor: Office: Phone/Voice Mail: E-Mail: Course Description Students

More information

User Testing & Automated Evaluation. Product Hall of Shame! User Testing & Automated Evaluation. Visual Design Review. Outline. Visual design review

User Testing & Automated Evaluation. Product Hall of Shame! User Testing & Automated Evaluation. Visual Design Review. Outline. Visual design review landay 1 USER INTERFACE DESIGN + PROTOTYPING + EVALUATION Product Hall of Fame or Shame? User Testing & Automated Evaluation Prof. James A. Landay University of Washington Apple One Button Mouse Autumn

More information

EVALUATION OF PROTOTYPES USABILITY TESTING

EVALUATION OF PROTOTYPES USABILITY TESTING EVALUATION OF PROTOTYPES USABILITY TESTING CPSC 544 FUNDAMENTALS IN DESIGNING INTERACTIVE COMPUTATIONAL TECHNOLOGY FOR PEOPLE (HUMAN COMPUTER INTERACTION) WEEK 9 CLASS 17 Joanna McGrenere and Leila Aflatoony

More information

A Comparative Usability Test. Orbitz.com vs. Hipmunk.com

A Comparative Usability Test. Orbitz.com vs. Hipmunk.com A Comparative Usability Test Orbitz.com vs. Hipmunk.com 1 Table of Contents Introduction... 3 Participants... 5 Procedure... 6 Results... 8 Implications... 12 Nuisance variables... 14 Future studies...

More information

Learnability of software

Learnability of software Learnability of software Aim: Evaluating learnability Writing on-line help Basis for Assignment 2 1 Qualities of IT applications Learnability From novice to expert user Time from first encounter to use

More information

Website Usability Study: The American Red Cross. Sarah Barth, Veronica McCoo, Katelyn McLimans, Alyssa Williams. University of Alabama

Website Usability Study: The American Red Cross. Sarah Barth, Veronica McCoo, Katelyn McLimans, Alyssa Williams. University of Alabama Website Usability Study: The American Red Cross Sarah Barth, Veronica McCoo, Katelyn McLimans, Alyssa Williams University of Alabama 1. The American Red Cross is part of the world's largest volunteer network

More information

Constructing a Qualtrics survey Before you = start

Constructing a Qualtrics survey Before you = start Data Science Tutorials Constructing a Qualtrics survey Before you = start César Zamudio Assistant Professor of Marketing & Entrepreneurship Kent State University Before you start Qualtrics is an extremely

More information

Easy Knowledge Engineering and Usability Evaluation of Longan Knowledge-Based System

Easy Knowledge Engineering and Usability Evaluation of Longan Knowledge-Based System Easy Knowledge Engineering and Usability Evaluation of Longan Knowledge-Based System ChureeTechawut 1,*, Rattasit Sukhahuta 1, Pawin Manochai 2, Jariya Visithpanich 3, Yuttana Khaosumain 4 1 Computer Science

More information

Usability Testing Essentials

Usability Testing Essentials Usability Testing Essentials Ready, Set...Test! Carol M. Barnum ELSEVIER Amsterdam Boston Heidelberg London New York Oxford Paris San Diego San Francisco Singapore Sydney Tokyo Morgan Kaufmann is an imprint

More information

The SAPS Johannesburg Area Police Transformation Survey Results

The SAPS Johannesburg Area Police Transformation Survey Results The SAPS Johannesburg Area Police Transformation Survey Results by Gareth Newham Research report written for the Centre for the Study of Violence and Reconciliation, January 2005. Gareth Newham is a former

More information

SOST 201 September 20, Stem-and-leaf display 2. Miscellaneous issues class limits, rounding, and interval width.

SOST 201 September 20, Stem-and-leaf display 2. Miscellaneous issues class limits, rounding, and interval width. 1 Social Studies 201 September 20, 2006 Presenting data and stem-and-leaf display See text, chapter 4, pp. 87-160. Introduction Statistical analysis primarily deals with issues where it is possible to

More information

DEPARTMENT OF HEALTH AND HUMAN SCIENCES HS900 RESEARCH METHODS

DEPARTMENT OF HEALTH AND HUMAN SCIENCES HS900 RESEARCH METHODS DEPARTMENT OF HEALTH AND HUMAN SCIENCES HS900 RESEARCH METHODS Using SPSS Topics addressed today: 1. Accessing data from CMR 2. Starting SPSS 3. Getting familiar with SPSS 4. Entering data 5. Saving data

More information

IBM MANY EYES USABILITY STUDY

IBM MANY EYES USABILITY STUDY IBM MANY EYES USABILITY STUDY Team Six: Rod Myers Dane Petersen Jay Steele Joe Wilkerson December 2, 2008 I543 Interaction Design Methods Fall 2008 Dr. Shaowen Bardzell EXECUTIVE SUMMARY We asked three

More information

This study is brought to you courtesy of.

This study is brought to you courtesy of. This study is brought to you courtesy of www.google.com/think/insights Health Consumer Study The Role of Digital in Patients Healthcare Actions & Decisions Google/OTX U.S., December 2009 Background Demonstrate

More information

Product Development for Medical, Life Sciences, and Consumer Health

Product Development for Medical, Life Sciences, and Consumer Health Product Development for Medical, Life Sciences, and Consumer Health Fundamentals of Usability Testing for FDA Validation MassMEDIC April 8, 2010 Beth Loring Director of Research and Usability 2 Topics

More information

APPENDIX G: Biennial Exhibition Device Survey Questions

APPENDIX G: Biennial Exhibition Device Survey Questions APPENDIX G: Biennial Exhibition Device Survey Questions STANDARD DEVICE QUESTIONS Did you use Whitney s Audio Guide to access the Museum s audio guide tour during today s visit? If so, please take a few

More information

CSE 403 Lecture 17. Usability Testing. Reading: Don't Make Me Think! A Common Sense Approach to Web Usability by S. Krug, Ch. 9-11

CSE 403 Lecture 17. Usability Testing. Reading: Don't Make Me Think! A Common Sense Approach to Web Usability by S. Krug, Ch. 9-11 CSE 403 Lecture 17 Usability Testing Reading: Don't Make Me Think! A Common Sense Approach to Web Usability by S. Krug, Ch. 9-11 Handbook of Usability Testing, 2ed by J. Rubin / D. Chisnell, Ch. 2-5 slides

More information

Frequency, proportional, and percentage distributions.

Frequency, proportional, and percentage distributions. 1 Social Studies 201 September 13-15, 2004 Presenting data and stem-and-leaf display See text, chapter 4, pp. 87-160. Introduction Statistical analysis primarily deals with issues where it is possible

More information

Intro to Analytics Learning Web Analytics

Intro to Analytics Learning Web Analytics Intro to Analytics 100 - Learning Web Analytics When you hear the word analytics, what does this mean to you? Analytics is the discovery, interpretation and communication of meaningful patterns in data.

More information

EVALUATION OF PROTOTYPES USABILITY TESTING

EVALUATION OF PROTOTYPES USABILITY TESTING EVALUATION OF PROTOTYPES USABILITY TESTING CPSC 544 FUNDAMENTALS IN DESIGNING INTERACTIVE COMPUTATION TECHNOLOGY FOR PEOPLE (HUMAN COMPUTER INTERACTION) WEEK 9 CLASS 17 Joanna McGrenere and Leila Aflatoony

More information

Methods: Deciding What To Design

Methods: Deciding What To Design Methods: Deciding What To Design Usability 3 Evaluation Licínio Roque lir@dei.uc.pt Founded 1297 AC Licínio Roque PhD in Information Systems Development Methodology Research in Interaction Design, Digital

More information

CICT ACCREDITED INSTRUCTOR TRAINER PROGRAM

CICT ACCREDITED INSTRUCTOR TRAINER PROGRAM ! CICT ACCREDITED INSTRUCTOR TRAINER PROGRAM Canadian Industrial & Construction Training Unit 9, 266 MacKay Crescent Fort McMurray, Alberta T9H 5C6 P: 780.790.1230 F: 780.791.9330 Email: cict@telus.net

More information

Usability Testing Methodology for the 2017 Economic Census Web Instrument

Usability Testing Methodology for the 2017 Economic Census Web Instrument Usability Testing Methodology for the 2017 Economic Census Web Instrument Rebecca Keegan Economic Statistical Methods Division March 8th, 2017 FCSM Disclaimer: Any views expressed are those of the author

More information

CS 315 Intro to Human Computer Interaction (HCI)

CS 315 Intro to Human Computer Interaction (HCI) 1 CS 315 Intro to Human Computer Interaction (HCI) 2 3 Acceptance Tests Set goals for performance Objective Measurable Examples Mean time between failures (e.g. MOSI) Test cases Response time requirements

More information

Interfaces Homme-Machine

Interfaces Homme-Machine Interfaces Homme-Machine APP3IR Axel Carlier 29/09/2017 1 2 Some vocabulary GUI, CHI,, UI, etc. 3 Some vocabulary Computer-Human Interaction Interaction HommeMachine User Interface Interface Utilisateur

More information

Mn/DOT Market Research Reporting General Guidelines for Qualitative and Quantitative Market Research Reports Revised: August 2, 2011

Mn/DOT Market Research Reporting General Guidelines for Qualitative and Quantitative Market Research Reports Revised: August 2, 2011 Mn/DOT Market Research Reporting General Guidelines for Qualitative and Quantitative Market Research Reports Revised: August 2, 2011 The following guidelines have been developed to help our vendors understand

More information

Survey Questions and Methodology

Survey Questions and Methodology Survey Questions and Methodology Winter Tracking Survey 2012 Final Topline 02/22/2012 Data for January 20 February 19, 2012 Princeton Survey Research Associates International for the Pew Research Center

More information

Comp 15 - Usability and Human Factors. Overview. Usability. Unit 5a - Usability Evaluation Methods

Comp 15 - Usability and Human Factors. Overview. Usability. Unit 5a - Usability Evaluation Methods Comp 15 - Usability and Human Factors Unit 5a - Usability Evaluation Methods This material was developed by Columbia University, funded by the Department of Health and Human Services, Office of the National

More information

Usable Privacy and Security Introduction to HCI Methods January 19, 2006 Jason Hong Notes By: Kami Vaniea

Usable Privacy and Security Introduction to HCI Methods January 19, 2006 Jason Hong Notes By: Kami Vaniea Usable Privacy and Security Introduction to HCI Methods January 19, 2006 Jason Hong Notes By: Kami Vaniea Due Today: List of preferred lectures to present Due Next Week: IRB training completion certificate

More information

Concepts of Usability. Usability Testing. Usability concept ISO/IS What is context? What is context? What is usability? How to measure it?

Concepts of Usability. Usability Testing. Usability concept ISO/IS What is context? What is context? What is usability? How to measure it? Concepts of Usability Usability Testing What is usability? How to measure it? Fang Chen ISO/IS 9241 Usability concept The extent to which a product can be used by specified users to achieve specified goals

More information

Survey Questions and Methodology

Survey Questions and Methodology Survey Questions and Methodology Spring Tracking Survey 2012 Data for March 15 April 3, 2012 Princeton Survey Research Associates International for the Pew Research Center s Internet & American Life Project

More information

Step-by-Step Instructions for Pre-Work

Step-by-Step Instructions for Pre-Work Step-by-Step Instructions for Pre-Work We recommend that you schedule 20-25 hours to complete your pre-work assignment. Please track your hours. We will ask you to record them on your pre-work evaluation

More information

Programmiersprache C++ Winter 2005 Operator overloading (48)

Programmiersprache C++ Winter 2005 Operator overloading (48) Evaluation Methods Different methods When the evaluation is done How the evaluation is done By whom the evaluation is done Programmiersprache C++ Winter 2005 Operator overloading (48) When the evaluation

More information

Step by Step Instructions for Pre Work

Step by Step Instructions for Pre Work Step by Step Instructions for Pre Work We recommend that you schedule 20 25 hours to complete your pre work assignment. Please track your hours. We will ask you to record them on your pre work evaluation

More information

Standard Glossary of Terms used in Software Testing. Version 3.2. Foundation Extension - Usability Terms

Standard Glossary of Terms used in Software Testing. Version 3.2. Foundation Extension - Usability Terms Standard Glossary of Terms used in Software Testing Version 3.2 Foundation Extension - Usability Terms International Software Testing Qualifications Board Copyright Notice This document may be copied in

More information

(Milano Lugano Evaluation Method) A systematic approach to usability evaluation. Part I LAB HCI prof. Garzotto - HOC-POLITECNICO DI MILANO a.a.

(Milano Lugano Evaluation Method) A systematic approach to usability evaluation. Part I LAB HCI prof. Garzotto - HOC-POLITECNICO DI MILANO a.a. (Milano Lugano Evaluation Method) A systematic approach to usability evaluation Part I LAB HCI prof. Garzotto - HOC-POLITECNICO DI MILANO a.a. 04-05 1 ABOUT USABILITY 1. WHAT IS USABILITY? Ë Usability

More information

Qualitative Data Analysis: Coding. Qualitative Methods: Interviews Chickasaw Nation September 12, 2017

Qualitative Data Analysis: Coding. Qualitative Methods: Interviews Chickasaw Nation September 12, 2017 Qualitative Data Analysis: Coding Qualitative Methods: Interviews Chickasaw Nation September 12, 2017 Session Overview Memos to Codes Developing Codebook Coding Data Inter coder Agreement Thick Descriptions

More information

Usability Evaluation of Web Office Applications in Collaborative Student Writing

Usability Evaluation of Web Office Applications in Collaborative Student Writing Master Thesis Computer Science Thesis no: MSC-2009:21 May 2009 Usability Evaluation of Web Office Applications in Collaborative Student Writing Muhammad Afsar Khan, Sher Hassan Department of School of

More information

User Testing Study: Collaborizm.com. Jessica Espejel, Megan Koontz, Lauren Restivo. LIS 644: Usability Theory and Practice

User Testing Study: Collaborizm.com. Jessica Espejel, Megan Koontz, Lauren Restivo. LIS 644: Usability Theory and Practice User Testing Study: Collaborizm.com Jessica Espejel, Megan Koontz, Lauren Restivo LIS 644: Usability Theory and Practice TABLE OF CONTENTS EXECUTIVE SUMMARY... 3 INTRODUCTION... 4 METHODOLOGY... 5 FINDINGS

More information

Based on the slides available at book.com. Graphical Design

Based on the slides available at   book.com. Graphical Design Graphical Design Graphic Design & User Interfaces Information oriented, systematic graphic design is the use of typography, symbols, color and other static and dynamic graphics to convey facts, concepts

More information

OUTLINE. Advanced Technical Communication & Writing Skills. What is technical communication? Technical communication skills

OUTLINE. Advanced Technical Communication & Writing Skills. What is technical communication? Technical communication skills Advanced Technical Communication & Writing Skills What is technical communication? Technical communication skills Principles of technical writing Technical writing is interpreting Planning is crucial Technical

More information

Summarising Data. Mark Lunt 09/10/2018. Arthritis Research UK Epidemiology Unit University of Manchester

Summarising Data. Mark Lunt 09/10/2018. Arthritis Research UK Epidemiology Unit University of Manchester Summarising Data Mark Lunt Arthritis Research UK Epidemiology Unit University of Manchester 09/10/2018 Summarising Data Today we will consider Different types of data Appropriate ways to summarise these

More information

Audit Teaching in GP 1

Audit Teaching in GP 1 Audit Teaching in GP 1 S Walkin 28 September, 2016 Last time on Audit teaching (Getting Started) What is Audit? How does it differ from research? Stages of conducting an audit 1. Select topic 2. Identify

More information

SUMMARY REPORT UNIVERSITY OF MINNESOTA GRADUATES. May. 29, th Ave. S.E. Room 103 Minneapolis, MN 55414

SUMMARY REPORT UNIVERSITY OF MINNESOTA GRADUATES. May. 29, th Ave. S.E. Room 103 Minneapolis, MN 55414 SUMMARY REPORT GRADUATES May. 29, 2009 UNIVERSITY OF MINNESOTA Phone: 612.626.0006 Fax: 612.624.1336 879 29th Ave. S.E. Room 103 Minneapolis, MN 55414 http://oms.umn.edu Info Section Item 1: My education

More information

User Assessment for Negotiating the Quality of Service for Streaming Media Applications

User Assessment for Negotiating the Quality of Service for Streaming Media Applications User Assessment for Negotiating the Quality of Service for Streaming Media Applications Adina Manoli Human Oriented Technology Lab, Department of Psychology, Carleton University, Ottawa, ON, K1S 5B6, Canada

More information

USABILITY TEST REPORT

USABILITY TEST REPORT USABILITY TEST REPORT CS 5760 HUMAN COMPUTER INTERACTIONS AND USABILITY Ankitha Pille GRAD5 HCI TEAM 6 INTRODUCTION UI DESCRIPTION The Application can be identified as mobile based online web application

More information

Outline. Usability Testing CS 239 Experimental Methodologies for System Software Peter Reiher May 29, What Do We Mean By Usability?

Outline. Usability Testing CS 239 Experimental Methodologies for System Software Peter Reiher May 29, What Do We Mean By Usability? Usability Testing CS 239 Experimental Methodologies for System Software Peter Reiher May 29, 2007 Outline What is usability testing? How do you design a usability test? How do you run a usability test?

More information

Statistics: Interpreting Data and Making Predictions. Visual Displays of Data 1/31

Statistics: Interpreting Data and Making Predictions. Visual Displays of Data 1/31 Statistics: Interpreting Data and Making Predictions Visual Displays of Data 1/31 Last Time Last time we discussed central tendency; that is, notions of the middle of data. More specifically we discussed

More information

COMP 6650 Web Usability Semester Project Report

COMP 6650 Web Usability Semester Project Report THE UNIVERSITY OF WEST INDIES FACULTY OF SCIENCE AND AGRICULTURE DEPARTMENT OF COMPUTING AND INFORMATION TECHNOLOGY COMP 6650 Web Usability Semester Project Report Project Title: User-Centered Redesign

More information

Software Development and Usability Testing

Software Development and Usability Testing Software Development and Usability Testing Shneiderman, Chapter 4 Preece et al, Ch 9, 11-15 Krug, Rocket Surgery Made Easy Rubin, Handbook of Usability Testing Norman Neilsen Group www HCI in Software

More information

THE TITLE OF MY THESIS GOES HERE: USE ALL CAPS AND PUT THE SUBTITLE ON THE SECOND LINE

THE TITLE OF MY THESIS GOES HERE: USE ALL CAPS AND PUT THE SUBTITLE ON THE SECOND LINE THE TITLE OF MY THESIS GOES HERE: USE ALL CAPS AND PUT THE SUBTITLE ON THE SECOND LINE Student Name (as it appears in One.IU) Submitted to the faculty of the School of Informatics in partial fulfillment

More information

Concepts of user-centered design

Concepts of user-centered design Lecture 1 Concepts of user-centered design What is UCD? Primary goad: making products usable Is there any difference? Usable Usefulness Usability Why important? Increased productivity Reduced errors Reduced

More information

Homework 1 Excel Basics

Homework 1 Excel Basics Homework 1 Excel Basics Excel is a software program that is used to organize information, perform calculations, and create visual displays of the information. When you start up Excel, you will see the

More information

Users are always RIGHT! Usability and Eyetracking to improve web sites

Users are always RIGHT! Usability and Eyetracking to improve web sites Users are always RIGHT! Usability and Eyetracking to improve web sites Laura Ruel, Hugh Morton Distinguished Associate Professor School of Media and Journalism University of North Carolina at Chapel Hill

More information

SAMPLE Treatment Perceptions Survey (TPS) Report. XXXXXX County, N=239. (Not Real Data) All Substance Use Treatment Programs Surveyed.

SAMPLE Treatment Perceptions Survey (TPS) Report. XXXXXX County, N=239. (Not Real Data) All Substance Use Treatment Programs Surveyed. Perceptions Survey (TPS) Report XXXXXX County, N=239 (Not Real Data) All Substance Use s Surveyed November 2017 Prepared by the University of California, Los Angeles Integrated Substance Abuse s *For county

More information

SWEN 444 Human Centered Requirements and Design Project Breakdown

SWEN 444 Human Centered Requirements and Design Project Breakdown SWEN 444 Human Centered Requirements and Design Project Breakdown Team Status Reports: (starting in Week 2) Your team will report weekly project status to your instructor, and as you wish, capture other

More information

REGULATED DOMESTIC ROAMING RESEARCH REPORT 2017

REGULATED DOMESTIC ROAMING RESEARCH REPORT 2017 REGULATED DOMESTIC ROAMING RESEARCH REPORT 2017 Researching the attitudes and perceptions of regional and remote Australians towards mobile providers and domestic roaming Vodafone Regional Roaming Research

More information

Error Analysis, Statistics and Graphing

Error Analysis, Statistics and Graphing Error Analysis, Statistics and Graphing This semester, most of labs we require us to calculate a numerical answer based on the data we obtain. A hard question to answer in most cases is how good is your

More information

MIT GSL week 4 Wednesday. User Interfaces II

MIT GSL week 4 Wednesday. User Interfaces II MIT GSL 2018 week 4 Wednesday User Interfaces II User Centered Design Prototyping! Producing cheaper, less accurate renditions of your target interface! Essential in spiral design process, useful in later

More information

CSCE 315 Fall Team Project 3

CSCE 315 Fall Team Project 3 CSCE 315 Fall 2017 Team Project 3 Project Goal Your team is to build a system that puts together different existing web components in an application that provides a quality user interface to the joined

More information

Evaluation studies: From controlled to natural settings

Evaluation studies: From controlled to natural settings Evaluation studies: From controlled to natural settings Lecture 14 Kristina Lapin Vilnius University Slides adapted from www.id-book.com 1 The aims: Explain how to do usability testing Outline the basics

More information

Usability Test Report for Programming Staff

Usability Test Report for Programming Staff Evaluation Assignment # 6 Usability Test Report for Programming Staff http://cshci-dev.mtu.edu:8084/ UX Expert : Sree Ram Akula (sreerama@mtu.edu) Programming Staff Development Team http://www.csl.mtu.edu/classes/cs4760/www/projects/s16/group4/www/

More information

Department of Organizational Performance and Workplace Learning, Boise State University Basic Use of Qualtrics Instructional Materials for OPWL 530

Department of Organizational Performance and Workplace Learning, Boise State University Basic Use of Qualtrics Instructional Materials for OPWL 530 Department of Organizational Performance and Workplace Learning, Boise State University Basic Use of Qualtrics Instructional Materials for OPWL 530 OPWL 530 Evaluation Basic Use of Qualtrics Instructional

More information

HCI and Design SPRING 2016

HCI and Design SPRING 2016 HCI and Design SPRING 2016 Before we start Project midway reports and presentations due in class on Thursday April 7 th 2- minute presentation (practice to make sure of the timing!) I WILL cut you off!

More information

Data Analysis using SPSS

Data Analysis using SPSS Data Analysis using SPSS 2073/03/05 03/07 Bijay Lal Pradhan, Ph.D. Ground Rule Mobile Penalty Participation Involvement Introduction to SPSS Day 1 2073/03/05 Session I Bijay Lal Pradhan, Ph.D. Object of

More information

CPSC 444 Project Milestone III: Prototyping & Experiment Design Feb 6, 2018

CPSC 444 Project Milestone III: Prototyping & Experiment Design Feb 6, 2018 CPSC 444 Project Milestone III: Prototyping & Experiment Design Feb 6, 2018 OVERVIEW... 2 SUMMARY OF MILESTONE III DELIVERABLES... 2 1. Blog Update #3 - Low-fidelity Prototyping & Cognitive Walkthrough,

More information

Improving Government Websites and Surveys with Usability Testing

Improving Government Websites and Surveys with Usability Testing Improving Government Websites and Surveys with Usability Testing a comparison of methodologies Jen Romano Bergstrom & Jon Strohl FCSM Washington, DC About this talk 1. Assessing the user experience is

More information

Hyacinth Macaws for Seniors Survey Report

Hyacinth Macaws for Seniors Survey Report Hyacinth Macaws for Seniors Survey Report http://stevenmoskowitz24.com/hyacinth_macaw/ Steven Moskowitz IM30930 Usability Testing Spring, 2015 March 24, 2015 TABLE OF CONTENTS Introduction...1 Executive

More information

GRADY NEWSOURCE KATE DEVLIN, LEAH MOSS, ANDREA SKELLIE & ASHLEY PANTER

GRADY NEWSOURCE KATE DEVLIN, LEAH MOSS, ANDREA SKELLIE & ASHLEY PANTER GRADY NEWSOURCE KATE DEVLIN, LEAH MOSS, ANDREA SKELLIE & ASHLEY PANTER INTRODUCTION TO THE STUDY THE CLIENT GRADY NEWSOURCE Grady Newsource is a student production of the Grady College of Journalism &

More information

Interaction Design. Ruben Kruiper

Interaction Design. Ruben Kruiper Interaction Design Ruben Kruiper What do you know? What do you think Interaction Design stands for? 2 What do you expect? Interaction Design will be: Awesome Okay Boring Myself I m not a big fan... This

More information

Climate(Central:( Usability(Briefing(

Climate(Central:( Usability(Briefing( Climate(Central:( Usability(Briefing( TO:Dr.JackBanks&RuthFitzgerald(WebDesigner) FROM:MarieBrokaw(ENGL334W) Introduction( ClimateCentral swebsiteisatthecoreofatmosphericscienceresearch.crossing thethresholdfromsciencenovicetoclimatemavendependsontheeffective

More information

User Services Spring 2008 OBJECTIVES Introduction Getting Help Instructors

User Services Spring 2008 OBJECTIVES  Introduction Getting Help  Instructors User Services Spring 2008 OBJECTIVES Use the Data Editor of SPSS 15.0 to to import data. Recode existing variables and compute new variables Use SPSS utilities and options Conduct basic statistical tests.

More information

Evaluation and Design Issues of Nordic DC Metadata Creation Tool

Evaluation and Design Issues of Nordic DC Metadata Creation Tool Evaluation and Design Issues of Nordic DC Metadata Creation Tool Preben Hansen SICS Swedish Institute of computer Science Box 1264, SE-164 29 Kista, Sweden preben@sics.se Abstract This paper presents results

More information

Running Head: TREE TAP USABILITY TEST 1

Running Head: TREE TAP USABILITY TEST 1 Running Head: TREE TAP USABILITY TEST 1 Gogglefox Tree Tap Usability Test Report Brandon S. Perelman April 23, 2014 Final Design Documents Final Design Prototype White Paper Team Gogglefox Website Author's

More information

I Shopping on mobile / RU

I Shopping on mobile / RU I Shopping on mobile / RU Exploring how people use their smartphones for shopping activities Q3 2016 I About this study Background: Objective: Mobile apps and sites are a vital channel for advertisers

More information

User Interface Design

User Interface Design Objective User Interface Design MIT, Walailak University by Dr.Wichian Chutimaskul Understand the principles of user interface (UI) design Understand the process of user interface design To design the

More information

Computational Systems COMP1209

Computational Systems COMP1209 Computational Systems COMP1209 Testing Yvonne Howard ymh@ecs.soton.ac.uk A Problem A café wants to build an automated system to provide breakfasts. The robot waiter greets people before taking their order

More information

USABILITY REPORT A REPORT OF USABILITY FINDINGS FOR OFF THE BEATEN PATH WEBSITE

USABILITY REPORT A REPORT OF USABILITY FINDINGS FOR OFF THE BEATEN PATH WEBSITE USABILITY REPORT A REPORT OF USABILITY FINDINGS FOR OFF THE BEATEN PATH WEBSITE Prepared by: Cori Vandygriff, Joseph Kmetz, Cammy Herman, and Kate DeBusk To: Off the Beaten Path Team From: Cammy Herman

More information

EasyTech Scope & Sequence for Grades K 8

EasyTech Scope & Sequence for Grades K 8 EasyTech Scope & Sequence for Grades K 8 Use the table below to develop your school district s technology plan. It provides an in-depth look at twelve critical digital literacy skills today s students

More information

CS3724 Human-computer Interaction. Usability Specifications. Copyright 2005 H. Rex Hartson and Deborah Hix.

CS3724 Human-computer Interaction. Usability Specifications. Copyright 2005 H. Rex Hartson and Deborah Hix. CS3724 Human-computer Interaction Usability Specifications Copyright 2005 H. Rex Hartson and Deborah Hix. Topics What are usability specifications? Usability specification tables Benchmark task descriptions

More information

Process of Interaction Design and Design Languages

Process of Interaction Design and Design Languages Process of Interaction Design and Design Languages Process of Interaction Design This week, we will explore how we can design and build interactive products What is different in interaction design compared

More information

Overview of the course. User-Centred Design. Group. Practical issue. Writting the report. Project work. Fang Chen

Overview of the course. User-Centred Design. Group. Practical issue. Writting the report. Project work. Fang Chen Overview of the course User-Centred Design Fang Chen 6 lectures, 3 hr each. L 1: April 6, 9-12, user-centered design concept L2: April 14, 9-12, usability concept L3. user-centered requirement study L4.

More information

USER-CENTERED DESIGN KRANACK / DESIGN 4

USER-CENTERED DESIGN KRANACK / DESIGN 4 USER-CENTERED DESIGN WHAT IS USER-CENTERED DESIGN? User-centered design (UCD) is an approach to design that grounds the process in information about the people who will use the product. UCD processes focus

More information

Sample: n=2,252 national adults, age 18 and older, including 1,127 cell phone interviews Interviewing dates:

Sample: n=2,252 national adults, age 18 and older, including 1,127 cell phone interviews Interviewing dates: Survey Questions Spring 2013 Tracking Survey Final Topline 5/21/2013 Data for April 17-May 19, 2013 Princeton Survey Research Associates International for the Pew Research Center s Internet & American

More information