Cognitive Walkthrough. Jon Kolko Professor, Austin Center for Design

Transcription

1 Cognitive Walkthrough Jon Kolko Professor, Austin Center for Design

2 Cognitive Walkthrough A method for evaluating the learnability of a product, based on a theory of problem solving in unfamiliar situations.

3 Cognitive Walkthrough A method for evaluating the learnability of a product, based on a theory of problem solving in unfamiliar situations. COGNITIVE WALKTHRU IS 1. Intended for first-time use 2. Assumes systems don t require training 3. Is based on a credible story of a hypothetical user

4 When confronted with a unique, new situation, people leverage a problem solving theory based on exploration and progressive behavior refinement. 1. We determine what controls are available for us to take action 2. We select the control that makes the most sense towards incremental progress 3. We perform the action using the control 4. We evaluate the results of our action to see if we have made positive, negative, or neutral progress

5 1. Prepare a prototype of any fidelity 2. Identify your user, assuming they are a system novice 3. Identify the main goals this user will have with the system 4. Identify and list each step through the product that support the user s main goals 5. Extract (or make) a screen shot that directly maps to each step in the walkthrough

6 Walk through the tasks screen by screen. At each screen, ask these questions, and answer them with a credible story: 1. Will the user try to achieve the right effect? 2. Will the user notice that the correct action is available? 3. Will the user associate the correct action with the effect they are trying to achieve? 4. If the correct action is performed, will the user see that progress is being made towards their goal?

7 Will the user try to achieve the right effect? The user of the system has an end goal in mind, but needs to accomplish various tasks to complete it. Will they even know to perform the specific steps along the way? The user wants to print a document. Will they know that they first need to select a printer? The user wants to manipulate an object in Illustrator. Will they know that they first need to change to manipulation mode?

8 Will the user notice that the correct action is available? Is the option visible and on the screen, or at least in a place the user will likely look? The user wants to perform an action, but it s buried in a menu The user wants to perform an action, but must swipe to another screen first The user wants to perform an action, but they have to tap and hold to make a button appear

9 Will the user associate the correct action with the effect trying to be achieved? Is a label or icon worded in a way that the user expects? The user wants to perform an action, but they don t realize that a given icon is how the action is initiated The user sees a menu with a variety of buttons, and isn t sure which to press

10 If the correct action is taken, will the user see that progress is being made towards their goal? Is there any feedback showing that the user selected the right option or is making forward momentum? The user arrives at a screen, but it has nothing to do with what they selected The user arrives at a screen, but it s unclear how or why they got there

11 1. Will the user try to achieve the right effect? 2. Will the user notice that the correct action is available? 3. Will the user associate the correct action with the effect that user is trying to achieve? 4. If the correct action is performed, will the user see that progress is being made towards their goal?

12 1. Will the user try to achieve the right effect? 2. Will the user notice that the correct action is available? 3. Will the user associate the correct action with the effect that user is trying to achieve? 4. If the correct action is performed, will the user see that progress is being made towards their goal?

13 1. Will the user try to achieve the right effect? 2. Will the user notice that the correct action is available? 3. Will the user associate the correct action with the effect that user is trying to achieve? 4. If the correct action is performed, will the user see that progress is being made towards their goal?

14 1. Will the user try to achieve the right effect? 2. Will the user notice that the correct action is available? 3. Will the user associate the correct action with the effect that user is trying to achieve? 4. If the correct action is performed, will the user see that progress is being made towards their goal?

15 1. Will the user try to achieve the right effect? 2. Will the user notice that the correct action is available? 3. Will the user associate the correct action with the effect that user is trying to achieve? 4. If the correct action is performed, will the user see that progress is being made towards their goal?

16 Unique Identifier Unique Screen ID Problem Description JK_1 1.4.A The icon necessary to launch the menu is not recognizable JK_2 1.4.B It is not clear that the goals will appear, or where to find them Severity (1-5, 5 is high) Frequency (1-5, 5 is common) Proposed Solution 3 4 Include a better icon, or include a tooltip that shows where to click; alternatively, use a text button for important actions ( Menu ) 3 4 Make the goal area more prominent Use a unique identifier that combines the initials of the evaluator with a running number tally (JK = Jon Kolko, 1 = incident number one) Define a severity and frequency rating to indicate the relative impact of the critical incident and the number of times this incident is likely to be identified by a user

17 Cognitive Walkthrough A method for evaluating the learnability of a product, based on a theory of problem solving in unfamiliar situations. COGNITIVE WALKTHRU IS 1. Intended for first-time use 2. Assumes systems don t require training 3. Is based on a credible story of a hypothetical user RUNNING A COGNITIVE WALKTHROUGH/ 1. Prepare a prototype of any fidelity 2. Identify your user 3. Identify the main goals this user will have with the system 4. Identify and list each step through the product that support the user s main goals 5. Extract (or make) a screen shot that directly maps to each step in the walkthrough 6. Walk through the screens and ask the four questions. 7. Catalog the problems in a spreadsheet 8. Propose changes to the problems 9. Prepare a presentation that describes the top findings

18 Jon Kolko Austin Center for Design