Evaluation Plan for Fearless Fitness Center Website

Transcription

1 Evaluation Plan for Fearless Fitness Center Website A three-step process will be used to prepare the Fearless Fitness website for use. First, at the outset of the project, Back-of-the-Envelope Task Analysis will be used in order to provide the development team with in-depth feedback on the website before it is exposed to end-users. Next, Heuristic Evaluation techniques will be used to systematically evaluate the site page by page so many of the basic errors are found and corrected. Finally, User Testing will be used to get feedback from a sample of target users before it is released to the general public. Further details on each step of the process are as follows: I. Back-of-the-Envelope Task Analysis A. Define Task (e.g. view log of progress toward fitness goal) B. Who will conduct the evaluation? 1. The software development team (end-users absent) a. As many members as possible will evaluate and compare errors found. C. Aspects to be evaluated 1. Time required to perform each task a. Break task down into natural steps b. Estimate time required for each step c. How many total steps are required? 2. Memory Load a. Break task down into natural steps b. Check for recognizable options at each step c. Look for easy-to-understand conventions d. Look for instances of recall (vs. recognition) e. Check ease of navigation (e.g. how to go back ) 3. Learning Curve a. Are there any unnecessary steps? b. Are standard conventions used? c. Are the steps logical? d. Are options clearly visible? D. What is to be gained from this step? 1. Understand how much time and effort required of user 2. Identify ways to reduce memory load and learning curve 3. Opportunities for shortcuts/workarounds 4. Check for optimal wording and conventions

2 II. Heuristic Evaluation A. Define Task B. Who will conduct the evaluation? 1. Software development team (end-users absent) 2. As many as possible will evaluate and compare errors found C. Aspects to be evaluated (*Nielsen and Molich) 1. Simple natural dialog a. Look for extraneous/irrelevant information. b. Are the options simple and straightforward? 2. Speak users language b. Look for unnecessary technical jargon, etc. c. Check for unclear language 3. Minimize user memory load a. Are options and dialogs clearly labeled? b. Are standard conventions utilized? 4. Consistency a. Are options presented following a consistent pattern? b. Are pages set up the same way? c. Is information organized logically? 5. Provide feedback a. Does every action produce a visible result? b. Are there confirmation dialogs when information is entered? c. If an action is not completed, is the user informed? 6. Provide clearly marked exits a. Is there a close or x option in every dialog? b. Is there a cancel or undo option to cancel changes? c. Do you always know your way Home? 7. Shortcuts a. Are there shortcuts for advanced users? b. What is the minimum number of steps to perform the task? c. Could a novice user still get the same results? 8. Good error messages a. Is there an error message when the action can t be completed? b. Does the error message state the problem? c. Is the error message understandable? d. Is the error message helpful? 9. Prevent errors a. Are false options displayed? b. If false options are displayed, are they grayed out? c. Before irreversible action completed, is there a confirmation dialog?

3 d. Is the user informed before a link opens a new page? e. Are warnings displayed where they should be? D. What is to be gained? 1. Check for errors throughout the whole site 2. Ensure the user is guided to take the right actions 3. Make results of actions predictable 4. Check for visibility 5. Identify inconsistencies and user-computer communication breakdown 6. Minimize user-testing time spent on functional problems

4 III. User testing A. Define Task B. Who will evaluate? 1. Fitness club staff and selected sample of club members 2. Staff members will perform tasks related to their departments 3. Selected variety of club members will evaluate site for their interests C. Aspects to be evaluated 1. Requirements a. Do the supported tasks match what the gym offers? b. Are there features that gym members can t benefit from? c. Are there areas of user interest not covered? d. Is there demand for this system and its features? e. Is the information correct? Emphasis and detail appropriate? 2. Learning curve a. Is the software easy for people other than developers to learn? b. Does the navigation follow the gym s structure? D. What is to be gained? 1. Fitness staff can contribute insight on clients needs based on experience 2. Including all departments covers various tasks 3. Fitness staff know what the gym offers and what is popular 4. Fitness staff know what information gym members are looking for 5. Being involved will help staff know how to assist users with software

5 To be completed by system designers. Please indicate items where you found errors. Heuristic Analysis Evaluation Sheet Page to be evaluated: 1. Please indicate anything you see that is not relevant 2. Please indicate any unjustified technical language usage. 3. Please indicate any language that may be unclear 4. Are there any options or dialogs that are not appropriately labeled? 5. List standard conventions used 6. Do menus, options, dialogs, and symbols follow a consistent pattern? 7. Does the page match the rest of the website? 8. Are the menus and features arranged logically? 9. Do any actions not produce a visible result? 10. Should there be a confirmation dialog anywhere and there isn t? 11. Is the user informed any time an action is not completed? 12. Does every window and dialog have a close feature? 13. What is the minimum number of steps using shortcuts? 14. Can novice and expert user get the same results? 15. Is there an error message when an action can t be completed? 16. Is any error message hard to understand or doesn t state the problem?

6 17. Are any false options displayed and not grayed out? 18. Should there be a confirmation dialog anywhere and there isn t? 19. Can the user get sent to a new page without warning? 20. Should there be a warning anywhere and there isn t?

7 To be completed by system designers. Please indicate items where you found errors. Task Analysis Evaluation Sheet Task to be evaluated: 1. List the main steps involved in the task and estimate time for each step: 2. How many steps are there? Total estimated time: 3. List the options selected to perform task: Are they recognizable (do not rely on recall)? Y / N 4. What conventions are used? 5. Can the user navigate from page to page and back from any page? Y / N 6. Could any steps be eliminated? 7. Are there any steps that are not logical? 8. Could any of the required options be made more visible?

8 Fearless Fitness Website Evaluation 1. How often do you visit the Fearless Fitness location near you? 2. Do you normally use electronic resources to assist with your fitness routine? 3. Is an electronic resource such as a website important to your overall view of a fitness center? 4. Is the design of the website pleasing to the eye? If not, what would make it better? 5. Does the layout make it simple to find the information that you are looking for? 6. Is it easy to navigate between pages of the website? 7. Are there any features that you feel are missing from the website? 8. If you had never visited a Fearless Fitness location, would the website make you feel that it is a gym that you would fill your fitness needs? 9. Overall, does the website fail to meet your needs, meet your needs adequately, or exceed your needs? Please explain.

9

10

11

12

13

14

15

16

17

18