CHAPTER 4 HUMAN FACTOR BASED USER INTERFACE DESIGN

Similar documents
A Study of Human Factors in Interactive Software

Experimental Evaluation of Effectiveness of E-Government Websites

Usability Report. Author: Stephen Varnado Version: 1.0 Date: November 24, 2014

Web Evaluation Report Guidelines

User Testing Study: Collaborizm.com. Jessica Espejel, Megan Koontz, Lauren Restivo. LIS 644: Usability Theory and Practice

A Usability Testing Approach to Evaluate User- Interfaces in Business Administration

2/18/2009. Introducing Interactive Systems Design and Evaluation: Usability and Users First. Outlines. What is an interactive system

Usability. HCI - Human Computer Interaction

Learnability of software

Stream Features Application Usability Test Report

Software Quality. Martin Glinz. Thomas Fritz. Lecture 7 UI Design, Usability & Testing. Many thanks to Meghan Allen and Daniel Greenblatt.

USER RESEARCH Website portfolio prototype

Improving user interfaces through a methodological heuristics evaluation framework and retrospective think aloud with eye tracking

Work Environment and Computer Systems Development.

EVALUATION OF THE USABILITY OF EDUCATIONAL WEB MEDIA: A CASE STUDY OF GROU.PS

The Business Case for Web Accessibility. Facilitator s Notes for this Module

Scrums effects on software maintainability and usability

Usability Report for Online Writing Portfolio

Concepts of Usability. Usability Testing. Usability concept ISO/IS What is context? What is context? What is usability? How to measure it?

Nektarios Kostaras, Mixalis Xenos. Hellenic Open University, School of Sciences & Technology, Patras, Greece

Usability of interactive systems: Current practices and challenges of its measurement

CHAPTER 3 A REVI EW & ANALYSIS OF USABILITY IN USER INTERFACE DESIGNING

Chapter 10 Interactive Systems And Usability Organizational Requirements Engineering

Cognitive Walkthrough Evaluation

THINGS YOU NEED TO KNOW ABOUT USER DOCUMENTATION DOCUMENTATION BEST PRACTICES

Usor: A Web Based Collection of User Oriented Methods

Usability Test Plan for Blogger Mobile Application

BCS THE CHARTERED INSTITUTE FOR IT. BCS HIGHER EDUCATION QUALIFICATIONS BCS Level 5 Diploma in IT. March 2017 PRINCIPLES OF USER INTERFACE DESIGN

Assistant Professor Computer Science. Introduction to Human-Computer Interaction

HOMEPAGE USABILITY: MULTIPLE CASE STUDIES OF TOP 5 IPTA S HOMEPAGE IN MALAYSIA Ahmad Khairul Azizi Ahmad 1 UniversitiTeknologi MARA 1

Using the Common Industry Format to Document the Context of Use

IBM MANY EYES USABILITY STUDY

Applying Usability to elearning

A Heuristic Evaluation of Ohiosci.org

MIT GSL week 4 Wednesday. User Interfaces II

balancer high-fidelity prototype dian hartono, grace jang, chris rovillos, catriona scott, brian yin

White Paper. Incorporating Usability Experts with Your Software Development Lifecycle: Benefits and ROI Situated Research All Rights Reserved

Interaction Design Guidelines and Rules

Who we tested [Eight] participants, having the following profile characteristics, evaluated [product name].

Evaluation and Design Issues of Nordic DC Metadata Creation Tool

A Health Literacy and Usability Heuristic Evaluation of a Mobile Consumer Health Application. Helen Monkman & Andre Kushniruk

Overview of the course. User-Centred Design. Group. Practical issue. Writting the report. Project work. Fang Chen

Chapter 4. Evaluating Interface Designs

Heuristic Evaluation of NUIG Participate Module 1

Easy English fact sheet

IJESRT. (I2OR), Publication Impact Factor: (ISRA), Impact Factor: 2.114

Usability Evaluation of Cell Phones for Early Adolescent Users

Interaction Design. Recap Session (Previous lecture April 21, 2016, 9am-12pm): Process Models, Elements and Usability

Interaction Design. Chapter 3 (May 11, 2017, 9am-12pm): Approaches to IxD Recap Session (Previous lecture): Process Models, Elements and Usability

Improving the Usability of the University of Rochester River Campus Libraries Web Sites

A Usability Evaluation of Google Calendar

1. Introduction and Overview

Usability Evaluation of Digital Library

A Paper Prototype Usability Study of a Chronic Disease Self-management System for Older Adults

Usability Test Report: Homepage / Search Interface 1

Software Development and Usability Testing

Memorandum Participants Method

User-centered design in technical communication

Heuristic Evaluation of igetyou

Prepared by: Marysol Ortega & Diana Arvayo

Interaction Design. Heuristic Evaluation & Cognitive Walkthrough

Usability and User Experience of Case Study Prof. Dr. Wiebke Möhring

Usability Testing Review

Applying Human-Centered Design Process to SystemDirector Enterprise Development Methodology

Human-Computer Interaction: An Overview. CS2190 Spring 2010

Evaluation techniques 1

Evaluation techniques 1

A Top-Down Visual Approach to GUI development

evision Review Project - Engagement Simon McLean, Head of Web & IT Support Information & Data Services.

HCI and Design SPRING 2016

Criterion 4 Exemplary 3 Very Good 2 Good 1 Substandard Comprehensive/ Web 2.0 tool cannot be used any content area and has

Cognitive Analysis of Software Interfaces

Honors & Scholars eportfolio Overview and Assessment Dr. Lindsey Chamberlain Dr. Leo Hoar

Overview of Today s Lecture. Analytical Evaluation / Usability Testing. ex: find a book at Amazon.ca via search

..in a nutshell. credit: Chris Hundhausen Associate Professor, EECS Director, HELP Lab

Amsterdam Medical Center Department of Medical Informatics. Improve. Usability evaluation of the sign up process of the Improve app

CS-5200 Design Project

CSE 440: Introduction to HCI User Interface Design, Prototyping, and Evaluation

CSE 440: Introduction to HCI User Interface Design, Prototyping, and Evaluation

A User Study on Features Supporting Subjective Relevance for Information Retrieval Interfaces

Easy Knowledge Engineering and Usability Evaluation of Longan Knowledge-Based System

15/16 CSY2041 Quality and User-Centred Systems

Usability Inspection Methods. Overview. Usability Measures. SMD157 Human-Computer Interaction Fall 2003

Parts of the SUM: a case study of usability benchmarking using the SUM Metric

Jennifer Nip, P.Eng. Portfolio

Usability Driven Website Design An Equine Sports Case Study

Usability Heuristic Evaluation for Phayao Province E-Government Portal, Thailand

Usability Testing Methodology for the 2017 Economic Census Web Instrument

Towards Systematic Usability Verification

COGNITIVE WALKTHROUGH REPORT. The International Children s Digital Library

Curtin University School of Design. Internet Usability Design 391. Chapter 1 Introduction to Usability Design. By Joel Day

CSCI 3160: User Interface Design

User Experience Report: Heuristic Evaluation

Human Computer Interaction in Health Informatics: From Laboratory Usability Testing to Televaluation of Web-based Information Systems

User Experience Design I (Interaction Design)

UPA 2004 Presentation Page 1

1. The Best Practices Section < >

Online Evaluation Tool: Dashboards and Reports

Ryan Parsons Chad Price Jia Reese Alex Vassallo

EVALUATION OF PROTOTYPES USABILITY TESTING

Transcription:

CHAPTER 4 HUMAN FACTOR BASED USER INTERFACE DESIGN 4.1 Introduction Today one of the most important concerns is how to use the system with effectiveness, efficiency and satisfaction. The ease or comfort during the usage of systems is mainly determined by characteristics of the software product itself, such as the user-interface. As usability is concerned with the usage of software systems generally, it forms an important pillar for determining and optimizing of product quality characteristics. Usability takes into consideration, the type of the users, the tasks to be carried out, as well as the physical and social aspects that can be related to the usage of the software products. There are several usability criteria available as guidelines that are defined in international standards such as the ISO 9241-11 [4]. For a successful application of these guidelines, software system designers need to understand the design goals and benefits of each guideline, the conditions under which the guideline should be applied, the precise nature of the proposed solution, and any procedure that must be followed to apply the guideline. ISO 9241-11 consists of guidelines on usability, providing definitions of usability that is used in subsequent related ergonomic standards. Moreover, this ISO explains how to identify the information necessary to be taken into account when specifying or evaluating usability in terms of measures of user performance and satisfaction. Usability evaluation can be defined 98

as the act of measuring (or identifying potential issues affecting) usability attributes of a system or device with respect to particular users, performing particular tasks, in particular contexts. The reason that users, tasks, and contexts are part of the definition is that the values of usability attributes can vary depending on the background knowledge and experience of users, the tasks for which the system is used, and the context in which it is used [5]. Various evaluation criteria can be used to test the usability of the system: Effectiveness: It is accuracy and completeness with which specified users can achieve specified goals in particular environment [6]. Producing the result that is wanted or intended produces a successful result. The total average of effectiveness has a relatively low score; thus, it seems that some additional features should be added to activate the system. Also when the total evaluation is low, this means that the user needs more time than expected to carry out the given tasks. Efficiency: Efficiency is defined as the recourses expanded in relation to the accuracy and completeness of goals achieved [6]; or the quality of doing something characterized with no waste of time or money. On this basis, evaluation is decided to improve the structure of the interfaces and to add a number of features before releasing the system to the users. Satisfaction: It is a tool to measure computer user s subjective satisfaction with the computer interface. It contains an overall measure of satisfaction and measures user satisfaction in four 99

specific interface aspects: screen factors, terminology and system feedback, learning factors, and system capabilities [7]. It is tangible that computers do more than just providing information and offering services to people to use [8]. Caroll [9] notes that the design of computing systems is part of an ongoing cycle in which new technologies raise new opportunities for human activities; as people's tasks change in response to these opportunities [5]. 4.2 Research Methodology: Empirical Study The purpose of our empirical study is to find out the important usability aspects, which need to be improved to reach high degree of usability. Since usability and empirical study are mutually dependent, we feel an effective empirical study is needed which could validate our findings. The main purpose of empirical study in our thesis is to study usability in a practical environment by observing the experiences of user while using the system. Hence, the empirical study is needed to find the usability flaws which affect the current system. To do an effective, empirical study five preset task have been identified and will be performed by the participants to increase the validity of the collected data. The collected data is checked and analyzed. To be specific the objectives of the study were to gain an insight into the issues of usability of the user interface and how usable our design was for different classes of users. Our study followed general guidelines for usability testing. These included designing tasks, the questionnaire, recruiting test participants, conducting testing, and analyzing test results. 100

The study took place in Think Computers. Think Computers is an interdisciplinary, professional consulting firm, which has its primary purpose the application of Managerial, Information system and Engineering skills to the solution of a wide number of problems in various commercial environments. The firm has in the past provided Software solutions government training in size from small private organizations to Major Corporation. Think Computers has a large number of developers with experience in development tools. Participants were informed that the tasks that they would be asked to do was not a test of their intelligence. All participants began by filling out a general information questionnaire concerning their personal characteristics like age and education (Illustrated in Appendix I). Researcher used library interface of Think Computers for this study. Participants were asked to perform the given tasks. Task duration and task success scores were collected. The task time started after the participant read the task aloud and ended in one of two ways: 1. The participants finished the task. A predetermined correct answer for each task was used to calculate task success measures. 2. The participants gave up. 4.2.1 Participants These participants were balanced by age, literacy level and general computer experience. Participants were divided into two groups; 1- having age less than or equal to 40, 2-having age above 40. Literacy level was measured using a 3 pt scale: users with different literacy levels namely 1=literate, 2=semi literate and 3=illiterate. Computer 101

experience was measured using a 5-pt scale: 1= novice, 2=beginner, 3=intermediate, 4=advanced and 5=expert. 4.2.2 Prototype Description The following section describes some of the screenshots of Library Software. This Software is used by Think Computers for their library management. We have chosen this software for our participants to perform the given task. Scenarios were used to describe how the users will perform the task. 102

Figure 4.1: Homepage of Library Software 103

Figure 4.2: Menu to navigate from Homepage to Query page 104

Figure 4.3: Query page of Library software 4.2.3 Scenario: Participants have to find out Yashwant Kanetkar s book Let Us C, from the library.(1) Find the above mentioned book.(2)find multiple edition of the book.(3)find the recent version.(4) What is the unique id of the book.(5) Take print out of the details so you can refer to it later. On the completion of these tasks, the participants were asked to fill up questionnaire (feedback). The questions for subjective evaluation have 105

been established after referring to different types of questionnaires. We have chosen computer system usability questionnaire (CSUQ) [10].This questionnaire, developed at IBM, is composed of 19 questions. We had made some changes in the questionnaire (Illustrated in Appendix I). Finally, the participant were thanked and asked if they had any questions. 4.2.4 Results A small number of participants were able to complete their task. Most of them completed fewer tasks successfully and took longer time on each task. Age, Computer experience and literacy level of the participants correlated with overall performance. Since the focus of our study was to identify usability problems in current user interface. Few participants who were unable to complete the tasks, when we discussed the reasons of their failure they said that they couldn t understand the functionality of the system. These users were puzzled by the meaning of selecting inputs actually they were not following the proper order. 4.2.5 Observations We had a number of usability observations about the system. 1. The user of old age does not prefer to recall information from one part of a dialogue to another. Participants of old age could not easily read characters, they preferred bigger font size. Few users reported that during task 1 when the users have to select menu for searching the book there was no tool tip available. 106

Figure 4.4: Old age participants prefer bigger font size From the above figure we can conclude that as the age increases participants prefer bigger font size. 2. The most significant problems that people with low literacy level encountered in comprehending the interface was that they read word by word trying to make sense of the information they read. It is clear that in order to provide a genuinely usable system for this group it is necessary to use more pictures, audio etc. 107

Figure 4.5: Users with low literacy level prefer simple language The results also indicated that low literacy users do not prefer dense pages. As information technologies expand far beyond the traditional personal computers into public information systems, designers of these systems must consider their target audience s level of literacy [2]. As Government and Social Services information move to online distribution, digital inclusion will require designers to consider the problems faced by low literacy users [3]. 3. Most of the participants who have computer experience could complete all the tasks. Novice and low literacy users couldn t understand technical terms properly. 108

Figure 4.6: Novice users unable to complete their task successfully Many users reported that the task1 was not completely successful, because it is not giving the proper guidance. Also when the user entered the Author name in search box to find the corresponding books, some users did not get the results because of space between keywords. Here the users got confused how to go on with the task. Here an alternative such as dropdown list is not provided by the system. When the user misspells the name of the Author, the system should be smart enough to show appropriate suggestion of authors that enables the users to complete the task. The system should be uniform and unitary which means the standard followed in one part of the system must be followed throughout the process. For example the operations of functions, tasks must be consistent. In the Library Interface standard font size is not 109

maintained throughout the process because of which the users felt little difficult to read the contents. Users cannot complete the tasks successfully because the important menus were not visible to users. In the interface users who don t have computer experience did not understand meaning of Query Menu. So terminology was not clear to the users. 110

Table 4.1: Factors which affect usability of the system Factors Age Literacy Level Computer Experience Impact of these factors on the usability of the system In the study conducted by us we found that only 2.3% of tasks could be completed by people of old age. Duration of task completion was very high. Most of them mentioned that they found system complicated and error messages were not clear. Results of the study indicate that usability of the system is highly affected by literacy level. Participants with low literacy couldn t understand most of the terminology used in the system due to this they made so many errors. The survey is indicative of the fact that system is moderately affected by the experience of the target user. As we had already mentioned that novice users prefer easy to use system whereas professional users prefer efficiency. 111

At all points during the designing of interface the target users should keep in mind and efforts should be made to ensure that the interface did not get confusing for the users. Icons, language and terminology should be understandable by the target users. Shortcuts or accelerators, unseen by novice users, are provided to speed up interaction and task completion by frequent users. Few participants mentioned that error messages were expressed in complicated language. Error messages should define problems precisely and give quick, simple, constructive, specific instructions for recovery. There is a great difference in task completion for different participants. This is due to the different experience, age and literacy level of the participants. 4.3 Conclusion The designers of the system should always consider human factors during design time because end user feel that if it is not easy to use, not easy to learn, not according to their needs, then even an excellent software could fail. Since users differ with regards to abilities, requirements and preferences so the system should aim to cover the broadest range of the users. User Interface tools should provide special helps to the designers like guidance and suggestions etc. 112

REFERENCE [1] Stephanidis C., Akoumianakis D., Sfyrakis M., Paramythis A.(1998),Universal accessibility in HCI: Process-oriented design guidelines and tool requirements, C. Stephanidis & A. Waern (Eds.), Proceedings of the 4th ERCIM Workshop on "User Interfaces for All", Stockholm, Sweden [2] Kodagoda Neesha, Wong B.L.W., Khan Nawaz(2008), Effects of Low & High Literacy on User Performance in Information Search and Retrieval., proceedings of the 22nd annual conference of Interaction a specialist group of the BCS 2008 HCI Liverpool,pp.1 [3] Kodagoda Neesha, Wong B.L.W., Khan Nawaz(2009), Identifying Information Seeking Behaviours of Low and High Literacy Users: Combined Cognitive Task Analysis. NDM9 2009 [4] ISO 9241-11: Ergonomic requirements for office work with visual display terminals (VDTs) - Part 11: Guidance on usability, 1998 [5] Odeh Salaheddin, Adwan Ibrahim O. (2009), A Usability Testing Approach to Evaluate User-Interfaces in Business Administration, International Journal of Human and Social Sciences 4:14 2009,pp.4,7 [6] Hartmann E. A., Westerwick A.(1998), Shopfloor Systems Based on Human Skill and Experience, 7th IFAC/IFIP/IFORS/IEA 113

Symposium on Analysis; Design and Evaluation of Man-Machine Systems, Kyoto, Japan, Sept. 16-18 [7] B. Shneiderman, C. Plaisant(2004), Designing the User Interface: Strategies for Effective Human-Computer Interaction. 4th Edition, Addison Wesley Longman [8] Rosson M. B., Carroll J. M.(2002), Usability Engineering: Scenario-Based Development of Human-Computer Interaction, Morgan Kaufmann [9] Caroll J. M.(2000), Making Use: Scenario-Based Design of Human-Computer Interactions, Cambridge, MA: MIT Press [10] Lewis J. R.(1995),IBM Computer Usability Satisfaction Questionnaires: Psychometric Evaluation and Instructions for Use, International Journal of Human-Computer Interaction, vol. 7, no. 1, pp. 57-78 114