Case Study: Successful Adoption of a User-Centered Design Approach During the Development of an Interactive Television Application
|
|
- Wilfred Wilkerson
- 6 years ago
- Views:
Transcription
1 Case Study: Successful Adoption of a User-Centered Design Approach During the Development of an Interactive Television Application Sheri Lamont Microsoft Corporation One Microsoft Way Redmond, WA U.S.A. sheril@microsoft.com Abstract When creating a user experience for interactive television applications, or for any interface for that matter, it is important to start user research early in the design cycle, so that improvements can be made on the user experience through iterations. Unfortunately, during the development of user experiences this does not often happen. This paper discusses how a user-centered design approach was successfully adopted during the creation of an interactive program guide. Specific tips and tricks for effectively working with development teams will also be presented. Keywords Interactive television, interactive program guide, usability, user-centered design, case study Introduction The term usability, in the context of creating software represents an approach that puts the user, rather than the system, at the center of the process. This philosophy, called user-centered design (UCD), incorporates user concerns and advocacy from the beginning of the design process and dictates that the needs of the user should be foremost in any design decision [ISO/IEC 1999]. In large software companies, usability professionals often find themselves coming into the process after the planning stages of a project because the team thinks of them as a resource that can be used once a user experience has been created. Alternatively, many teams believe that due to their shipping deadlines, they don t have time to incorporate user-interface changes based on user research and usability evaluations of the product. As concluded by [Rosenbaum et al., 2002], integrating a UCD approach into the development process is challenging and requires political savvy, knowledge of a wide variety of methods, flexibility in using methods, inspiration and innovation. This paper discusses how the Microsoft TV usability group rallied the development team and 13 got them to adopt a UCD approach for the creation of an interactive program guide (IPG). Case Study: Designing the Microsoft TV Interactive Program Guide The Microsoft TV Interactive Program Guide (IPG) is an embedded interactive television application that resides natively on a low-end settop box. This simple guide allows users to scan television shows listed in a grid format, search for television programs by categories or keyword, set TV reminders so they are informed when their favorite television program is on, and set parental controls for rated content. A recent report from [Datamonitor, 2002] identifies the following key attributes as central to the development of advanced IPGs: simplicity (leveraging a low level of input and providing users with a simple and familiar interface), usability (the environment should reflect the likely nature of usage, for instance with the initial options relevant to the context the user has entered the IPG from), accuracy (program listings are up to date at all times to ensure the trust of the end user) and objectivity (one type of content is not prioritized over another). When we created the Microsoft TV IPG, the entire team s primary focus was on simplicity and usability (identified as the key consumer needs
2 left unfulfilled by IPGs already on the market). One of the main business goals was to build a product that is faster, easier-to-use, more attractive and more fun than competitive products. In order to achieve this, the usability team proposed that a UCD approach be adopted by the product team and tightly integrated with the development process of this product. Due to the fact that the business goals aligned with usability s goals for the product, this was easy to achieve. Additionally, the development team for this product was small approximately people, which made it a good environment to adopt a UCD approach. The user interface (UI) design specifications were written and owned by a single person in the role of program manager (spec writer) and UI designer, thus influence did not need to be directed at a group of people. With everything in place, usability embarked on a challenging and very exciting process to create a best of breed user experience for an IPG application. The following section walks through each step of our approach to implementing UCD for this project and what specific methodologies were used. Have a Business Goal Related to Ease of Use Many usability professionals feel that in order for good UCD awareness to take place, the attitudes and philosophies of usability (and design for that matter) must be internalized by those who make decisions that affect the final design of a product. The shift to internalizing usability can be accelerated by thinking about usability from a strategic (proactive and integrated) instead of tactical (responsive and isolated) perspective [Rosenbaum et al., 2000]. By having some of the main business goals for the IPG product specify ease of use and simplicity, a good user experience became a strategic initiative. The end result was that the entire team, from senior management down to the individual contributor level fostered and promoted the need to ship a best of breed user experience for our product. Fix What Was Broken Due to the fact that the entire team for creating the Microsoft TV IPG product was very small, that meant the usability resources were limited as well. In order for the UCD approach to be successful, the first thing that was done by usability was reflect upon what worked well for the product teams and what didn t work well in 14 the past. One major issue that surfaced was a lack of usability s awareness of what milestone the team was at in the development process and how each milestone was defined. From here, usability began meeting with the product team members to ensure the following: Usability understood the various milestones in the development process. Usability worked with the team to come up with usability exit criteria for each milestone (i.e., there must be no severity 1 usability issues in order for the team to declare code complete). Usability proposed a specific milestone for UI by establishing a formal UI freeze date. During the development of the product, the team understood when usability would need to run evaluations on the product, and what support (i.e., such as builds on set-top boxes) usability would need from them. The other major issue that surfaced was the product team s inability to see how effective this usability support really was. To address this issue, usability brainstormed with the members of the product team and came up with usability projects that the team was excited about and which also facilitated easy tracking of progress during the development cycle. These included benchmarking lab studies and competitive evaluations. Benchmark Using Consistent Tasks for Each Study To prepare for the benchmarking lab studies, usability identified and wrote a set of 13 core tasks we thought most users would complete with the product. Data from previous Microsoft site visits to WebTV customers and satellite subscribers were used to help narrow down the task list. Some of the 13 tasks included: Changing channels/channel surfing Finding out the name of the TV program currently being watched and what it was about Searching for a specific TV program Setting a list of favorite channels Finding child-appropriate cartoons Setting parental controls These 13 core tasks were given to participants to complete each time a lab study was conducted so that the task performance could be used to benchmark and measure the team s progress over
3 time. This benchmarking approach enabled usability to track the improvements the team made during each stage of the development process, over a period of about one year. In total, three benchmark studies were conducted during that one year period. Track the Changes to the User Experience As mentioned above, benchmarking enabled usability to track progress towards the UI goals throughout the year. To ensure that the benchmarking results were visible to the team and easily interpreted, we created a special report format that allowed the product team to compare and contrast the success of tasks from study to study. Due to the report format, each finding and recommendation from the previous study could be compared to the current finding so that it was easy to verify whether the last UI fix fully alleviated the usability issue. If the fix had not alleviated the issue, additional usability findings were reported and further recommendations were presented in the report. If the issue was fully addressed, no further recommendations were listed in the row for that particular issue. In addition to making it easy to compare and contrast the success of tasks from study to study, the report format also highlighted how the iterations improved the overall experience. Refer to Table 1 for an excerpt of the report format. There were some instances where usability issues surfaced that were not identified in the previous baseline study. If this occurred, these issues were listed in a New Issues section of the usability report. The findings were listed for the current study and the text Not a usability issue was placed in the previous study findings column. Finally, to help the product team understand how serious an issue really was, usability prioritized each issue using a system of asterisks and check marks. Three asterisks indicated that the issue was the most severe, while a check mark indicated that the issue had been solved or that the task was a success (see Table 2). Table 2: Legend used in report format to explain priority. Priority Definition *** Serious this can prevent users from completing tasks ** Moderate this can cause users to have difficulty completing tasks * Minor this can cause users to hesitate in completing tasks and complete tasks less efficiently NEW! Fixed no more design changes are required New Finding- this is a new usability issue identified from the current test Table 1: Excerpt of report format for tracking usability issues. STUDY #1 FINDINGS ACTION TAKEN STUDY #2 FINDINGS FURTHER RECOMMENDATIONS Expected to be able to specify Able to successfully search a time rather than a timeframe using By Day and Time label in Search PRI Three participants wanted the ability to specify specific times rather than a timeframe in the Search by Time feature. These participants also indicated that the labels Morning, Afternoon, Night and Late Night were ambiguous because they weren t certain if 11:00 pm constituted Night or Late Night. Changed search capabilities from 4 generic categories to specific hours of the day to allow user to specify a specific time. Bug # A21B5 All participants were able to correctly search on a specific day (tomorrow) at a specific time for a specific program using the By Day and Time label. All participants easily picked out the day and time to complete the task. When asked to search for programs on today, six participants selected the Today label within search, while only one participant opted to use the Browse feature. Continue to allow users to specify a specific day and time to complete a search. No recommendations are necessary. 15
4 After each benchmark study was completed, we quantified the team s progress by tallying up the number of usability issues found, and compared that number against the number of usability issues that were addressed. Furthermore, we found it useful to compare the number of usability issues discovered from one study to the next so the team could see that the overall discovery of usability issues was on a down trend (see Table 3). Quantitatively reporting the usability findings really emphasized the team s progress, and highlighted the merits of the UCD approach. Table 3: Example of how usability findings were reported quantitatively. Benchmark Study A 33 usability issues were discovered 30 of these issues were addressed through a redesign or UI change (to be verified in next study) Result the team is addressing more than 90% of the usability issues found with the user experience Benchmark Study B 15 usability issues were discovered 10 of these were new usability issues 5 were re-occurring issues all had dropped in severity from previous study Deliver on Your Promise One of the most important things that usability can do to build a sense of trust and commitment is to deliver on promises made to the team. This not only includes delivering usability reports on time (as determined by usability and the product team) but within an appropriate amount of time after the study has been completed. Too often, usability studies are run and it takes another 2-3 weeks for the usability report to be completed. In our case, for each study that was run for the IPG product, usability agreed that the full report would be completed and ready for reading 4 days after the last participant came through the lab. During the development cycle when the team was working hard towards a specific milestone and basically had a deadline for which UI changes could not be accepted beyond a certain point, usability worked with the team to provide quick findings so that a high level summary of the results could be shared with the team the day after the study sessions finished. This facilitated faster tracking of issues and allowed the product team to make the necessary changes to the UI in time for critical deadlines. Make it Easy for the Product Team Once product specifications are created and signed off, the product team typically lives and breaths through their bug tracking system. In other words, changes don t get done unless they are filed as a bug. This was no different for our situation. In order to make it easy for the product team to track the usability and design recommendations from the benchmark studies, we followed suit and filed all usability issues/recommendations for improving the user experience as (UI) bugs in the bug tracking system. Each bug contained steps on how to reproduce the issue, a detailed list of the usability findings and the recommendations for how to fix the usability issue. Usability assigned the bug to the person who owned that particular area in the product, and then when it was fixed and the new code was checked in, usability received a notification of the fix. Because usability had filed a bug on the UI change, that also meant closing the usability bugs following the same bug filing procedure as the product team - the person who opened the bug was responsible for verifying that the change indeed fixed the problem, and then they were responsible for assigning the bug to a Test team member for closing. In essence, we had final say on the bug! To further enhance tracking, we filed the UI bugs before distributing the report so that the bug ID number could be written alongside each issue listed in the usability report (see Table 1). Conduct Competitive Evaluations As previously mentioned, it was agreed that a competitive usability evaluation would be conducted against the incumbent guide product near the end of the development cycle. For this study, we used as many of the benchmarking tasks as possible, since those tasks were common tasks that users could perform with either product. Next, 10 participants were recruited for the study by an outside agency and these participants were asked to come into the labs to use both products (in a living room setting of course). The order in which users interacted with 16
5 the products was counterbalanced to control for order effects. Feedback from the participants was obtained through the verbal protocol method, and metrics such as task success, number of errors, and ability to complete tasks within the time limit were recorded. Participants completed post-task and post-test questionnaires to gather subjective feedback as well. Due to the fact that the results turned out in favor of the IPG 1.0 product, usability wanted to evangelize the success of the UCD process throughout the organization. A division-wide usability presentation was held. Once the data collection was complete, usability analyzed the results and presented the findings in a side-by-side comparison slide presentation. Video highlights were used to help illustrate the findings and make the presentation a little more interesting for the audience. Results and Discussion Overall, usability ran three benchmark studies on the IPG product and one competitive study during the year of development. Over 40 major UI/usability bugs were filed in the bug tracking system. In the end, the development team had made three full iterations on the design and had addressed over 90% of all usability issues identified through the research. Ultimately, we found that almost 90% of users who evaluated our product in the labs found the IPG product to be easier to use, required fewer steps to complete tasks, completed tasks more easily, and found our user experience more visually pleasing than the incumbent guide. Looking Back What Could We Have Done Better? It is always important to reflect on your work to see where there is room for improvement for future projects. We have identified a few key learnings based on our experience that include: Try to run the competitive study before the product ships so that any feedback you get can be used for improving the user experience in the current version. In our case, we had to use what we learned from the competitive study in future versions of our product because the competitive study was conducted after IPG 1.0 had shipped. Find an informal usability review methodology that evaluates the user experience before conducting the benchmark studies. Since shipping IPG 1.0, the usability group has worked really hard to find an informal technique that works well with the product team. We now use an adapted methodology from Wharton et al., which is called the Streamlined Cognitive Walkthrough (SCW) (Spencer, 2000). Usability has found this methodology to be highly successful for identifying usability issues that can be easily fixed before putting the product in front of users. The other benefit the SCW offered was increased trust between the usability engineer, the program manager, and the UI designer. Due to the SCW methodology s success, usability now requires running a SCW on each user experience before it is put in front of real users in a costly lab setting. Conduct more field research. During the creation of IPG 1.0, we had to rely on our previous experience from related site visit work on satellite and cable because we had to forego doing site visits specific to IPG in lieu of spending time with the development team in the planning/scheduling meetings defining the milestones. Now that the relationships have been forged, we recommend conducting more user research and site visits during the planning stage of the development process. Fortunately, because the UCD approach was so successful, it helped the usability group justify more money for these types of projects for the future so we will have enough resources to continue spending time in the planning meetings and conduct the up-front user research. Increase your involvement with the planning/scheduling meetings by writing a formal usability plan for the release so that members of the product team have a document to which they can refer. Since shipping IPG 1.0, we have written a formal usability plan for our other major shipping product and have worked with the product team to re-order development tasks so more chunks of the user experience are implemented at one time (as opposed to the tasks being spread out during the implementation phase). Since the feature set for this new project was much larger than IPG 1.0, this has helped us get some of the features in front of users even earlier in the development process. 17
6 Conclusions The UCD philosophy incorporates user concerns and advocacy from the beginning of the design process and dictates that the needs of the user should be foremost in any design decision. The results as presented in this case study showed that a UCD approach was successfully adopted in a development cycle and provided evidence that it positively impacted the overall user experience of the IPG product. This case study also reinforces that if usability engineers want a team to adopt a UCD approach during the development cycle of a product, they must be willing to work at it with the team. Understanding the development team s processes and the constraints in which they develop user experiences will go a long way to ensure that the tactics you take to influence the user experience will be positively received. References Datamonitor, "The Evolution of the EPG: Electronic Program Guide Develop in Europe and the US", September. ISO/IEC Human-Centred Design Processes for Interactive Systems, ISO/IEC 13407: 1999 (E). Rosenbaum, S., J. Rohn & J. Humburg A Toolkit for Strategic Usability: Results from Workshops, Panels and Surveys. Proceedings from the Conference on Human Factors and Computer Systems, The Hague, Netherlands, April 1-6, pp Rosenbaum, S., C. Wilson, T. Jokela, J. Rohn, T. Smith & K. Vredenburg Usability in Practice: User Experience Lifecycle Evolution and Revolution. Proceedings from the Conference on Human Factors and Computer Systems, Minneapolis, Minnesota, April 20-25, pp Spencer, R The Streamlined Cognitive Walkthrough Method, Working Around Social Constraints Encountered in a Software Development Company. Proceedings from the Conference on Human Factors in Computing Systems, The Hague, Netherlands, April 1-6, pp Wharton, C. W., J. Reiman, C. Lewis, & P. Polson The cognitive walkthrough method: A practitioner s guide. In J. K. Nielson, & R. L. Mack (Eds.) Usability Inspection Methods. Wiley, New York. 18
IBM s approach. Ease of Use. Total user experience. UCD Principles - IBM. What is the distinction between ease of use and UCD? Total User Experience
IBM s approach Total user experiences Ease of Use Total User Experience through Principles Processes and Tools Total User Experience Everything the user sees, hears, and touches Get Order Unpack Find Install
More informationChoosing the Right Usability Tool (the right technique for the right problem)
Choosing the Right Usability Tool (the right technique for the right problem) User Friendly 2005 December 18, Shanghai Whitney Quesenbery Whitney Interactive Design www.wqusability.com Daniel Szuc Apogee
More information2/18/2009. Introducing Interactive Systems Design and Evaluation: Usability and Users First. Outlines. What is an interactive system
Introducing Interactive Systems Design and Evaluation: Usability and Users First Ahmed Seffah Human-Centered Software Engineering Group Department of Computer Science and Software Engineering Concordia
More informationUSER-CENTERED DESIGN KRANACK / DESIGN 4
USER-CENTERED DESIGN WHAT IS USER-CENTERED DESIGN? User-centered design (UCD) is an approach to design that grounds the process in information about the people who will use the product. UCD processes focus
More informationStandard Glossary of Terms used in Software Testing. Version 3.2. Foundation Extension - Usability Terms
Standard Glossary of Terms used in Software Testing Version 3.2 Foundation Extension - Usability Terms International Software Testing Qualifications Board Copyright Notice This document may be copied in
More informationneeds, wants, and limitations
In broad terms Process in which the needs, wants, and limitations of end users of a product are given extensive attention at each stage of the design process. ISO principles which says that the design
More informationUsability Evaluation as a Component of the OPEN Development Framework
Usability Evaluation as a Component of the OPEN Development Framework John Eklund Access Testing Centre and The University of Sydney 112 Alexander Street, Crows Nest NSW 2065 Australia johne@testingcentre.com
More informationVolume Licensing Program Now Available. Announcing the Release of OnePager Pro and Express 3.2. Welcome! Inside this issue: (See Volume on page 3)
Volume 1, Issue 1 April 30, 2010 Announcing the Release of OnePager Pro and Express 3.2 Chronicle Graphics OnePager Pro now features multi-level time axes, fillable milestone symbols, and an interactive
More informationEvaluation in Information Visualization. An Introduction to Information Visualization Techniques for Exploring Large Database. Jing Yang Fall 2005
An Introduction to Information Visualization Techniques for Exploring Large Database Jing Yang Fall 2005 1 Evaluation in Information Visualization Class 3 2 1 Motivation What are the advantages and limitations
More informationAgile Accessibility. Presenters: Ensuring accessibility throughout the Agile development process
Agile Accessibility Ensuring accessibility throughout the Agile development process Presenters: Andrew Nielson, CSM, PMP, MPA Ann Marie Davis, CSM, PMP, M. Ed. Cammie Truesdell, M. Ed. Overview What is
More informationCOGNITIVE WALKTHROUGH REPORT. The International Children s Digital Library
COGNITIVE WALKTHROUGH REPORT The International Children s Digital Library Jessica Espejel 2/27/2014 P a g e 1 Table of Contents Table of Contents... 1 Executive Summary... 2 Introduction... 3 Methodology...
More informationUser Testing Study: Collaborizm.com. Jessica Espejel, Megan Koontz, Lauren Restivo. LIS 644: Usability Theory and Practice
User Testing Study: Collaborizm.com Jessica Espejel, Megan Koontz, Lauren Restivo LIS 644: Usability Theory and Practice TABLE OF CONTENTS EXECUTIVE SUMMARY... 3 INTRODUCTION... 4 METHODOLOGY... 5 FINDINGS
More informationThe Role of User U. Centered Design Process in Understanding Users. Andrea F. Kravetz VP User Centered Design Elsevier August 2005
The Role of User U Centered Design Process in Understanding Users Andrea F. Kravetz VP User Centered Design Elsevier August 2005 2 Agenda User Centered Design: what is it and why is it important? User
More informationUser-centered design in technical communication
User-centered design in technical communication Information designer & information architect Sharing knowledge is better than having it. Tekom - TC Europe November 19-20, 2003 Nov. 19-20, 2003 User-centered
More informationFoundation Level Syllabus Usability Tester Sample Exam
Foundation Level Syllabus Usability Tester Sample Exam Version 2017 Provided by German Testing Board Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged.
More informationPromoting Component Architectures in a Dysfunctional Organization
Promoting Component Architectures in a Dysfunctional Organization by Raj Kesarapalli Product Manager Rational Software When I first began my career as a software developer, I didn't quite understand what
More informationEvaluation and Design Issues of Nordic DC Metadata Creation Tool
Evaluation and Design Issues of Nordic DC Metadata Creation Tool Preben Hansen SICS Swedish Institute of computer Science Box 1264, SE-164 29 Kista, Sweden preben@sics.se Abstract This paper presents results
More informationAnalytical &! Empirical Evaluation
Analytical &! Empirical Evaluation Informatics 132 5/22/2012 TODAY Evaluation Due: A3 Paper Prototyping UPCOMING Friday: Group Project Time Monday: Memorial Day, No Class Wednesday: HCI in the Real World
More informationPUTTING THE CUSTOMER FIRST: USER CENTERED DESIGN
PUTTING THE CUSTOMER FIRST: USER CENTERED DESIGN icidigital.com 1 Case Study DEFINE icidigital was chosen as a trusted creative partner to design a forward-thinking suite of sites for AICPA, one of the
More informationcs465 principles of user interface design, implementation and evaluation
cs465 principles of user interface design, implementation and evaluation Karrie G. Karahalios 24. September 2008 1. Heuristic Evaluation 2. Cognitive Walkthrough 3. Discuss Homework 3 4. Discuss Projects
More informationCognitive Walkthrough
1 Cognitive Walkthrough C. Wharton, J. Rieman, C. Lewis and P. Polson, The Cognitive Walkthrough Method: A Practitioner s Guide, in J. Nielsen and R. Mack (eds.), Usability Inspection Methods, John Wiley
More informationMarketing Performance in Executive perspective on the strategy and effectiveness of marketing
Executive perspective on the strategy and effectiveness of email marketing Table of Contents Introduction 2 The state of email marketing performance 3 Successfully achieving objectives 4 Most important
More informationAcurian on. The Role of Technology in Patient Recruitment
Acurian on The Role of Technology in Patient Recruitment Wearables smartphones social networks the list of new technological tools available to patients and healthcare providers goes on and on. Many clinical
More informationHTC.com THE USER EXPERIENCE AWARDS SUBMISSION
HTC.com Project Submission Title: HTC.com Organization and Client Name: Fantasy Interactive and HTC Contact Person: Johnny Michaelsen - johnny.michaelsen@f-i.com Project URL: http://www.htc.com/www/ Case
More informationPortfolio. Mihai Marin
Portfolio Mihai Marin Case Study No. 1 AXA Insurance - Travel Insurance: Redesign Quote & Buy Journey The Brief As a result of the Travel Quote & Buy journey not being fully mobile optimised, it was becoming
More informationDigital Marketing Manager, Marketing Manager, Agency Owner. Bachelors in Marketing, Advertising, Communications, or equivalent experience
Persona name Amanda Industry, geographic or other segments B2B Roles Digital Marketing Manager, Marketing Manager, Agency Owner Reports to VP Marketing or Agency Owner Education Bachelors in Marketing,
More informationThe Pluralistic Usability Walk-Through Method S. Riihiaho Helsinki University of Technology P.O. Box 5400, FIN HUT
The Pluralistic Usability Walk-Through Method S. Riihiaho Helsinki University of Technology P.O. Box 5400, FIN-02015 HUT sirpa.riihiaho@hut.fi Abstract Pluralistic usability walkthrough is a usability
More informationMeet our Example Buyer Persona Adele Revella, CEO
Meet our Example Buyer Persona Adele Revella, CEO 685 SPRING STREET, NO. 200 FRIDAY HARBOR, WA 98250 W WW.BUYERPERSONA.COM You need to hear your buyer s story Take me back to the day when you first started
More informationSWEN 444 Human Centered Requirements and Design Project Breakdown
SWEN 444 Human Centered Requirements and Design Project Breakdown Team Status Reports: (starting in Week 2) Your team will report weekly project status to your instructor, and as you wish, capture other
More informationTable of contents. TOOLKIT for Making Written Material Clear and Effective
TOOLKIT for Making Written Material Clear and Effective Table of contents U.S. Department of Health & Human Services Centers for Medicare & Medicaid Services Table of contents Overview of the Toolkit The
More informationUse Case Study: Reducing Patient No-Shows. Geisinger Health System Central and Northeastern Pennsylvania
Use Case Study: Reducing Patient No-Shows Geisinger Health System Central and Northeastern Pennsylvania February 2014 Geisinger is a leading integrated health services organization widely recognized for
More informationFoundation Level Syllabus Usability Tester Sample Exam Answers
Foundation Level Syllabus Usability Tester Sample Exam s Version 2017 Provided by German Testing Board Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged.
More informationImproving the Usability of the University of Rochester River Campus Libraries Web Sites
River Campus Libraries Improving the Usability of the University of Rochester River Campus Libraries Web Sites Susan K. Cardinal April 6, 2008 New Orleans ACS Meeting Outline What is Usability? Why is
More informationCognitive Walkthrough
1 1 Cognitive Walkthrough C. Wharton, J. Rieman, C. Lewis and P. Polson, The Cognitive Walkthrough Method: A Practitioner s Guide, in J. Nielsen and R. Mack (eds.), Usability Inspection Methods, John Wiley
More informationVIDEO 1: WHY IS THE USER EXPERIENCE CRITICAL TO CONTEXTUAL MARKETING?
VIDEO 1: WHY IS THE USER EXPERIENCE CRITICAL TO CONTEXTUAL MARKETING? Hello again! I m Angela with HubSpot Academy. In this class, you re going to learn about the user experience. Why is the user experience
More informationThe LUCID Design Framework (Logical User Centered Interaction Design)
The LUCID Design Framework (Logical User Centered Interaction Design) developed by Cognetics Corporation LUCID Logical User Centered Interaction Design began as a way of describing the approach to interface
More informationINF 231 Project 1 (Customer: Dr. Geoff Ward) Fernando S., Hosub L., Roeland S., Ya-Wen L., Sunakshi G., Michael W. B., Sowmya J.
INF 231 Project 1 (Customer: Dr. Geoff Ward) Fernando S., Hosub L., Roeland S., Ya-Wen L., Sunakshi G., Michael W. B., Sowmya J. Today s Objectives What have we achieved so far? How we did that? Why did
More informationHow to Conduct a Heuristic Evaluation
Page 1 of 9 useit.com Papers and Essays Heuristic Evaluation How to conduct a heuristic evaluation How to Conduct a Heuristic Evaluation by Jakob Nielsen Heuristic evaluation (Nielsen and Molich, 1990;
More informationOverview of the course. User-Centred Design. Group. Practical issue. Writting the report. Project work. Fang Chen
Overview of the course User-Centred Design Fang Chen 6 lectures, 3 hr each. L 1: April 6, 9-12, user-centered design concept L2: April 14, 9-12, usability concept L3. user-centered requirement study L4.
More informationCASE STUDY IT. Albumprinter Adopting Redgate DLM
CASE STUDY IT Albumprinter Adopting Redgate DLM "Once the team saw they could deploy all their database changes error-free at the click of a button, with no more manual scripts, it spread by word of mouth.
More informationHeuristic evaluation is a usability inspection technique developed by Jakob Nielsen. The original set of heuristics was derived empirically from an
Heuristic evaluation is a usability inspection technique developed by Jakob Nielsen. The original set of heuristics was derived empirically from an analysis of 249 usability problems (Nielsen, 1994). -Preece
More information"Charting the Course... ITIL 2011 Managing Across the Lifecycle ( MALC ) Course Summary
Course Summary Description ITIL is a set of best practices guidance that has become a worldwide-adopted framework for IT Service Management by many Public & Private Organizations. Since early 1990, ITIL
More informationUsability Report. Author: Stephen Varnado Version: 1.0 Date: November 24, 2014
Usability Report Author: Stephen Varnado Version: 1.0 Date: November 24, 2014 2 Table of Contents Executive summary... 3 Introduction... 3 Methodology... 3 Usability test results... 4 Effectiveness ratings
More informationUsability Testing CS 4501 / 6501 Software Testing
Usability Testing CS 4501 / 6501 Software Testing [Nielsen Normal Group, https://www.nngroup.com/articles/usability-101-introduction-to-usability/] [TechSmith, Usability Basics: An Overview] [Ginny Redish,
More informationProblem and Solution Overview: An elegant task management solution, that saves busy people time.
An elegant task management solution, that saves busy people time. Team: Anne Aoki: Storyboarding, design, user studies, writing Alex Anderson: User studies, design Matt Willden: Ideation, writing, user
More informationStep-by-Step Instructions for Pre-Work
Step-by-Step Instructions for Pre-Work We recommend that you schedule 20-25 hours to complete your pre-work assignment. Please track your hours. We will ask you to record them on your pre-work evaluation
More informationEvaluation techniques 1
IMS5302 Human-computer interaction Lecture 6 Other Evaluation Techniques Overview Other evaluation methods Expert reviews Field studies Developing scenarios Selecting an evaluation method IMS5302 2 Scenarios
More informationEvaluation techniques 1
IMS5302 Human- computer interaction Lecture 6 Other Evaluation Techniques Overview Other evaluation methods Expert reviews Field studies Developing scenarios Selecting an evaluation method IMS5302 2 Scenarios
More informationCS 160: Evaluation. Outline. Outline. Iterative Design. Preparing for a User Test. User Test
CS 160: Evaluation Professor John Canny Spring 2006 2/15/2006 1 2/15/2006 2 Iterative Design Prototype low-fi paper, DENIM Design task analysis contextual inquiry scenarios sketching 2/15/2006 3 Evaluate
More informationCS 160: Evaluation. Professor John Canny Spring /15/2006 1
CS 160: Evaluation Professor John Canny Spring 2006 2/15/2006 1 Outline User testing process Severity and Cost ratings Discount usability methods Heuristic evaluation HE vs. user testing 2/15/2006 2 Outline
More informationCase study on PhoneGap / Apache Cordova
Chapter 1 Case study on PhoneGap / Apache Cordova 1.1 Introduction to PhoneGap / Apache Cordova PhoneGap is a free and open source framework that allows you to create mobile applications in a cross platform
More informationTIE Project Work on Pervasive Systems
TIE-13011 Project Work on Pervasive Systems 2013-2014 Workshop on UX evaluation, 3.12.2013 Thomas Olsson Groups answers to warm-up questions How do you validate that the product matches the needs and requirements
More informationPerfect Timing. Alejandra Pardo : Manager Andrew Emrazian : Testing Brant Nielsen : Design Eric Budd : Documentation
Perfect Timing Alejandra Pardo : Manager Andrew Emrazian : Testing Brant Nielsen : Design Eric Budd : Documentation Problem & Solution College students do their best to plan out their daily tasks, but
More informationh(p://ihm.tumblr.com/post/ /word- cloud- for- hci- human- computer- interacbon CS5340 Human-Computer Interaction ! January 31, 2013!
h(p://ihm.tumblr.com/post/105778492/word- cloud- for- hci- human- computer- interacbon CS5340 Human-Computer Interaction January 31, 2013 Today s Class Administrivia User-centered Design Establishing Requirements
More informationData Governance Quick Start
Service Offering Data Governance Quick Start Congratulations! You ve been named the Data Governance Leader Now What? Benefits Accelerate the initiation of your Data Governance program with an industry
More informationIntegrating User Evaluation into Software Development Environments
Integrating User Evaluation into Software Development Environments Yael Dubinsky, Tiziana Catarci, Shah Rukh Humayoun, and Stephen Kimani Dipartimento di Informatica e Sistemistica Università di Roma "La
More informationCurtin University School of Design. Internet Usability Design 391. Chapter 1 Introduction to Usability Design. By Joel Day
Curtin University School of Design Internet Usability Design 391 Chapter 1 Introduction to Usability Design By Joel Day Internet Usability Design 391 Chapter 1: Usability Introduction Page 2 of 6 What
More informationDesign Iteration: From Evidence to Design. Slides originally by: Dick Henneman
Design Iteration: From Evidence to Design Slides originally by: Dick Henneman Foundations: MS-HCI @ Georgia Tech Context of use Context of development Analyze/ Evaluate Design/B uild Evidence-Based Design
More informationReview, Adapt, Improve. April 3, 2018
Review, Adapt, Improve April 3, 2018 JOHN DUCKWITZ Client Success Team Lead Sunlight is said to be the best of disinfectants. Justice Louis Brandeis A healthy communications and outreach strategy works
More informationConcepts of Usability. Usability Testing. Usability concept ISO/IS What is context? What is context? What is usability? How to measure it?
Concepts of Usability Usability Testing What is usability? How to measure it? Fang Chen ISO/IS 9241 Usability concept The extent to which a product can be used by specified users to achieve specified goals
More informationUsability Testing Review
Usability Testing Summary Usability Testing Review Alexis Anand, Katrina Ezis, Ma Shixuan, Cynthia Zhang CSE 440 Section AD All of our usability tests were conducted with students from Computer Science
More informationBEYOND THE LIVING ROOM
PREPARED EXCLUSIVELY FOR THE BIG DATA SUMMIT BEYOND THE LIVING ROOM INSIGHTS FROM CATCH-UP TV VIEWING For this year s Variety Big Data Summit, Ooyala conducted some exclusive research into the viewership
More informationOptimize Online Testing for Site Optimization: 101. White Paper. White Paper Webtrends 2014 Webtrends, Inc. All Rights Reserved
Optimize Online Testing for Site Optimization: 101 White Paper Overview Understanding the differences between A/B and multivariate testing helps marketers select the proper method for reaching optimization
More informationIteration and Refinement 02/18/2003
Iteration and Refinement 02/18/2003 1. Case Study: Columbia House Columbiahouse.com has some unique challenges. Although not many people have visited the site, almost everyone has been a member of their
More information3-Part Guide to Developing a BYOD Strategy
An IT admin s guide to implementation considerations and best practices when developing a BYOD strategy As the consumerization of IT continues to grow, so has the popularity of Bring Your Own Device (BYOD)
More informationWoolwich CHC adopts the CIW as a strategic planning tool. A tool to shift the conversation. Using the CIW to advance community health and wellbeing
Advancing health and wellbeing for individuals, families and communities AOHC and its members are using the Canadian Index of Wellbeing (CIW) as a powerful tool to support their efforts in making health
More informationCustomize. Building a Customer Portal Using Business Portal. Microsoft Dynamics GP. White Paper
Customize Microsoft Dynamics GP Building a Customer Portal Using Business Portal White Paper Helps you implement a customer portal and create web pages and web parts specifically designed for your customers.
More informationApplying Usability to elearning
Applying Usability to elearning 6 December 08 John Wooden, PhD Director of Usability Services Fredrickson Communications jwooden@fredcomm.com We make information useful! About Fredrickson Communications
More informationIBM MANY EYES USABILITY STUDY
IBM MANY EYES USABILITY STUDY Team Six: Rod Myers Dane Petersen Jay Steele Joe Wilkerson December 2, 2008 I543 Interaction Design Methods Fall 2008 Dr. Shaowen Bardzell EXECUTIVE SUMMARY We asked three
More informationCS Equalizing Society - Assignment 8. Interactive Hi-fi Prototype
CS 147 - Equalizing Society - Assignment 8 Interactive Hi-fi Prototype Crystal Escolero - Design and Product Management Jessica Guo - Development and User Testing Trevor Rex - Development and User Testing
More informationUX Research in the Product Lifecycle
UX Research in the Product Lifecycle I incorporate how users work into the product early, frequently and iteratively throughout the development lifecycle. This means selecting from a suite of methods and
More informationSFU CMPT week 11
SFU CMPT-363 2004-2 week 11 Manuel Zahariev E-mail: manuelz@cs.sfu.ca Based on course material from Arthur Kirkpatrick, Alissa Antle and Paul Hibbits July 21, 2004 1 Analytic Methods Advantages can be
More informationStep by Step Instructions for Pre Work
Step by Step Instructions for Pre Work We recommend that you schedule 20 25 hours to complete your pre work assignment. Please track your hours. We will ask you to record them on your pre work evaluation
More informationHP environmental messaging
HP environmental messaging Promise Definition Designing for the environment As a technology industry environmental leader for decades, HP is making a difference with a comprehensive Design for the Environment
More informationMiPhone Phone Usage Tracking
MiPhone Phone Usage Tracking Team Scott Strong Designer Shane Miller Designer Sierra Anderson Designer Problem & Solution This project began as an effort to deter people from using their phones in class.
More informationCognitive Walkthrough Evaluation Yale University School of Art
www.campusconnections.us Cognitive Walkthrough Evaluation Yale University School of Art Allison Hall LIS 644 - Usability Theory & Practice Pratt SILS 1 Executive Summary Yale University is one of the most
More informationHello everyone, how are you enjoying the conference so far? Excellent!
1 Hello everyone, how are you enjoying the conference so far? Excellent! I m Andy Sutton, the e-builder User Experience Lead, and I m here to talk to you about User Experience. In this session, we re going
More informationSYSPRO s Fluid Interface Design
SYSPRO s Fluid Interface Design Introduction The world of computer-user interaction has come a long way since the beginning of the Graphical User Interface, but still most application interfaces are not
More informationThe Power to Prototype
The Power to Prototype The art and science of prototyping is observed across different industries. Many professionals across diverse domains love to associate themselves with the know-how of prototyping.
More informationDelivery guide: SAGE Video
Delivery guide: SAGE Video Our Trainers have put together this training delivery guide to accompany the SAGE Video training presentation. If you plan on delivering the training presentation to educate
More informationCHAPTER 4 HUMAN FACTOR BASED USER INTERFACE DESIGN
CHAPTER 4 HUMAN FACTOR BASED USER INTERFACE DESIGN 4.1 Introduction Today one of the most important concerns is how to use the system with effectiveness, efficiency and satisfaction. The ease or comfort
More information6 TOOLS FOR A COMPLETE MARKETING WORKFLOW
6 S FOR A COMPLETE MARKETING WORKFLOW 01 6 S FOR A COMPLETE MARKETING WORKFLOW FROM ALEXA DIFFICULTY DIFFICULTY MATRIX OVERLAP 6 S FOR A COMPLETE MARKETING WORKFLOW 02 INTRODUCTION Marketers use countless
More informationUsability Report for Online Writing Portfolio
Usability Report for Online Writing Portfolio October 30, 2012 WR 305.01 Written By: Kelsey Carper I pledge on my honor that I have not given or received any unauthorized assistance in the completion of
More informationTHE REAL ROOT CAUSES OF BREACHES. Security and IT Pros at Odds Over AppSec
THE REAL ROOT CAUSES OF BREACHES Security and IT Pros at Odds Over AppSec EXECUTIVE SUMMARY Breaches still happen, even with today s intense focus on security. According to Verizon s 2016 Data Breach Investigation
More informationRequirements Gathering: User Stories Not Just an Agile Tool
Copyright 2016 Loft9. All Rights Reserved. 1 Loft9Consulting.com LOFT9 BUSINESS INSIGHTS Requirements Gathering: User Stories Not Just an Agile Tool Copyright 2016 Loft9. All Rights Reserved. 2 Loft9Consulting.com
More informationOverview: Introducing Usability and User-Centered Design (UCD)
Overview: Introducing Usability and User-Centered Design (UCD) Janice (Ginny) Redish, Ph.D. President Redish & Associates, Inc. 6820 Winterberry Lane Bethesda, MD 20817 voice: 301-229-3039 fax: 301-229-2971
More informationUSABILITY REPORT A REPORT OF USABILITY FINDINGS FOR OFF THE BEATEN PATH WEBSITE
USABILITY REPORT A REPORT OF USABILITY FINDINGS FOR OFF THE BEATEN PATH WEBSITE Prepared by: Cori Vandygriff, Joseph Kmetz, Cammy Herman, and Kate DeBusk To: Off the Beaten Path Team From: Cammy Herman
More informationDataverse Usability Evaluation: Findings & Recommendations. Presented by Eric Gibbs Lin Lin Elizabeth Quigley
Dataverse Usability Evaluation: Findings & Recommendations Presented by Eric Gibbs Lin Lin Elizabeth Quigley Agenda Introduction Scenarios Findings & Recommendations Next Steps Introduction Scenarios Scenario
More informationWhite Paper. Incorporating Usability Experts with Your Software Development Lifecycle: Benefits and ROI Situated Research All Rights Reserved
White Paper Incorporating Usability Experts with Your Software Development Lifecycle: Benefits and ROI 2018 Situated Research All Rights Reserved Learnability, efficiency, safety, effectiveness, memorability
More informationOverview of Today s Lecture. Analytical Evaluation / Usability Testing. ex: find a book at Amazon.ca via search
Overview of Today s Lecture Analytical Evaluation / Usability Testing November 17, 2017 Analytical Evaluation Inspections Recapping cognitive walkthrough Heuristic evaluation Performance modelling 1 2
More informationResponsive Redesign dispatch.com 10tv.com thisweeknews.com
Responsive Redesign 2014 dispatch.com 10tv.com thisweeknews.com Project Goals Establish a one web content strategy Share templates and interaction design patterns across brands Provide enough flexibility
More informationExperiences in Data Quality
Experiences in Data Quality MIT IQIS 2010 Annette Pence July 14-16, 2010 Approved for Public Release: 10-0686 Distribution Unlimited As a public interest company, MITRE works in partnership with the government
More informationStream Features Application Usability Test Report
Stream Features Application Usability Test Report Erin Norton and Katelyn Waara HU 4628: Usability and Instruction Writing Michigan Technological University April 24, 2013 Table of Contents Executive Summary
More informationebook library PAGE 1 HOW TO OPTIMIZE TRANSLATIONS AND ACCELERATE TIME TO MARKET
ebook library PAGE 1 HOW TO OPTIMIZE TRANSLATIONS AND ACCELERATE TIME TO MARKET Aligning people, process and technology to improve quality and speed to market To succeed in the global business arena, companies
More informationAssignment 8 rekindl Local Community (1:30PM) Meet The Team. Ryan C. Amanda L. Sara V. James C.
Hi-Fi Prototype Assignment 8 rekindl Local Community (1:30PM) Meet The Team Ryan C. Amanda L. Sara V. James C. Introduction Mission Statement: Reignite faded friendships. Problem Overview: Busy schedules
More informationRapid Research. For 2.0 Development. Presented by Kelly Goto
Rapid Research For 2.0 Development Presented by Kelly Goto kelly@gotomedia.com "Successful user experiences deliver a firm's value proposition -- the brand promise -- to customers in the most effective
More informationDescribe the benefits of incorporating design methodologies on projects for increased customer alignment and business impact.
SESSION OBJECTIVES Describe the benefits of incorporating design methodologies on projects for increased customer alignment and business impact. Identify and apply Design Thinking techniques for improving
More informationMeasuring Web 2.0. Business Challenges
Measuring Web 2.0 Technologies with WebTrends Marketing Lab Overview WebTrends 851 SW 6th Ave., Suite 700 Portland, OR 97204 1.503.294.7025 1.503.294.7130 fax US Toll Free 1-877-WebTrends (1-877-932-8736)
More informationUsability Testing Essentials
Usability Testing Essentials Ready, Set...Test! Carol M. Barnum ELSEVIER Amsterdam Boston Heidelberg London New York Oxford Paris San Diego San Francisco Singapore Sydney Tokyo Morgan Kaufmann is an imprint
More informationCanada Highlights. Cybersecurity: Do you know which protective measures will make your company cyber resilient?
Canada Highlights Cybersecurity: Do you know which protective measures will make your company cyber resilient? 21 st Global Information Security Survey 2018 2019 1 Canada highlights According to the EY
More information