TIVOLI AUDIO MODEL ONE AM/FM TABLE RADIO M3 Design Heuristic Evaluation +1.512.218.8858 November 2013
CONTENTS Introduction What, why, and how? Evaluation Summary Overview of evaluation and final scoring Strengths & Opportunities Key takeaways of evaluation Evaluation Data Reference 2
INTRODUCTION M3 heuristic analysis process What is a heuristic evaluation? A heuristic evaluation is an usability assessment tool that M3 utilizes early in product development. It helps researchers, designers and engineers identify usability problems related to how the product functions and interacts with the user. The evaluator meticulously inspects the product and judges its compliance to predetermined usability and design criteria the heuristics. Why is it useful to you? M3 heuristic evaluation serves 3 key purposes: 1. Learn from your competition a method to create head-to-head comparisons to your competition, and understand the pros and cons of each product 2. Improves decision making - allows the development team to quickly and thoroughly understand how well a product performs to establish usability and design criteria for new product concepts 3. Concept evaluation tool a highly efficient scoring tool used to assess multiple concepts during development to objectively rank concept alternatives 3
INTRODUCTION M3 heuristic analysis process How does it work? M3 experts analyze a product against 9 evaluation criteria divided into 3 key stages. Each criteria is evaluated on a 5 point scale based on how the product behaves and what it communicates to its user. The results indicate how close to the 5-point optimum the product is designed from a human-centered perspective. Stage 1 Stage 2 Stage 3 Refer to Evaluation Data Reference section for detailed explanation of each stage and its associated criteria 4
HEURISTIC EVALUATION Tivoli Audio Model One Manual AM/FM Table Radio 5
HEURISTIC EVALUATION Tivoli Audio Model One Manual AM/FM Table Radio There are so many products on the market today that are jam packed with bells and whistles. My guess is that most of them probably don t offer much value to the user. The problem with this is that the product easily becomes confusing and overly complicated to use. I am curious as to who really takes advantage of all the features, or is this simply a case of a more is better marketing tactic? Whatever the reason that might be, it is truly refreshing when you cross paths with a product that is specifically designed to do just one thing and has one purpose. This issue s chosen product for heuristic evaluation is exactly that. Here s how it performs against our 9 criteria. 6
EVALUATION SUMMARY Tivoli Audio Model One Manual AM/FM Table Radio EVALUATION SUMMARY USABILITY & DESIGN CRITERIA SCORE * IMPRESSION ENGAGEMENT EXPERIENCE The product is ultra simple to use. Controls are presented to the user in a well thought out and concise manner. However, it s overly simplistic nature created some questionable layout and label design directions. Some relatively minor style over substance details hindered the product from scoring full marks. Unfortunately, the simple presentation of the product also leads to some minor usability compromises for the sake of aesthetic goals. Even though the product is missing some helpful features and userfriendly feedback cues, it is still perfectly usable, albeit with some initial learning and user adaptations. A simple product, but not so fool-proof during use. Opportunities for mistakes are relatively high, but the good news is that the user can still easily recover from serious errors. The overall product is consistently designed with a good color story, simple interaction, and a straightforward design. AESTHETICS 4 SIMPLICITY 4 LANGUAGE 4 APPROPRIATENESS 3 FLEXIBILITY 3 FEEDBACK 3 ERROR PREVENTION 3 RECOVERY 4 CONSISTENCY 5 * Scoring System 1 = Does not meet minimum usability and design criteria 2 = Almost meets the minimum usability and design criteria 3 = Meets minimum usability and design criteria 4 = Meets most of the usability and design criteria 5 = Meets optimum usability and design criteria 7
EVALUATION SUMMARY Tivoli Audio Model One Manual AM/FM Table Radio Final Average Score 3.7 (out of 5) M3 Heuristics Meets most of the usability and design criteria 8
STRENGTHS Key elements that should be embraced or improved upon Simple and straightforward design Logical layout / functionality, and intuitive analog operation Tells a consistent usability story throughout the entire product Branding, and label language are coherent and easy to read Appropriate design / usability story enhances the user experience Clear rubber feet detail is an example of a functional and inconspicuous feature that compliments the overall simple design Clear and simple labeling, and avoid any unnecessary graphics Like the rest of the product, the rear should also be carefully considered and appropriately designed 9
OPPORTUNITIES Key elements that should be reconsidered and redesigned Beware of where touch-point colors are applied on the product, so user is not confused during use. All indicator lights should be appropriately labeled. Allow appropriate amount of clearance space between graphic labels to ensure maximum legibility and minimal visual clutter. Consider using colors or other markings for groups of connectors to ensure easy identification and visual differentiation. Use of touch-point color on a non-touch-point feature is confusing All indicator lights should be labeled to avoid confusion Potentially relocate the headphone jack away from other little-used connectors or position it on the front face for easier access. All label placements should be appropriate, logical and highly visible with the feature Placement of graphics should be carefully considered to ensure clarity and minimal visual clutter Closely packed identical connectors could be frustrating for the user during access and identification 10
EVALUATION DATA REFERENCE
01 IMPRESSION Evaluation Guidelines The impression stage of a product experience in where the product conveys its look, feel and functional details. At this stage users formulate an overall perception of the product. This is where certain judgments are made about the perceived level of simplicity or complexity, and initial assessments of how usable the product is for it s intended use. AESTHETICS SIMPLICITY LANGUAGE Conveys appropriate look & feel - functional form and purposeful details Overall perception of product, visibility of information, and level of complexity in terms of product interaction Use of natural and logical words, labels, meaningful colors, and logical interactions Considerations: What does the overall appearance say to you? Is the form appropriate for its intended purpose? Is it form follows function or style over substance? Considerations: Does the product details convey a sense of simplicity? Is the product over-loaded with complex and confusing details? Are product information (e.g. brand, labels, buttons) clearly visible and readable? Does the product guide you through its use and operation? Considerations: Does the product communicate its use and operation in simple easy-to-understand terminology? Are the touch-points all well labeled and identified in a logical concise format and language? Are the product colors telling you something? 12
01 IMPRESSION Evaluation Worksheet AESTHETICS Conveys appropriate look & feel - functional form and purposeful details - Simple, clean and straightforward designed to do one thing right Solid, good weight, and well made build like a speaker unit Rubber feet provides a sturdy, and stable support Gloss white enclosure finish is subtle, and modern White power cord matches the product enclosure Some thoughts were given to the design and color specs on rear of the product Cheap power cord does not match the quality of the product The EMI ferrite suppressor attached to the power cord is large, and unappealing, especially encased in contrasting black plastic 13
01 IMPRESSION Evaluation Worksheet SIMPLICITY Overall perception of product, visibility of information, and level of complexity in terms of product interaction - Simple color palette tells an effective usability story: white = enclosure and label, green = interaction areas, silver = user touch-points Product warning label is molded on to rear enclosure approach is clean and clever Clean minimal printed graphics on front only brand / model Blatantly analogue old school simplicity and nostalgically elegant Co-existence of a power cord connector and a 12V DC connector is confusing Combining the AM and FM frequency scales together around the dial looks confusing and complicated, especially when neither scales are labeled 14
01 IMPRESSION Evaluation Worksheet LANGUAGE Use of natural and logical words, labels, meaningful colors, and logical interactions - Certainly more complexity in the rear of product, but all clearly labeled Names of designer and engineer printed on rear of product adds a touch of personal exclusivity and a premium quality to the product Good font size easy to read Classic style volume graphic adds a nostalgic touch to a classic product Great use of colors to communicate the product s usability story Front graphics between the band selector and tuner dial are overlapping each other s visual bounding box causing a sense of chaos and disorganization 15
02 ENGAGEMENT Evaluation Guidelines The engagement stage sets out to assess specific characteristics of the product in use. Users at this stage judge how well it feels and functions in relation to its intended use. This is where users assess the object s ability to provide feedback, and adapt to changing users and/or environmental conditions. APPROPRIATENESS FLEXIBILITY FEEDBACK Interaction is in context and relevant to the product - conveys a sense of familiarity and appropriate mental model Use of product is efficient and adaptable, based upon different users and environmental influences Product communicates its intentions at all times in regards to its state, mode, action, status, mistake and error, etc. Considerations: Does the way the product is used and operated make any logical sense in its given context? Does the product feel appropriate and relevant during use? Considerations: Does the product adapt to your needs, or do you need to adapt to the product? What happens if more than one person uses the same product? Can the product work efficiently under other intended environments and scenarios? Considerations: Does the product validate and confirm all interactions during use? Does the product notify the user on operation status? Does the product notify the user when there s an error? How does the product notify the user when a mistake has been made? Does all touch-points communicate its state and intentions? 16
02 ENGAGEMENT Evaluation Worksheet APPROPRIATENESS Interaction is in context and relevant to the product - conveys a sense of familiarity and appropriate mental model - Clear division of tasks setup in the rear of product / primary use mode in the front Recessed connector surface on rear of product allows the connector plugs to be hidden from sight Flat sided features on the power & source selector aids finger purchase and a sense of orientation A column of identical connectors on the rear appears neat and tidy, but rather difficult to quickly identify the correct one the icon labels help, but still not ideal since the recessed connectors are not on the same plane as the labels Frequency dial only rotates up to 180 degrees must turn the opposite direction to get to the other end of the scale Dial design deceivingly appears to consist of a central turn knob, and an outer turn ring (both in touch-point silver) easy to be interpreted as one for rapid control and the other for fine adjustment Questioning whether the silver outer turn ring is intended for use or not Headphone jack in the rear of product is inconvenient to access and locate, especially when the jack is positioned next to a group of other identical type of jacks Speaker audio is cut off if headphones are left plugged in could be confusing if the user forgets to unplug it 17
02 ENGAGEMENT Evaluation Worksheet FLEXIBILITY Use of product is efficient and adaptable, based upon different users and environmental influences - Good weight and rubber feet provide a stable and secure support for different surfaces Small enough to be portable No presets mean regular manual tuning Small size, but can t be used on the move due to power source AM mode must resort to the awkwardly located frequency scale below the main dial 18
02 ENGAGEMENT Evaluation Worksheet FEEDBACK Product communicates its intentions at all times in regards to its state, mode, action, status, mistake and error, etc. - All necessary information is immediately available at a glance Signal strength LED light provides useful feedback to user during station search Analogue tuning dial feels weighted and fluid, which provides more tactile and precise tuning feel than the digital versions Analogue volume dial offers a more precise volume control than the incremental adjustments on digital versions Visual and audible feedback confirmation on power status and tuning status Volume is too sensitive Turning volume to minimum will not power off product, which most would consider this to be an unconventional usage behavior for such a product Volume rotates pass indicated graphic Limited feedback during AUX mode signal strength LED indicator remains on is confusing No label next to signal strength LED indicator adds initial confusing 19
03 EXPERIENCE Evaluation Guidelines The experience stage sets out to assess a products ability to deal with or avoid error conditions. Users at this stage assess its ability to correct its mistakes. Finally, this stage is where users judge how well the product delivers consistency across its user touch points and performance. ERROR PREVENTION RECOVERY CONSISTENCY Product prevents problems before it happens Ability to correct mistakes - reversible actions and states Consistent delivery of Aesthetics, Language, Relevancy, and Feedback Considerations: How well does the overall product prevent user error from happening? How easy does the touch-points allow mistakes to be made? Considerations: Is it possible to recover from the mistake? How easy is it to correct the mistake? Considerations: Is the overall look & feel and context of use consistently conveyed throughout the product(s)? Is the use of language, icons, and colors consistently delivered on the product(s)? Does all the interaction/ touch-points share the same or similar usability story? Does the product consistently provide meaningful feedback no matter what and where the user is interacting? 20
03 EXPERIENCE Evaluation Worksheet ERROR PREVENTION Product prevents problems before it happens - Fine adjustment of frequency makes tuning process easier and quicker Simple interface layout and bold mode dials mean it s more difficult to cause user error in the first place Does not effectively communicate that it is set to AUX mode During AUX mode, volume control on product works independently to audio device s volume rather confusing and tedious to deal with 2 independent volume adjustments, and could fool user to think something could be broken upon connection with incorrect audio output level No audio from the speaker if headphones are left plugged in could be confusing if the user forgets to unplug it Multiple of identical connectors on rear of product make identification less efficient, and connection more cumbersome Connector label on rear of product sits proud from the actual recessed connection jacks could be less efficient to connect to, and possibly leading to user error 21
03 EXPERIENCE Evaluation Worksheet RECOVERY Ability to correct mistakes - reversible actions and states - Limited settings and functionality makes error recovery extremely easy, and relatively quick to diagnose the issue for example, if no sound from speaker, then it s either in AUX mode, or headphones are still plugged in Could be an unnecessary hassle to locate the problem for example, return back to power off mode, unplug all connections, and start again 22
03 EXPERIENCE Evaluation Worksheet CONSISTENCY Consistent delivery of Aesthetics, Language, Relevancy, and Feedback - Single color for all user touch-points Dial operation is consistently applied, it s simple to use, and familiar to the context of the product Consistent font and graphic styles used throughout the product Consistent usability story touch-point indicators are always molded, and text / details are always printed If outer tuning ring is not intended to be used as dial, why have the ring colored in silver touch-point color? 23
Heuristics