Usability Labs For Every Budget From $50 to $50,000

Transcription

1 Usability Labs For Every Budget From $50 to $50,000 Prepared for UPA-Boston Annual Conference May 26, 2009 Rich Buttiglieri, Usability Consultant Design & Usability Center

2 Why Have a Lab? There are two main functions of a lab: Records the session for later review Allows for observers to watch live Additional benefits: Helps to support the importance of usability in your organization Promotes customer loyalty showing them you are listening

3 Budget-Minded Labs (~ $50) Free desktop sharing (VNC, TeamViewer, etc) + $49 wireless intercom Allows for local observers Freedom to test anywhere HD-quality viewing Trade-offs Does not record the desktop session Connection may be unstable Observers need to be within a few hundred feet of participant Audio may be poor

4 Budget-Minded Labs (~ $400) Camtasia + Webcam w/microphone Records sessions only Moderator sits with participant HD recording Supports PIP Trade-offs No support for live observers

5 Budget-Minded Labs (~ $1,000) Camcorder + Wireless A/V sender Records sessions and allows local observers only (no remote web observers) Flexibility to test physical device, not just software Better suited for dedicated space Trade-offs Not broadcast over the internet for remote observers SD recording of test subject, the product Added cost for observer TV Moderator sits with participant

6 Budget-Minded Labs (~ $1,500) Software customized for usability testing (Morae) + WebCam Records sessions and allows remote observers PIP with desktop in HD Flexibility to test physical device, not just software Trade-offs Firewall issues for remote observers not on the same subnet

7 Budget-Minded Labs (~ $600/year) Fee-based web conferencing (WebEx, ShowMyPC, GoToPC, etc) Freedom to test anywhere Records sessions and allows remote observers Observers can be anywhere, not limited to the same LAN as participant Audio via VOIP (with USB microphones) or conference call (with speakerphones) HD-quality viewing Trade-offs Must tell observers to MUTE Participant can see list of attendees/observers if not blocked No picture-in-picture (pip)

8 Budget-Minded Labs ($1,500/year) Fee-based desktop sharing tailored to usability testing (UserVue) Records sessions and allows remote viewers All-in-one solution Software initiates phone call between moderator and participant and puts audio on internet for observers to hear Don t have to ask observers to MUTE Private chat between moderator and observers, participant doesn t see list of observers HD-quality viewing Trade-offs No pip Moderator must be out of testing room on their own phone Best with speakerphone at both ends

9 Mid-Priced Labs (~$5,000) A la Carte A/V Equipment Testing room Camera(s) + microphone(s) VGA splitter Tripod(s) or wall mount(s) Control room Scan converter Camera monitor(s) Video mixer Audio mixer Amp DVD recorder TV for observers (video feed) Trade-offs SD recordings Moderator sits with participant Local observers only

10 Mid-Priced Labs (~$10,000) Additions for moderator to sit out of the room: Testing room Add: speaker Add: Camera pan/tilt mount(s) Control room Add: Condenser microphone Add: Camera pan/tilt controls Add: VGA splitter + slave monitor Trade-offs SD recordings

11 High-End Labs (~$20,000) Turnkey solution - broadcast studio all-in-one device (NewTek TriCaster) Professional results with overlays and dual screen Supports multiple camera angles Web streaming of session live without firewall issues nor downloads Records to hard drive (tapeless) Trade-offs SD recordings Camera control and preview system Public Announcement (PA) system Additional hard drive storage

12 High-End Labs ($20,000+) Other turnkey solutions (Noldus, Ovo Studios) Built-in event logging and analysis software HD recordings Recordings to hard drive (tapeless) Trade-offs No support for remote observers

13 High-End Lab Accessories 2-way mirror Private in-ear chat (IFB system) Moderator can receive private messages from the control room Mostly hidden from participant s view Eye Tracking Equipment Fixed screen Mobile eye tracking modules $25,000 - $35,000 and up

14 Physical Space Considerations Locate permanent space (near front door, ground floor if possible, good signage!) Don t mix participants with observers (keep doors and walking paths as separated as possible) Make testing space configurable to all types of test participants (lighting control for low vision participants, wheelchair accessible, etc) Sound proofing techniques (panels, full deck walls, make observation room not adjacent to testing room)

15 Physical Space Considerations Make observation space comfortable (good chairs, good lighting, good HVAC control, popcorn!) 2-way mirror, or not? Camera placement

16 Putting It All Together DUC Labs Three room suite Control room Testing room 24 seat observation room

17 Putting It All Together DUC Labs Two room suite 7 seat observation/control room Testing room

18 Putting It All Together DUC Labs AMX Panel Camera Previews TriCaster Studio Public PA Note Taker PC Clone Monitor

19 Putting It All Together DUC Labs TV Channel 1: TriCaster Studio (SD)

20 Putting It All Together DUC Labs TV Channel 2: Morae Observer (HD)

21 Putting It All Together DUC Labs TV Channel 3: Participant Clone (HD)

22 Questions? Contact information: Rich Buttiglieri