Public Speaking Goes Mobile

Transcription

1 Public Speaking Goes Mobile SpeakEasy Allisyn Jones Sheilia Campbell Samar Aleem Paula Croisetiere Christine Wessels

2 Agenda Overview User Research Plan Usability Testing- Round 1 Usability Testing-Round 2 Conclusion

3 Background Initial Problem: Most professionals do not have the time they need to practice their presentations. Most people are nervous about performing before a large crowd. Our Initial Solution: An app that helps users plan, practice, and implement presentations or speeches.

4 Learning Goals Improve public speaking skills. Help individuals better prepare for presentations. Provide feedback to live, recorded and online presentations.

5 Original Prototype

6 Notifications

7 USER RESEARCH -PROJECT MANAGEMENT PLAN LEADS: ALLISYN JONES & SAMAR ALEEM

8 Kickoff Meeting Prioritize edits to prototype Collectively decide direction of the application Eliminate features of the application Strategize type of testing needed Name our app! Decide on prototype update software

9 Useful Activities on Collaborate for Kickoff Meeting

10 Useful Activities on Collaborate for Kickoff Meeting

11 Offline Discussion to Manage Edits and Ideas to Prototype

12 Goals User-centered design methods Details for further development of the prototype Selection of user research methods Logistical planning and procedures for the semester

13 Research Questions Determine what features are useful Determine if features are confusing SpeakEasy Expectation Demographic data

14 Usability Testing ROUND 1 LEAD: SHEILA JUCHA

15 Round 1- Goals/Methods/? s Blackboard Wiki team input Goal Question Method Determine feature/function priorities of app Rate each feature 1-5 on how valuable they find it What would be helpful to have on this application that you did not see when preparing for a presentation? Nano-usability test Focus group Determine what features are useful Determine if features are confusing Public Speaking App expectations Demographic data If you were preparing for a big presentation what feature would you use? How quickly were you able to use the features/functions? What would make you a repeat user? What types of public speaking sessions would you use it for? Was anything confusing on the application? What was your first impression of the application? How would the app make your life easier? What do you want to gain from using this application? How do you think a mobile application can help you to build or enhance your pubic speaking skills? Age, gender, education Technology level, own mobile device Nano-usability test focus group Nano-usability test Focus group Focus group Survey Survey

16 Round 1- Goals Observe how users approach the application Determine if SpeakEasy mobile app prototype is intuitive to accomplish Practice and Participate function tasks Determine what features are useful and/or confusing Determine what features are missing or should be added

17 Round 1-Methodology Functional Prototype Balsamiq pdf Link viewer and annotate for screen tap functions Test Script Google docs survey Micro-Usability Testing Face-to-face observations and interviews User by self with tasks, prototype, and survey Follow-up interview

18 Tester Demographics Selected Met persona characteristics Availability Gender 60% Female 40% Male Age Range 65% % Education 66% Bachelor s and Master s degrees 34% Doctoral degrees

19 Results- General Most users found app helpful and intuitive Most liked mobile, anytime, anywhere access Most liked the app for webinars and podcasts Users requested a tutorial or guide for features/icons

20 Results- Practice Request an option to turn off interactions at the bottom of the screen Request tool tips for features/icons Confusion with Announce option Thumbs up more positive than thumbs down With some guidance, liked practice function

21 Results- Participate Overall, users very positive about Participate Liked the selection aspect and scheduling Liked ability to switch tabs; presenter, slides, or both Did not like thumbs down, point system, or forced evaluation Chat function was confusing Screen was busy, users not sure what to do without guidance

22 Results- Additional Requests A summary of feedback A cumulative score The ability to see all participants A running time to see how long they have left A share function

23 New Home Screen User comment: Add Recent SpeakEasy Activity on the cycle of the home screen

24 New Screen Layout User comment: Provide an option for different views to scale down the screen

25 Share Option User comment: Provide screen sharing options

26 Webinar Option User Comment: Concentrate on webinars for application use

27 Usability Testing ROUND 2 LEADS: PAULA CROISETIERE CHRISTINE WESSELS

28 Usability Testing Overview Prototype revised based on Round 1 results input from team Nano-usability format Facilitators observe Testers perceptions documented Pre- post- test survey and observations analyzed Team approves updates Prototype revised

29 Goals Verify prototype improvements Check app intuitiveness Enhance group process Improve testing process Collect data using Likert scale Leverage existing data

30 Updates from Round 1 Prototype Simplified GUI Robust prototype Shorter survey(s) Facilitation more consistent Test Package Testing format Instructions Pre-Survey 1 Prototype Post-Survey Interview 2 3

31 Testing Participant Orientation Thank You for coming this far Begin by answering the pre-testing half of a survey. You are the Host for a webinar. Your role is to ensure everything is well planned, slides are available, everything is functioning, participants have been invited, the event has been advertised, etc.

32 Testing Continued Tester Task List 1. Schedule webinar 2. Set presenter options 3. Run participant demo 4. Introduce presenter 5. Poll participants 6. Role change 7. Comment on presentation 8. Return to home page 9. Explore 10.Complete posttesting survey You re Done!

33 Tester Demographics Gender 63% female 38% male Age range 50% yrs 38% 55+ yrs 13% yrs Education 63% Master s 25% Doctoral 13% Bachelor s

34 Tester Background Industry 25% Education/Academia, Healthcare, Govt 13% Business, IT Presentation Types 37% Training 32% Project Status Updates 11% Webinars, Sales / Proposals 5% Keynote, Religious Why Testers Enjoyed Webinars 36% Interactivity 29% Speaker 21% Visuals 14% Variety

35 Results Improvements 67% neutral App intuitiveness Likert scale 55% very difficult and difficult 22% easy

36 Possible Prototype Revisions More help functions roll overs, tool tips Ensure completion of presentation triggers evaluation Add additional functionality presentation setup; date and time scheduling, file loading, inviting of participants, and resource definitions webinar interactions; polling, participant questions, application sharing, comment timeline, and speaker comments

37 Round 2 Limitations Balsamiq prototyping software cannot: Create a fully functional mobile application and web-based Community of Practice Develop an environment where users can test out presentation functionality over a period of time Testing pool size

38 Leveraging Existing Resources YouTube Google Forms Google Drive LinkedIn Twitter

39 Leveraging Existing Research Webinars ARE Effective used for education and sales a cost effective means to disseminate content Effective -always (32%) -Frequently (16%)

40 Leveraging Existing Research Device Size does NOT Limit Functionality TalkPoint s mobile delivery grew 1200% in (without excluding interactive elements like Q&As, surveys, polling and social media functionality). Also: cost effective and greater reach

41 Conclusions Data shows: SpeakEasy is viable, and fills a niche 78% of the testers have not encountered an app like SpeakEasy Testers confused it s purpose and overlooked the help button Continue buttons are for games Button descriptions in Help section Develop features that support project updates and instructional presentations 32% of the testers give project updates 37% give training or instructional presentations

42 Next Steps Make prototype more intuitive and expand community aspect Focus on developing a fully functional SpeakEasy mobile application following positive usability testing Market the new SpeakEasy mobile application to communication departments of higher educational institutions, and training departments of businesses with limited training budgets and remote employees.