Usability Test Plan for Blogger Mobile Application

Transcription

1 Usability Test Plan for Blogger Mobile Application Prepared For: Kevin McGowan, Project Sponsor Luke Bjerring, Software Engineer Completed By: Alanna Lewis B l o g g e r. c o m 7 / 2 0 /

2 Table of Contents Purpose... 3 User Profiles Summary... 4 User User User Problem Statement and Test Objectives... 5 Test Environment... 6 Methodology... 6 Number of Participants... 6 Length of Sessions... 7 Test Procedure... 7 Pre-Test Questionnaire and Lab Orientation... 7 User Specific Scenarios... 7 Post-Test Questionnaire and Closing... 7 Appendix A: User Scenarios and Tasks... 8 User 1 Scenarios... 8 Scenario Scenario Scenario User 2 Scenarios Scenario Scenario Scenario User 3 Scenarios Scenario Scenario Scenario Appendix B: Pre-Test Questionnaire Appendix C: Post-Test Questionnaires User 1 Post-Test Questionnaire User 2 Post-Test Questionnaire User 3 Post-Test Questionnaire Page 2

3 Purpose The purpose of the Blogger Mobile Application usability test is to collect feedback regarding how users use the Mobile application on both ios and Android mobile devices, including tablets, ipads and mobile phones. The usability test will also collect feedback about problems users may encounter while using the application, and what improvements users would like to see made to the Blogger mobile application in order to improve the user experience. Mr. Kevin McGowan, is the project sponsor, and is working closely with Luke Bjerring, the Blogger software engineer. They would like to learn about users experiences on Android devices as compared to their experiences on ios devices. The test plan describes: user profiles to recruit for testing problem statement and test objectives testing methodology test environment and equipment required in the usability center test procedure User scenarios o Appendix A: User Scenarios and Tasks questionnaires in appendices: o Appendix B: Pre-Test Questionnaire o Appendix C: Post-Test Questionnaire Page 3

4 User Profiles Summary To recruit prospective test participants, five user profiles were developed and submitted previously. Personas for each user were also developed and submitted. Three of these five user profiles will be the target for participant recruitment. The following user profiles were selected as they represent target audiences for customer expansion for Blogger. User 1 Bill Keeley, age 65 Goals: Grow his business customer base. Showcase specialty work done by his company. Educate potential clients about his products. I need to spread the word about my business, but I have very little time to invest in this project. I need to showcase my work and connect with new clients. This tool needs to be effective and efficient. User 2 Melanie Nicholls, age 22 Goals: Document her travels, and share her experiences with friends and family. Create a journal for herself. Upload pictures. I have lots of friends and family who want to follow my journey, many of who are looking for tips for their own trips. I want to be able to share my experiences with them, and have a journal of lasting memories for myself. User 3 Bethany Shaw, age 37 Goals: Host her resume. Keep a current portfolio online. Accept freelance jobs. I need a site that I can customize to get the right look and feel for me, but that I won t have to build from scratch, that s too much like my work. Page 4

5 Problem Statement and Test Objectives The usability test of the Blogger Mobile Application will provide qualitative and quantative data addressing Blogger s corporate management team and Blogger s software engineers interest in understanding the user experience across multiple platforms. We will assess the users experience with creating an account, personalizing a blog, and uploading photos across multiple devices, as well as overall satisfaction with the mobile application. Tasks for testing the Blogger Mobile Application will include: The general feeling/layout of the application: o Is the layout comparable across multiple devices and operating systems? Does the layout suggest the route first time users will take to create a blog? The procedure for creating an account: o Entering personal information does the application require reasonable information from users? o Are users able to easily create an account on all platforms including ios and Android devices? The procedure for personalizing a blog: o Are users able to easily select a template for their blog? o Are users able to personalize and edit a template? o Are users able to develop their own blog layout if they have prior knowledge with web design? o Is template display consistent and accurate across both Android and ios devices? o Is template selection and application intuitive for the user? The procedure for uploading photos: o Are users able to easily upload photos taken on their mobile device? o Are users able to easily upload photos from their on a mobile device? o Are upload procedures intuitive for the users? o Are upload procedures comparable across both Android and ios devices? Navigation: o Can users intuitively navigate the application across all devices? Satisfaction: o Which aspects do users like and which aspects do they dislike? o What would users like to see improved? o Are satisfaction levels consistent across all devices and operating systems? Page 5

6 This usability study will be designed to allow us to obtain mostly qualitative data. The questions used in the testing were developed from a range of user personas, including target audiences across a wide age range. The focus of the study will be task-oriented. Participants will be given a pre-test questionnaire to obtain information about their typical device usage, preferred operating system, prior usage of Blogger and/or similar blogging applications, as well as their expectations regarding the mobile application. Participants will be given scenarios that direct them to perform specific tasks that will help assess the issues listed in the questions above. Post-test questionnaires will be completed after each scenario, as well as a summative questionnaire with opportunity for user comments at the end of the testing session. Participants will be scheduled in sessions 90 minutes in length to include pre-test and post-test questionnaires. Users will be given one hour to complete 3 scenarios using two different devices. Before and after the scenarios are complete users will be given a 15 minute window to complete questionnaires. If users complete the scenarios in less than one hour, they will be able to begin the post-test questionnaire immediately, in order to obtain accurate responses. Test Environment The tests will be conducted in a full-scale usability lab in Toronto Ontario, at Consumer Vision Ltd. Participants will be recruited through the Consumer Vision Ltd in-house recruiting telephone survey centre. Logging and recording of sessions will be performed using Morae, with additional eye tracking technology provided by Consumer Vision Ltd. Methodology This section describes the testing methodology and scenarios that users will complete. A total of 12 participants will take part in the 3 scenarios in 90 minute sessions. Three users will participate in the test simultaneously. Number of Participants A total of 12 participants will partake in the test scenarios. Four users will be recruited from each of the three user profiles outlined previously. Participant age ranges may vary from the user profiles ± 3 years, and participants will be recruited based on similarity to the previously submitted user personas in order to achieve the desired demographic for testing. Page 6

7 Length of Sessions The total length of each session will be 90 minutes including: Pre-test questionnaire and usability lab orientation (15 minutes) Task scenarios (60 minutes) Post-test questionnaire and user comments (15 minutes) Test Procedure The test will begin with a pre-test questionnaire as well as a basic usability lab orientation. This will give users the opportunity to have any basic device operation questions or test procedure questions answered such as how to turn on the devices, which devices will be used, number of tests that will be conducted. Users will not be allowed to ask any questions about the scenarios or about the Blogger Mobile Application during this time. Following the orientation scenarios will be presented as described in the following sections, and afterwards a post-test questionnaire will be completed. Participants will have access to the Blogger Mobile application, Gmail, and the photo gallery on each device. All other applications will be locked using Kid Mode on the devices. This information will be stated during the orientation to reduce participant confusion and frustration during the scenarios. Pre-Test Questionnaire and Lab Orientation The moderator will welcome participants and provide the pre-test questionnaire (Appendix A). The moderator will allow the users to view the facilities and answer questions following the guidelines as listed above. The moderator will ask users to think out loud during the scenarios. Finally the moderator will have participants sign a video consent form before testing begins. User Specific Scenarios Users will be presented with 3 scenarios, each containing 2 similar tasks to complete on different devices (Appendix A). The scenarios will be suited to match their user profile as established during the screening process. Post-Test Questionnaire and Closing The moderator will ask the participant to complete the post-test questionnaire, collect any additional comments, and thank the participant for their involvement. Page 7

8 Appendix A: User Scenarios and Tasks User 1 Scenarios Users from the User 1 demographic will complete these scenarios using an ipad and an iphone. Scenario 1 You run a small business named Polytek Systems Limited which provides custom floor coatings for a wide range of clients. You have decided to start a website using Blogger to showcase your work. Complete the following tasks on the ipad provided in order to start your blog. Task 1 (ipad) Use the Blogger app loaded on the ipad to create an account with the following information. Your account information will be deleted following the test. Name: Provide your real first and last name for testing purposes. user1@gmail.com Password: create your own password according to the password requirements. Blog name: Polytek Ltd Web address: polytekltd.blogspot.com Task 2 (iphone) Use the Blogger app loaded on the iphone to create an account with the following information. Your account information will be deleted following the test. Name: Provide your real first and last name for testing purposes. user1@gmail.com Password: create your own password according to the password requirements. Blog name: Polytek Systems Web address: polyteksystems.blogspot.com Page 8

9 Scenario 2 You have successfully created a Blogger account. You want to present a professional appearance for your Blogger website. Your company colours are blue and grey. You want your website to reflect these colours. Task 1 (ipad) Select an appropriate template to use on your site polytekltd.blogspot.com based on these colours. Apply the template to the website using the Blogger app on the ipad. Add your company logo to the website from the photo gallery on your ipad. Task 2 (iphone) Select an appropriate template to use on your site polyteksystems.blogspot.com based on these colours. Apply the template to the website using the Blogger app on the iphone. Add your company logo to the website from the photo gallery on your iphone. Scenario 3 You are visiting a potential client tomorrow, and want to show them some of the work you have done for other clients in the past. You need to be able to show the client photos of your work during the meeting, by having your Blogger site open on your mobile device. You will need to add pictures with captions to your site. Task 1 (ipad) Upload a photo of a jobsite to your site polytekltd.blogspot.com on your ipad from the photo gallery. Upload a photo of a jobsite to your website using Gmail. You will already be signed into a Gmail account. The photo is attached to the only in your inbox. Add a caption summarizing the photo. Task 2 (iphone) Upload a photo of a jobsite to your site polyteksystems.blogspot.com on your iphone from the photo gallery. Upload a photo of a jobsite to your website using Gmail. You will already be signed into a Gmail account. The photo is attached to the only in your inbox. Add a caption summarizing the photo. Page 9

10 User 2 Scenarios User 2 will complete the following scenarios using an ipad and an Android tablet. Scenario 1 You have recently graduated from university and are spending the next several months backpacking across Asia. You want to create a travel journal for yourself to log your memories. Task 1 (ipad) Use the Blogger app loaded on the ipad to create an account and site with the following information. Your account information will be deleted following the test. Name: Provide your real first and last name for testing purposes. user2@gmail.com Password: create your own password according to the password requirements. Blog name: Trip Abroad Web address: tripabroad.blogspot.com Select a template for your site and add an introduction paragraph of text. Text is as follows: Hello, my name is <insert name> welcome to my travel blog. I will be logging my travels through Asia over the next several months. Task 2 (Android Tablet) Use the Blogger app loaded on the Android tablet to create an account and site with the following information. Your account information will be deleted following the test. Name: Provide your real first and last name for testing purposes. user2@gmail.com Password: create your own password according to the password requirements. Blog name: Trip to Asia Web address: triptoasia.blogspot.com Page 10

11 Select a template for your site and add an introduction paragraph of text. Text is as follows: Hello, my name is <insert name> welcome to my travel blog. I will be logging my travels through Asia over the next several months. Scenario 2 You have now been travelling for three weeks. You are about to move on to a new country, and want to upload a gallery of photos from your first stop before getting on the plane. Task 1 (ipad) Upload 5 photos to the site tripabroad.blogspot.com from the gallery on the ipad. Task 2 (Android Tablet) Upload 5 photos to the site triptoasia.blogspot.com from the gallery on the Android tablet. Scenario 3 Your family has ed you some photos from home and you want to include them in one of your blog posts. Task 1 (ipad) Upload 3 photos to the site tripabroad.blogspot.com from the Gmail account logged in on the ipad. The photos are located in the only in the inbox. Task 2 (Android Tablet) Upload 3 photos to the site tripabroad.blogspot.com from the Gmail account logged in on the Android tablet. The photos are located in the only in the inbox. Page 11

12 User 3 Scenarios User 3 will complete the following scenarios using an Android tablet and an Android phone. Scenario 1 You are graphic designer who has been doing mostly freelance work since graduating. You want to start a website to host your resume in the hopes of finding more stable fulltime work. You have already signed up for a Blogger account and created a website, and have the blogger app on your mobile device. Task 1 (Android Tablet) Using the Android tablet provided, upload your resume to the website called mydesignservices.blogspot.com. Your resume is located in the Gmail inbox of the account signed in on the device. The subject line is resume and should be the most recent in the inbox. Task 2 (Android Phone) Using the Android phone provided, upload your resume to the website called hiremetodesign.blogspot.com. Your resume is located in the Gmail inbox of the account signed in on the device. The subject line is resume and should be the most recent in the inbox. Scenario2 You have been working at your new full-time job for a few months now, but miss working with your freelance clients. You have decided to do a bit of freelance work on the weekends and advertise your services through your Blogger website. You have decided to add sample projects to your website to act as a portfolio for potential clients. You are starting with the websites you designed for clients last summer. Task 1 (Android Tablet) Make a blog post containing 2 links to external sites on your blog mydesignservices.blogspot.com using the Android tablet provided. Have the link text read as specified below, use any font colour of your choice other than blue. Link text Poppytalk I Heart Organizing Link to site Task 2 (Android Phone) Make a blog post containing 2 links to external sites on your blog hiremetodesign.blogspot.com using the Android phone provided. Have the link text read as specified below, use any font colour of your choice other than blue. Page 12

13 Link text My New Roots Print and Pattern Link to site Scenario 3 You have a bit of spare time to work on your website this afternoon. You want to personalize it to make it fit your design preferences. You are expecting friends in 20 minutes, so you need to be able to make small design and layout changes, not a complete design overhaul. Task 1 (Android Tablet) Change the following components of your blog mydesignservices.blogspot.com using the Blogger app on the Android tablet. Adjust the layout Adjust the width of the left sidebar Change the colour scheme of your blog Task 2 (Android Phone) Change the following components of your blog hiremetodesign.blogspot.com using the Blogger app on the Android phone. Adjust the layout Adjust the width of the left sidebar Change the colour scheme of your blog Page 13

14 Appendix B: Pre-Test Questionnaire This test is suitable for all users Name: Age: Have you ever run a blog before? Have you ever used Blogger before? If you were to start a blog what would the subject be? Have you ever heard of these blog hosting sites before? (Circle all that apply) Blogger Wordpress Weebly Squarespace.com Which devices do you use most when working with mobile apps? Specify operating system (Android or ios). Page 14

15 Appendix C: Post-Test Questionnaires User 1 Post-Test Questionnaire Test to be given to participants in User 1 category: ipad and iphone Overall how easy was it to use this application? (Circle one) Very difficult Somewhat Neither difficult Somewhat easy Very easy difficult nor easy Did you prefer using the Blogger application on the tablet or the phone? (Circle one) ipad iphone Why? How much time do you think you would need before you felt comfortable using Blogger? Would you recommend the Blogger mobile app to a friend? Why or why not? What was the most frustrating task you had to perform? What was your favourite feature of the Blogger mobile application? If you could add one feature to the app what would it be? Page 15

16 User 2 Post-Test Questionnaire Test to be given to participants in User 2 category: ipad and Android Tablet Overall how easy was it to use this application? (Circle one) Very difficult Somewhat Neither difficult Somewhat easy Very easy difficult nor easy Did you prefer using the Blogger application on the ipad or the Android Tablet? (Circle one) ipad Android Tablet Why? How much time do you think you would need before you felt comfortable using Blogger? Would you recommend the Blogger mobile app to a friend? Why or why not? What was the most frustrating task you had to perform? What was your favourite feature of the Blogger mobile application? If you could add one feature to the app what would it be? Page 16

17 User 3 Post-Test Questionnaire Test to be given to participants in User 3 category: Android Tablet and Android Phone Overall how easy was it to use this application? (Circle one) Very difficult Somewhat Neither difficult Somewhat easy Very easy difficult nor easy Did you prefer using the Blogger application on the ipad or the Android Tablet? (Circle one) Android Tablet Android Phone Why? How much time do you think you would need before you felt comfortable using Blogger? Would you recommend the Blogger mobile app to a friend? Why or why not? What was the most frustrating task you had to perform? What was your favourite feature of the Blogger mobile application? If you could add one feature to the app what would it be? Page 17