Smartphone App. Test Administrator Guide. Version 1.0

Transcription

1 Smartphone App Test Administrator Guide Version 1.0

2 1. Getting Started... 3 What is Versant?... 3 System Requirements... 3 Test Administrator Checklist... 3 Preparing for Test Administration... 3 Test Administration Recommendations for Testing... 4 Best Practices... 4 Test Environment... 4 Partition Setup... 4 Proctor... 4 Prepare Test Takers Test Administration Setup... 5 Prepare the Device for Testing Navigating the App... 6 Home Screen Admin Screens... 7 Sign-In... 7 Admin Options... 8 Pre-Download Tests... 9 Downloaded Tests Test Status Test Taker Screens Start Test Volume and Microphone Check Test Screens Exiting the Test Before Finishing Rule Violation Score Report Further Support Additional Information Alert Messages & Remedy Support Contact Page 2 of 21

3 1. Getting Started What is Versant? Versant is a suite of spoken language tests automatically scored by patented Ordinate speech processing technology. Tests assess non-native language skills. Score reports offer overall and subskill scores along with areas for improvement. Versant tests can be taken on various platforms, including smartphones. This guide will walk you through using spoken Versant tests on smartphones. System Requirements Spoken Versant tests are compatible with iphone ios 8 or higher and Android 4.4 or higher. For full system requirements, including bandwidth requirements, view the Versant Test App Technical Requirements Guide. Test Administrator Checklist Review and print this checklist for successful test administration. Preparing for Test Administration You will receive a batch key, which will enable you to pre-download tests. Each predownloaded test will have Test Identification Number (TIN). If supplying the smartphone for test takers, pre-download tests onto each device. Prepare TIN distribution to test takers. You may assign names to TINs or have a printout of the TINs with space to write down test taker IDs as they come in. Test Administration Ensure distraction-free environment. Prepare your devices: Download the Versant test app & ensure there is enough battery to administer testing. If using Wi-Fi, sign devices onto the Wi-Fi network. Internet is needed to download the test contents after TIN submission on app and to send responses for scoring at the end of the test. Test takers will be instructed to enable Airplane Mode and turn off WiFi during the test, so it is important to remember to reconnect to the network after testing to upload responses. For test administration, provide test taker with their TIN and instructions: o Let test takers know that they need to complete the test to have it scored. Ensure test responses are uploaded for scoring by viewing the Test Status screen on the app where the TIN was submitted, or check your Scorekeeper account. The Test Status screen on the app will display Scored or Score Pending for successfully uploaded TINs. Page 3 of 21

4 2. Recommendations for Testing Best Practices Test Environment Designated test locations are required to provide a distraction-free, secure testing environment with continuous candidate surveillance. If your test center is already administering exams, the layout of your office may be sufficient as long as it meets the requirements below. If you are setting up a new test center, the exact layout will vary depending on the physical space available and on the number of candidates that will be accommodated. Testing can be a stressful experience for many candidates. Even minor noises near the exam delivery room can cause a candidate to feel distracted. If there is obvious noise, such as building construction, when a candidate is ready to take an exam, ask the candidate whether he or she will be affected by the noise before the exam is started. Recommendations for minimizing noise distractions: 1. Insulate the exam delivery room to minimize noise. In addition to insulated walls, an insulated ceiling will help minimize noise. 2. In the exam delivery room, remove or turn off equipment such as printers, fax machines, copiers or telephones while testing is in progress. While testing is in progress, place a sign alerting people in your office to be especially quiet near the exam delivery room. For example, you might post a sign that says, "Quiet! Testing in Progress." Partition Setup If you are using privacy partitions, which will create privacy and also absorb sound between workstations, we strongly suggest having permanent partitions or walls that are at least 5 feet in height from the ground up and extend outward from the wall at a 90-degree angle. Desktop partitions are acceptable as long as the height measured from the floor is at least 5 feet. If using partitions, the partitions must allow an unobstructed view of each candidate (including their hands) within the exam delivery room. Proctor We recommend that the test administrator be seated within the exam delivery room. The proctor cannot have a computer inside the exam delivery room. They may be provided a desk and a chair. Pearson recommends that multiple proctors be present to monitor exams if more than fifteen candidates are taking an exam at one time (1 proctor per fifteen candidates). Page 4 of 21

5 Prepare Test Takers Before testing begins, it is recommended that test administrators: 1. Inform test takers of the test length so that the proper time can be allocated to focusing on the test. 2. Demonstrate to test takers how to place and speak to the device for best sound quality recording. Optimal use is for smartphone to set on the table or held (with the arm bent naturally at the elbow) cm in front of you. If using ear buds, the test taker should let the microphone rest in its natural position. Additionally, the appropriate speaking volume should be neither too soft nor too loud. 3. Advise test takers to do their best. If they do not know an answer, they should either stay silent or say, I don t know. 4. Advise test takers to remove personal items; this includes any note-taking materials. 5. After the test taker starts their test, they should follow on-screen prompts to turn off Internet (turn off Wi-Fi and turn on Airplane mode). 3. Test Administration Setup Prepare the Device for Testing 1. Install the app onto the device. See App Installation Instructions. 2. Configure your data network (see Technical Requirements). 3. Ensure the device has ample battery charge for testing. Page 5 of 21

6 4. Navigating the App Home Screen The Home Screen contains three separate options for managing your tests and scores. Start Test: Tapping this button will take you to a TIN entry page. Enter a TIN on this page to start a test. Test Status: Tapping this button will allow you to view scores and other test statuses for tests started on the device. Admin: Tapping this button will take you to the Admin screen to pre-download tests and view downloaded tests available for testing. Page 6 of 21

7 5. Admin Screens Versant Test App admin capabilities allow test administrators to pre-download tests and view pre-downloaded tests on the device. Sign-In From the Home screen, tap Admin. You will be asked to enter the admin password. The admin password is , or Versant on the keypad. Page 7 of 21

8 Admin Options After you input the admin password, you arrive at the Admin screen. Tap Pre-Download Tests to download TINs or batches onto the device before testing. Downloading TINs or batches ahead of time will allow test takers to complete these tests on the device without Internet. This is highly recommended if you will be testing in an area without a reliable Internet connection. Tap Downloaded Tests to view all unused TINs downloaded. These are available TINs you could assign. Page 8 of 21

9 Pre-Download Tests The Versant test app allows you to pre-download tests multiple ways. Pre-downloading a test onto the app will allow you to start the pre-downloaded test without an Internet connection. To pre-download one or more tests using TINs or a batch key, follow these instructions: 1. Enter the desired TIN or batch key into the text entry field. 2. Tap the plus (+) button to next to the text entry field. 3. To add additional TINs to the download queue, enter another TIN in the text entry field and tap the plus sign (+). Please do not enter over 150 TINs, as this can lead to exceptionally long download times. 4. To remove a TIN from the queue: a. On Android, tap on the TIN and choose Delete to delete the individual TIN or Delete All to remove all TINs. b. On ios, swipe left on the TIN, tap Delete red button. If you want to all of the TINs, tap Delete on the top right and then Delete All on top left corner. 5. When you are ready to start the download, tap Download and do not navigate away from the screen. 6. Once the download is complete, the Done button appears. You will see the TIN status, such as TINs downloaded successfully, or unsuccessfully with the reason noted (i.e. used TINs). Tap Done. Page 9 of 21

10 Downloaded Tests To view any tests that have been pre-downloaded tap Downloaded Tests from the Admin screen. You may need to tap Refresh TINs to get the most up-to-date information. This screen is only for tests that have not yet been taken. For information about tests on the device that have been taken, please go to the Test Status screen. To start a pre-downloaded test, return to Home and tap Start Test. Enter the TIN of any pre-downloaded test and you will be able to take the test. Test Status The test status screen allows you to view the status of any tests started on the device. Review the status to see if actions are required. In Progress: This test is currently underway and the user may resume at the beginning of the last test section. Tap Continue will take you to the TIN entry page and allow you to re-enter the same TIN to continue the test. A countdown timer will be displayed. If you wish to resume a test, please tap Continue before the timer expires. Note: When test takers send the app to the background or exit they can return to the app and continue from the last started test section. Test takers can do this up to two times with a maximum of 45 seconds total spent outside of the app between the two attempts. After that, they cannot use the same TIN. Only under the circumstance of the app crashing does the test taker have up Page 10 of 21

11 to 4 hours since the start of the test to resume. They will resume on the first question of the last started section. Upload Pending: This test has been completed but the responses have not been uploaded for scoring. Please connect to the Internet to automatically upload these responses for scoring. Score Pending: The responses have been uploaded to the scoring server, but the Versant app cannot retrieve the pending score due to a lack of Internet connection. Please connect to an Internet connection to automatically retrieve the score. Scored: Your test has been scored. If the test administrator has enabled test takers to view score reports, test takers can tap Score on the right to view the score report. If the batch is locked, the Score button will not appear and the test score will not be accessible on the device; administrators can view score via ScoreKeeper. Incomplete: Test taker was unable to complete the test and the time period to continue the test has passed. Test takers should contact their test administrator if further assistance is needed. Expired: Test taker did not start the test before it expired. Test takers should contact their test administrator if further assistance is needed. Test Taker Screens Start Test When a test taker opens the app and is ready to take a test with no distractions, follow these instructions from the Home screen: 1. Tap Start Test. 2. Enter the Test identification Number (TIN) and tap Sign In. 3. Review the important test instructions, swiping through the instructions screens. Volume and Microphone Check The test taker needs to check their volume and mic: 1. From the Welcome screen, tap Next. 2. Follow the prompt and move the slider to adjust to the desired volume. Then tap Next. 3. Follow the prompt and repeat what is seen on the screen. This checks the microphone. Then tap Next. Page 11 of 21

12 Test Screens The first test screen is the Test Overview screen. This screen shows the different types of questions the test taker needs to complete and estimated time to complete. Once on this screen, the test taker cannot restart the test, and the Test Identification Number is considered used. Test Overview Once the test taker is ready to take the test, tap Start Test. If not ready, tap Cancel, and the test taker is taken to the Home screen. Page 12 of 21

13 Airplane Mode and WiFi The Airplane Mode and WiFi screen appears after Test Overview. It prompts users to turn on Airplane Mode and turn off WiFi to reduce distractions from other app notifications. When the test taker is ready, they tap Next. Page 13 of 21

14 Test Questions While taking the test, the test taker can view speaker and microphone levels. When the audio is playing, the volume icon is activated: During this time test taker should listen to the audio prompt and adjust their volume as necessary. When it is the test taker s turn to speak and record their answer, the bars next to the speaker icon will light up, like so: Exiting the Test Before Finishing Exiting the test before finishing is highly discouraged. If for some reason the test taker still wants to exit prematurely, tap on the left X icon from the screen title bar. Page 14 of 21

15 Rule Violation If during testing the test taker violates an administration rule, a violation message appears. The test taker violates a rule when the test taker puts the app in the background or exits the app more than two times or spends more than 45 seconds total out of the app, whichever occurs first. Start New will allow the test taker to enter a new Test Identification Number and begin a new test. Exit (Home) will take the test taker to the Home screen. Page 15 of 21

16 Test Completion Tap Retrieve Score if the test taker has an Internet connection and wants to view their score report. This option is only available if the test batch was set to unlock scores in ScoreKeeper. Tap Sign Out to exit to the Home screen. Score Report Admins can obtain score reports from the app test status screen or Test takers may do the same if the admins did not lock scores to test takers. Page 16 of 21

17 Page 17 of 21

18 Page 18 of 21

19 6. Further Support Additional Information Technical Requirements App Installation Instructions Frequently Asked Questions (FAQs) Alert Messages & Remedy Alert Message An unexpected error has occurred. Please try again. If the error persists, use a different TIN. An unexpected error has occurred. Please try again. If the error persists, please contact Technical Support. Network error occurred. Please try again. If the error persists, please contact your System Administrator. No Network Connection. Turn off Airplane Mode or Use Wi-Fi to Access the Network. The resume period for this test is over. The test has been cancelled. The TIN is incorrect. There is a problem with this TIN. Please enter a different TIN. There is not enough free space on the device to take this test. Please clear disk space. This test has already been used. Please enter a different TIN. This TIN has expired. Unknown error Remedy Please try a different TIN. If the issue continues, contact Technical Support. Please try again 5-10 minutes. If issue continues, contact Technical Support. Please try again. If the error continues, please contact your System Administrator. Check your Internet connection. Turn off Airplane Mode, or use Wi-Fi to access Internet. Contact your test administrator or obtain a different TIN. Please check your TIN and re-submit. Please enter a different TIN. There is not enough disk space to download content for a test. Please delete unnecessary content from your device and try again. Please enter a different TIN. Please contact your test administrator. Please try again. If issue continues, contact Technical Support. Page 19 of 21

20 Troubleshooting Questions and Answers 1. What if the test content download has stalled and does not appear to be advancing? The download progress bar indicates download progress. The test content download speed depends on your network connection. If 5-10 minutes have gone by and you are not seeing the download progress advance, the download may have been stalled due to intermittent Internet connectivity. Force-close the app and restart the download. 2. What if the microphone is not working during a test? The application may not have access to the microphone. Enable the app to access the microphone: a. For Apple devices: Go to Settings, Versant, Microphone, and then enable Versant to have access to the microphone. b. For Android devices: i : Microphone access was provided during app download. Contact Support for further assistance. ii. 6.0+: Go to Settings, Apps, tap Versant, Permissions. Then ensure the microphone is enabled. 3. What happens if I delete the app when responses have not yet been uploaded? Unfortunately, responses will be deleted along with the app. The test cannot be scored. 4. Where can I download the app? The Versant test app can be downloaded from the Google Play and Apple app stores Android users: ios users: 5. Do test takers need to use a headset during the test? No. If you wish, test takers may wear a headset during the test but it is not required. In either case, ensure the test taker is in a quiet environment. 6. What code do I enter after tapping Admin on the main screen? or Versant on the keypad. 7. How do I see which tests have been downloaded to my device? Enter the Admin section of the app, then tap Downloaded Tests. You will see a list of all available TINs and their status. If the list appears to be out of date, tap Refresh TIN List at the bottom. 8. My TIN/Batch Key is not recognized. Verify that you are entering the TIN/Batch Key exactly as it appears on your test paper or ScoreKeeper account. If the issue persists, please contact support. Page 20 of 21

21 9. How do I enable Airplane Mode on my device? The steps to enable Airplane Mode will vary from device to device. Please check the following guides: Android users: ios users: I m a test administrator. The test was completed but I cannot view scores. Check the Test Status screen on the device the test was taken. See if responses for the TIN were uploaded. If responses were not uploaded successfully, make sure the device is connected to the Internet. If the Test Status screen shows that responses were uploaded successfully, it may be that the batch was setup with locked scores. Support Contact Can t find the answer to your question? Our Support Team will be happy to assist. You may contact our Support Team by completing the Support form: Page 21 of 21