FAA TEST VALIDATION STUDY EXAM INFORMATION FOR PROCTORS

Transcription

1 FAA TEST VALIDATION STUDY EXAM INFORMATION FOR PROCTORS IMPORTANT: ALL PROCTORS MUST COMPLETE THE FAA VALIDATION TEST STUDY BRAINSHARK TRAINING AND REVIEW THE ATTACHED TEST ADMINISTRATOR TUTORIAL PRIOR TO ADMINISTERING THESE EXAMS. General Information There is one (1) exam in this program. Proctor issued scratch paper and pencil are the only materials allowed. Use of electronic devices and/or reference materials is prohibited. Candidates are allowed a 15- minute and a 45-minute break. It is okay if they leave the building during their break. Proctor/Test Administrator Script There is a script that all proctors MUST read to candidates during check-in. It is included Test Administrator Tutorial that follows. Test Engine Test administered via 3 rd Party Software: SureSelect (Computer Based Tests Icon) SHL (FAA SHL Link A and FAA SHL Link B Icons) Check-In Requirements 1 unexpired Government-issued photo ID that bears the candidate s first and last name. First and Last name on ID must match the name in the PSI system. Photo of candidate will NOT be taken. Exam Aids/Figure Books/Plan Sets to be Issued to Candidate None Score Reports Score Report NOT issued to candidate for this exam. Exam Details Exam Title FAA Test Validation Study Materials Allowed Scratch Paper Pencil Materials NOT Allowed Book/Manual Notes Pens Calculator PSI Services 1/19/2016

2 PSI Services 1/19/2016

3 Table of Contents Overview... 3 TEST ADMINISTRATOR SCRIPT... 4 CHECKING THE CANDIDATE IN AND OUT... 6 Check In (Existing Procedure)... 6 Check-Out (Existing Procedure)... 7 SETTING UP THE KEYBOARD... 8 ASSIGNING THE ORDER OF PORTIONS... 9 DESCRIPTION OF PORTIONS Computer Based Tests (SureSelect) Portion FAA_SHL_LINK_A or B Portions TEST CENTER SECURITY Security Overview Unauthorized Use of Tests Test Room Monitoring Activities to Report to Management Immediately Site Inspections Incident Reports PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 2

4 Overview The exam is considered to be Third Party. Therefore, the proctor must follow all the existing Third Party Test rules for checking the candidate in and out. (See CHECKING THE CANDIDATE IN AND OUT, page 6. There are several unique tasks that the proctor must perform when administering the FAA Test Validation Study: 1. The proctor must read a script to each candidate during check-in. (See TEST ADMINISTRATOR SCRIPT, page 4). 2. The proctor must set up the keyboard for the workstation(s) on which Exam will be given (See SETTING UP THE KEYBOARD, page 8). 3. There are 3 separate portions that candidates must take for this exam. The proctor must rotate the order of the portions for each candidate (See ASSIGNING THE ORDER OF PORTIONS, page 9). 4. The proctor must manually start each portion and be familiar with their format (See DESCRIPTION OF PORTIONS, page 10) Miscellaneous information: The test administrator issues scratch paper and pencil for this test. These are the only materials allowed. (Note: The scratch paper and pencil MUST be collected from the candidate at check out.) During the 6-hour testing session, the candidate may use up to 15 minutes for breaks and 45 minutes for lunch (although proctors should be flexible with allowing candidates to continue testing if they exceed their break time). Candidates are required to provide one form of valid Identification. Photo of candidate will not be taken during check-in. Score reports will not be provided to candidates for this test. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 3

5 TEST ADMINISTRATOR SCRIPT TEST ADMINISTRATOR SCRIPT FOR FAA TEST VALIDATION STUDY "Welcome to the FAA Test Validation Study." "I'm [your name]. I'm one of the Test Administrators." "Today you will be taking 3 different tests containing various assessments. I will provide additional information about this shortly." "For admittance today, you are required to provide one form of valid, Government-issued photo ID. Please provide your ID at this time. " [NOTE: Test Administrator should compare name on ID with name in system/roster. Also compare photo on ID to the candidate checking in with you. For name discrepancies, please use the Acceptable Names Discrepancy document. If the type of discrepancy is NOT listed on that document, please contact a PSI supervisor or Proctor Support Rep for further guidance] [NOTE: Continue with the check-in process in ATLAS to assign a seat.] "I will be keeping your ID here at the desk." "I will be providing you with company issued scratch paper and pencil. These will be the only allowed materials to enter the testing room with you. You MUST return these items to me at checkout. The scratch paper and pencil may NOT leave the test center premises at any time and you may NOT keep the scratch paper, make copies or photograph the information contained on the paper." "For this test, you will need to comply with our test security policy. You are NOT permitted to bring any personal items into the testing room. Please place your coats and any other personal items, including wallets and purses in (location). You may NOT have any food, drinks, calculators, electronic devices of any kind, cell phones, pagers, beepers, watches that have alarms turned on (or make any kind of noise) or any type of secondary features, or computer paraphernalia with you at the test station. One of the assessment screens gives conflicting information and states that a calculator is allowed. However, this message is incorrect. Calculators are not approved for this test validation study. "Let s go over a few administrative items." "The rest rooms are located: " [inform the candidate where the restrooms are located]. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 4

6 "You may purchase lunch at " (e.g., hotel restaurant, facility cafeteria, etc.). [inform the candidate where the nearest restaurants or eating facilities are]. "At your workstation, I will assist you with loading each of the 3 different assessments. Each assessment contains various subtests. Once you have completed all subtests for each test, please raise your hand or come find me at the desk so that I can load your next assessment. "The instructions are NOT timed nor are the periods between each test. If you need to stretch or take a quick break, those are the advised times to do so." "You are permitted to take a 15 minute break and a 45 minute lunch break. This test allows for you to leave the building for your lunch break." "Once you ve started the timed portion of a test, the timing does NOT stop if you take a break." "Once the test starts, please be considerate of the other test candidates. Do NOT talk to or interrupt other test candidates during the testing session. Raise your hand if you have a problem and a Test Administrator will try to help you." "Do NOT press control-alt-delete or attempt to restart your computer. Do NOT put any disks in the CD ROM drive or memory sticks in the USB ports." "If you don t understand something or feel you are having a problem, review the directions if that option is offered to you. The test administrators are NOT allowed to interpret the questions for you. We can only intervene or assist if you have a computer problem." "You will NOT receive any results for this test validation study." "Please see me or one of our other test administrators once you have completed the 3rd assessment battery. At that time, you will need to return the scratch paper and pencil that was issued to you. You will then receive your ID. " "Do you have any questions? Okay, let's proceed to your workstation to get started." PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 5

7 CHECKING THE CANDIDATE IN AND OUT Check In (Existing Procedure) Use the Proctor workstation and go to your OPS candidate check-in screen. Note the icon that denotes that the exam is considered to be a third party exam. Choose the appropriate candidates and click the Check in Candidate button to proceed with the check-in process and seat assignment as usual: PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 6

8 Check-Out (Existing Procedure) At the OPS workstation, check-out the candidate by clicking the Client Checkout button, then confirming check-out on the next screen. After check-out, the Candidate s Test Status read as Uploaded: PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 7

9 SETTING UP THE KEYBOARD Before administering the test, proctors MUST prepare the keyboard at any workstation that will be assigned an FAA Test Validation Study candidate. Proctors will need to affix letters and a Yes and No to the specific keys on the keyboard. After the candidate has completed the test, remove the labels. The letter A will need to be taped to the F5 key along the top Row of the Keyboard. The letter B will need to be taped to the F6 key. The letter C will be taped on the F7 key. And the letter D will need to be taped to the F8 key. On the numerical key pad, the word YES will need to be taped on the + (Addition) key and the word NO will need to be taped to the Enter Key. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 8

10 ASSIGNING THE ORDER OF PORTIONS On the workstation to be used by the candidate, you will see three icons as follows: The icons represent the 3 different assessments that each client must take. You (the Proctor) must rotate the order of the portions as follows: Scenario 1 Scenario 2 Scenario 3 Portion 1 Computer Based Tests FAA_SHL_LINK_A FAA_SHL_LINK_B 15 Minute Break 15 Minute Break 15 Minute Break Portion 2 FAA_SHL_LINK_A FAA_SHL_LINK_B Computer Based Tests 45 Minute Lunch Break 45 Minute Lunch Break 45 Minute Lunch Break Portion 3 FAA_SHL_LINK_B Computer Based Tests FAA_SHL_LINK_A You must keep track of the Scenario (order of the portions) assigned for each Candidate by making a notation on the Roster: At the assigned test workstation, you must select the first portion for the candidate. You must open the second and third portions after each break. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 9

11 DESCRIPTION OF PORTIONS Computer Based Tests (SureSelect) Portion Click on the Computer Based Tests icon, and then the Login button: Upon login, click on the Administer Tests button on the left side of the Test Administration screen. You may search for the candidate using their last name or candidate code. The candidate code or ID is located on the session roster for the candidate PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 10

12 This portion contains 4 sections. We will review each of these areas in detail so that you may assist a candidate if they lose their place or if there is an unforeseen technical issue that requires the proctor to restart the candidate s exam. For each candidate that begins the "Computer Based Tests" (SureSelect) assessments, proctors MUST select "All Tests". If there is a need to restart a candidate due to a technical issue, you will need to select the specific test where the candidate left off, as well as the remaining tests that that the candidate has not completed. The 4 sections in this section, in order, are: Memory task: This exam starts with an instruction screen shown here. To move forward, the candidate must click the continue button in the bottom corner. The exam begins with a black screen and a number as indicated on the instructions screen. If a candidate should lose their place or have technical difficulties, they may describe or you may want to describe this exam as the numbers exam or flashing number quiz to determine the correct test the candidate was in prior to the technical issue. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 11

13 Remembering Relationships: This exam starts with an instruction screen shown here. To move forward, the candidate must click the continue button in the bottom corner. The exam begins with a black screen with white lettering and an equal sign. If there are technical issues with the workstation that require a restart, candidates might describe this section or Proctors may want to describe this section to candidates as the letter and equal sign or the letter quiz. Visualizing: The third section in this section is called Visualizing. In this section candidates will see a landscape and planes. Candidates and Proctors may describe this section as the plane game or the landscapes and planes exam: PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 12

14 Radar simulation: In this section candidates will see blue dots with numbers in them, that travel across the screen. Candidates and/or Proctors may describe this section as the moving blue number dots or the blue moving dots. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 13

15 FAA_SHL_LINK_A or B Portions Now we are going to discuss the FAA_SHL_LINK_A or B exam. When you click on the icon, you will see the registration/login screen. The first time you launch this link for a new candidate, you will need to click on New Users/Register Now on the left side of the screen. The next screen will request general login details from the candidate. Proctors MUST write down the username and password on the roster for the candidate s exam. This username and password will be used again for the candidate s second FAA_SHL_LINK_A or B exam later in their session. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 14

16 After clicking on Register, the candidate will see a data protection notice shown here. To move forward, the candidate (not the Proctor) must click the box that reads: I have read and agreed to the data protection notice and agree to the use of the information for SHL research purposes. Then the candidate must click Continue. After clicking Continue, the candidate will see a login screen. They must enter their first name, last name, and participant ID. This ID is the same as a normal Candidate ID number and can be found on your PSI roster. To move forward the candidate should click Continue. The next screen will require your proctor user name and password provided to you by your supervisor. Once you have entered your proctor username and password you must click the Login button. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 15

17 The next screen shows the different assessments for the candidate. The proctor should copy the session ID listed at the top of this page to the roster in case there a loss of connectivity or other technical issue during the exam. To continue, the candidate must click on the Take Assessment link to launch the test. Upon Take Assessment, information pertaining to the test appears. After reading the information, the candidate must click on Start Evaluation to view the actual questions: First screen: FAA_SHL_LINK_A First screen: FAA_SHL_LINK_B Each section is timed and the computer will automatically move the candidate into the next section of the portion. Once again, if the candidate should lose connectivity or log off by mistake, they may log back into this exam using their session ID that you had recorded on the roster. Note: SHL_A has 6 sections (Technical Checking, Multitasking Ability, Personality Questionnaire, Deductive Reasoning, Work Attitude and Tendencies, and Verbal Ability) and SHL-B has 5 sections (Inductive Reasoning, Attitude and Tendencies, Spatial Ability, Motivation Questionnaire, and Numerical Ability). PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 16

18 When the candidate completes the exam, they will see the task on the home screen has changed from Take Assessment to Completed as shown here: Starting the second portion: The process is the same, except that there is no need to re-register the candidate. Instead, the candidate may enter User Name and Password in the Returning User section and proceed to Login: The next screen is the test administrator login. This is the same login you used for the first exam. As with the other SHL link we just reviewed, the second exam also displays a session ID in case their computer loses connectivity. Proctors must be sure to write down this session ID on the roster. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 17

19 TEST CENTER SECURITY Security Overview As a test administrator, test security is your number one priority. Each Test Administrator with access to the FAA Test Validation content MUST: Recognize the need for test security Apply sound judgment in handling the test Notify appropriate officials immediately if there is any suspicion of attempts to compromise test security. Unauthorized Use of Tests Unauthorized uses of the validation tests include, but are not limited to: Providing practice or familiarization to individuals to assist them in passing the test. Any use of the test to assist in creating test practice and/or coaching programs, materials, or courses. Use of the test as a game or recreation. Unauthorized person(s) provided access to the test, test procedures, test results and reports, or the test software code or password to launch the test. Test Room Monitoring Once testing has commenced, begin the test monitoring. Ensure a Test Administrator can observe each Candidate. Do NOT sit with your back to the Candidates. Scan the room periodically and maintain awareness at all times. Perform walk-through s of the testing room every 10 minutes. Avoid pausing to stand behind Candidates while they are taking the test. It is better to observe Candidates from a few feet back, if space permits. Keep the room quiet and free from distractions. Document standard incidents (complaints or activity that is out of the norm) thoroughly by submitting a regular Incident Report. Test Security incidents should be submitted using the Security Incident Report form. Do NOT use the FAA AT-SAT incident report form for this program. Keep the DVR and Video Surveillance Monitor ON and IN VIEW at all times PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 18

20 Do NOT leave the test room unattended unless the room has been cleared and locked. At least one Test Administrator MUST be monitoring testing at all times when testing is in progress. Do NOT take screen shots or make copies of the test displays or problems. Do NOT permit photographs to be taken of the computer screens. Immediately report attempts to compromise the test. If there is a concern that the test might have been compromised, immediately contact a Test Administrator Support Representative or the appropriate Regional Site Supervisor. Activities to Report to Management Immediately If any of the following is observed, the Test Administrator MUST immediately notify Test Administrator Support or the Regional Site Supervisor for further guidance (no matter the time of day or occurrence during the session): Use of notes Attempt to write down and remove test content from test center Talking to other Candidates during the test Discussing test content after the test Bribery or attempted bribery Possession and/or use of unauthorized materials (including any electronic device such as a cell phone, camera, calculator, translator, etc.). An imposter or someone other than the Candidate attempting to take the test for the Candidate. Once Management has been contacted: The Test Administrator will receive further guidance on handling the situation. Upon the conclusion of the incident and after receiving guidance from PSI Management, the Test Administrator MUST submit a Security Incident Report. Reminder: for this program, do NOT submit an FAA AT-SAT Incident Report. Site Inspections It is the responsibility of the Test Administrator to conduct regular self-inspections of the test center to ensure continuing high standards of cleanliness, neatness, furniture condition, facility appearance, etc. From time to time, PSI management will visit each test center to verify conditions as reported, to provide feedback to the local test administrators, and to confer with property management staff as required. PSI management will conduct occasional test center inspections on an announced or unannounced basis. The Test Administrator MUST verify appropriate identification from all inspectors. The FAA may also conduct visits. The Test Administrator MUST verify appropriate identification in such instances and contact a Regional Site Supervisor immediately. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 19

21 Incident Reports Incidents that should be reported include, but are NOT limited to: Technical issues resulting in a delay or cancelation of the Candidate s test Test Security Breaches Site Testing Conditions such as broken thermostat, problems with heating, air conditioning, ventilation, leaks, noise disturbances, fire alarm, and any other situation that could cause either a disruption in testing or cause discomfort for the Candidate. Candidate illness/injury that occurs on the test center. Candidate(s) voicing displeasure or complaint to the Test Administrator regarding the test or testing experience. Any time a Candidate is NOT admitted to test. NOTE: Candidates should never be turned away from their test without approval from PSI Management. Essentially, an Incident Report MUST be submitted for any instance other than a perfect testing session. PSI Service LLC 2016 FAA Test Validation Study Test Administrator Training page 20