Select2Perform Custom Assessment Builder (CAB )

Transcription

1 Select2Perform Custom Assessment Builder (CAB )

2 Table of Contents THE SELECT2PERFORM CUSTOMER ASSESSMENT BUILDER... 2 Getting Started... 2 Uploading and Using Audio and Image Files in a Test Question... 2 Adding a Test Question... 3 Questions... 5 Answers... 7 Finish... 9 Using the HTML Editor... 9 Editing a Test Question Questions Answers Finish Adding a New Test Adding Sections Instructions Options Question List Options Adding Instructions Finish Editing a Test Sections Options Finish... 31

3 THE SELECT2PERFORM CUSTOMER ASSESSMENT BUILDER The Customer Assessment Builder (CAB) is an extremely powerful tool that allows an individual or company to create custom tests. Once created, these tests may be administered in the office or delivered via the Internet. Customized tests may include questions from existing SHL assessments and they may also include custom questions. Many question types may be mixed to suit your needs. Most HTML tags, audio, and graphic files may be inserted into questions and answers you create. Getting Started CAB is only available to customers with CAB licenses and Enterprise accounts. To use the CAB, you must be logged into Select2Perform as a Company Administrator. Test Administrators do not have the ability to create custom assessments. When designing a test, ensure your browser is set up correctly to use Select2Perform. Information about setting up your browser can be found by clicking Download the Select2Perform Internet Explorer/Workstation Setup Document at SHL Technical Support or Customer Service is available to assist you with your browser settings. Next, determine if you want to use existing SHL-authored questions exclusively or if you want to include your questions in the new custom assessment. To include your custom questions, follow the steps in the section titled Adding a Test Question. Uploading and Using Audio and Image Files in a Test Question The CAB allows a user to attach audio and graphic files to test questions. The audio files or graphics may be associated with a question stem or an answer and may be used multiple times. Before these files may be associated with a question, the user must upload the files. All uploaded files must be no larger than 64K. Video files must have the.wmv,.avi and.mpg extension. Audio files must have the.mp3 or.au extension. Graphic files must have a.gif,.jpg,.jpeg, or.png extension. Animated.gif files are supported. First, upload the audio or image file into Select2Perform 1. Select the CAB menu, and under CAB click Media. 2. Click the Add button. 3. Type a name for the file in the Code field. Select the Check button to make certain the code has not been used before. 4. If necessary, enter a description of the file in the Description field. 5. Select the Browse button to select the file on your PC or network that you wish to upload. Once all of the required fields have been completed, select Add to upload your file. After the image has been uploaded, a preview of the image displays. Page 2

4 The Search for Existing Media(s) screen redisplays. Adding a Test Question WARNING: Some question types cannot be combined into a single test. For instance, all multiple choice questions can be combined in a test; Typing questions cannot be combined. For more information, please contact the SHL Technical Support Center. CAB allows you to create test questions and then add them to your custom tests. You must create the questions first so that you can select them by name when creating the test. NOTE: The CAB menu will only display if your company has a license for CAB and you are logged in as a Company Administrator. To create a new test question, use the following steps: 1. Click the CAB menu, and under CAB, click Question, then click the Add button. The Enter Question Information screen displays: 2. Enter a question name. SHL recommends you use a consistent naming convention. Over time the question pool will grow quickly and you may need to search for a particular question easily. An example of a naming convention is: TestnameQuestion# The name must be unique. Click the Check button to check if the name already exists in the database. If it doesn't exist, click OK in the Results window. Otherwise, enter a different name for the question. Page 3

5 4. Click the Type list arrow and select a question type. The question type determines the manner in which the question is presented to the test taker and the type of answer fields available within the Answers tab. Refer to the following table for a description of the question types: Question Type Multiple Answer Multiple Choice Short Answer Split Screen Typing Text True False Typing Description Question has 2 or more possible answers and may have one or more correct answers. The answers designated as correct must all be selected by the candidate for the question to be scored as correct. Question has 2 or more possible answers, and one correct answer. SHL users can make adaptive questions with the multiple choice question type. Question compares the candidate s typed response against the response in the answer tab. This question type is often used with spelling questions and requires an exact match. NOTE: Do not use this question type for paragraph-length answers. Use the Text question type. The text is displayed in the top pane on-screen so there are no paper text originals. The text is not visible before the timer starts. The candidate types the text directly into the Text box and cannot copy text from another document and paste into the Text box. Question prompts for a text response. The response is not scored. This is used for survey questions or for essays that will be manually scored. Question is stated in such a way that the candidate answers whether the statement is true or false. Question consists of the key press text for a typing test and for the warm up. Name the warm up typing question so that you can easily identify the question as the warm up. 5. In the General tab, type a question description in the Description box that briefly states what the question is assessing. You may need to search the Question list by description to easily find a particular question or set of questions. 6. In the Topic field, type a brief topic name. For some question types, the detailed score report displays the number of correct responses grouped by topic. The Topic field is optional. 7. In the Reference field, enter notes or revision dates. The Reference field is optional. 8. The Active option is selected by default so that the question will be available when you create a test. Deselect this option if you want to continue to work on the question later. 9. Click the Skill Level list arrow and select a question skill level. Skill level options are Basic, Intermediate, Advanced or N/A. For some question types, the detailed score report displays the number of correct responses grouped by skill level. Also, for some tests, the system can display the questions in order of skill level, with basic questions presented first, then intermediate, and then advanced. For tests where the skill level does not apply, select N/A. 10. Click the Question Text tab. Page 4

6 Questions 1. Click the + button in the Click + for formatting options field below the Enter Question Text box. The text editor displays. For assistance using the editor, refer to Using the Edit HTML Editor later in this document. 2. Type the question text and use any of the formatting buttons if necessary. NOTE: To upload an image file from the Question Text or Answers tab, select either the Insert Video, Insert Audio or Insert Image button, select your file, and click Select to insert it. You will notice the programming code that automatically appears within the text as shown below: The programming code begins with %% and ends with %%. Text, HTML tags, or other graphic/audio files may be inserted before or after the programming code. More than one image or audio file may be inserted into the question or answer text. 3. Click Add to add the question, or Preview to preview the question in a new window. 4. Click Save + New to save the question. The Enter Question Information screen redisplays. Page 5

7 5. Click the Answers tab. Page 6

8 Answers The screen elements available depend on the question type selected. For general purposes, the Multiple Choice question is used below. For other question types, see page 17. Page 7

9 The question text is displayed for your reference. It is not editable on the Answers tab. To edit the question text, click the Question Text tab and the Enter Text button. 1. To display the answers randomly to the candidate, select the Randomized checkbox. 2. For commonly used answers, click the Use Common Answer Type list arrow and select an answer type. Refer to the table below for common answer types: Question Type Definition 1-5 answers are listed from number 1 to 5 Agree/Disagree Agree/Disagree 4 pt Agree/Disagree 5 pt Frequency 5 pt Important 5 pt Likelihood 5 pt Never/Always 5 pt Poor/Outstanding 6 pt Speed 5 pt True/False two answers are displayed: Agree and Disagree four answers varying in degree from Agree to Disagree five answers varying in degree from Agree to Disagree five answers of varying degrees of occurrences Five answers of varying degrees of importance five answers of varying degrees of chances five answers of varying degrees of frequency six answers of varying degrees of quality five answers of varying degrees of promptness two answers are displayed: True and False When you select a common answer type for several consecutive questions, the system will automatically combine the questions on one page as shown below: For each answer: Page 8

10 Finish If the answer is the correct answer, click the Correct option in the Correct column. To remove an answer box, click the Remove (X) button that is located to the left of the answer box. To add another answer box, click the Add Answer button. To save the current question, click the Add button OR To save time when creating questions with similar or identical attributes, use the Save and New button. The Save and New button saves the current question and creates a copy, including question and answer(s) fields. The new copy is then opened in edit mode. Enter a unique name by modifying the Name field at the top of the screen and click the Update button or, for more copies, click the Save and New button again. To preview the question as it will appear to the test taker, click the Preview button at the bottom of the screen. To exit the Enter Question Information screen without saving your changes, click the Cancel button. Using the HTML Editor You can use formatting for most text fields by using the HTML Editor. You can also copy and paste text from Notepad into the HTML Editor. SHL recommends that you not copy and paste from Word to avoid extraneous code and extra steps to clean up the text. To use the Edit HTML editor, use the following steps: 1. Click the + button in the Click + for formatting options field. The HTML editor screen displays. 2. Type the text you want to display. Refer to the following table for using the HTML Editor: Page 9

11 Button Function Edit HTML code --displays HTML code that was created by the editor. Click the button again to redisplay in View mode. If you are using special characters and the editor does not display them correctly using the Source button, add <pre> and </pre> around the HTML code you're entering. That will preserve the HTML formatting and the editor will not attempt to convert the characters. HTML Link--displays the Link--Web Page dialog box from which you can indicate the url location of the link Font drop-down list--select text then click Arial, Arial Black, Comic Sans MS, Courier New, Lucida Console, Tahoma, Times New Roman, Trebuchet MS, Verdana Size drop-down list--select text then select up or down arrow to apply the appropriate size to the text Font Style: Bold--bolds the selected text Font Style: Italic--italicizes the selected text Underline--italicizes the selected text Strike Through--places a line through the selected text Text Color--displays a color palette from which you can select a color for the text Background Color--displays a color palette from which you can select a color to highlight the text Insert/Remove Bulleted List--when turned on, places a bullet in front each line of text Insert/Remove Numbered List--when turned on, numbers each line consecutively until turned off Insert Audio--displays the Select an audio file dialog box from which you can select and preview audio files. The system inserts the code for the file and not an actual file. The audio can play when the record you are building is saved. You cannot use this button when creating a custom application form. Insert Image--displays the Select an image file dialog box from which you can select and preview graphic files. The system inserts the code for the file and not an actual image. The image will display when the record you are building is saved. You cannot use this button when creating a custom application form. Page 10

12 Insert Video--displays the Select a video file dialog box from which you can select video files. You can Preview the selected video file by using Rewind, Stop, Pause, Play, FF buttons. Editing a Test Question To edit a test question, use the following steps: 1. Click the CAB menu, and under CAB, click Question, then click the Search button. 2. The Search for Existing Question(s) screen displays. 3. Enter your search criteria in the appropriate boxes. 4. Click the Search button. A list of question records displays. 5. Click the Edit icon of the question you want to change. The Update Question Information screen displays: 6. If applicable, type a different question name with a predetermined naming convention in the Name box. Over time the question pool will grow quickly and you may need to search for a particular question easily. An example of a code is: TestnameQuestion# Click the Check button to check if the name already exists in the database. If it doesn't exist, click OK in the Results window. Otherwise, enter a different name for the question. 8. If applicable, click the Type list arrow and select a different question type. The question type is the manner in which the question is presented to the test taker. The question type will also determine the type of answer fields available within the Answers tab. Refer to the following table for a description of the question types: Question Type Description Page 11

13 Multiple Answer Multiple Choice Short Answer Split Screen Typing Question has any number of answers and may have one or more correct answers. The answers designated as correct must be selected by the candidate for the question to be scored as correct. There must be a minimum of two answers from which the candidate can choose. Questions may have any number of answers, one of which must be indicated as the correct answer. There must be a minimum of two answers from which the candidate can choose. A question that is answered by a typed answer. For example, a spelling question. The answer is checked against a string comparison. The text is displayed in the top pane on-screen so there are no text originals. The text is not visible before the timer starts. Type the text directly into the Text box. Do not copy text from another document and paste into the Text box. Text True False Typing Question is typed in the Question Text tab. The answer is a typed answer. The answer is checked against a string comparison. Question is stated in such a way that the candidate answers whether the statement is true or false. Question consists of the key press text for a typing test and for the warm up. Name the warm up typing question so that you can easily identify the question as the warm up. 9. In the General tab, if applicable, modify the question description in the Description field. The description briefly states what the question is assessing. You may need to search the Question list by description to easily find a particular question or set of questions. 10. In the Topic field, if applicable, modify or enter the brief topic name. As an example, enter the objective heading for the question, summary statement or it may remain blank. 11. In the Reference field, modify or enter notes, revision dates, or it may remain blank. 12. The Is Active option is selected by default so that the question will be available when you create a test. Deselect this option if you want to continue to work on the question later. 13. If applicable, click the Skill Level list arrow and select a different question skill level. Skill level options are Basic, Intermediate, Advanced or N/A. 14. Click the Question Text tab. Questions 1. To modify the question text, click the Enter Text button next to the Enter Question Text box. The text editor displays. For assistance using the editor, refer to the Help file Using the Edit HTML Editor. 2. Modify the question text and use any of the formatting buttons if necessary. 3. Click Done. The Enter Question Information screen redisplays. 4. Click the Answers tab. Page 12

14 Answers 1. To display the answers randomly to the candidate, select the Randomized checkbox. 2. For commonly used answers, click the Use Common Answer Type list arrow and select an answer type. Refer to the table below for common answer types: Question Type Definition 1-5 answers are listed from number 1 to 5 Agree/Disagree Agree/Disagree 4 pt Agree/Disagree 5 pt Frequency 5 pt Important 5 pt Likelihood 5 pt Never/Always 5 pt Poor/Outstanding 6 pt Speed 5 pt True/False two answers are displayed: Agree and Disagree four answers varying in degree from Agree to Disagree five answers varying in degree from Agree to Disagree five answers of varying degrees of occurrences five answers of varying degrees of importance five answers of varying degrees of chances five answers of varying degrees of frequency six answers of varying degrees of quality five answers of varying degrees of promptness two answers are displayed: True and False 3. To change which answer is the correct answer, click the Correct option in the Correct column. You can have more than one correct answer for Multiple Answer question type. Finish To remove an answer box, click the Remove (X) button that is located to the left of the answer box. To add another answer box, click the Add Answer button. To save the current question, click the Update button. OR To save time when creating questions with similar or identical attributes, including question/answer text, use the Save As button. The Save As button creates a copy of the current question, including question and answer(s) fields, and saves it as a Page 13

15 new question that can be edited at any time. To create the duplicate, enter a new question name for the duplicate by modifying the current question Name field at the top of the screen and click the Save As button. To preview the question as it will appear to the test taker, click the Preview button at the bottom of the screen. To exit the Enter Question Information screen without saving your changes, click the Cancel button. To preview the question as it will appear to the candidate, click the Preview button. To learn how to create the type of questions listed in the above table, refer to the previous section on Adding A Test Question. Adding a New Test The Enter Test Information screen allows you to create a new test using existing questions within the database. Next, the test administrator is able to assign the test in a test session to a candidate. When creating a new test, you can set test rules such as navigation, which item types are presented together in the test or on a page inside the test, timing, instructions and stem collapsing. You can preview, print, clone, and save the test. You can also set the default scoring rollup. The administrator obtains a list of the dimensions in the test and determines the hierarchy of scoring (child ID, parent ID, weight, mean, SD, display flag, and label). The overall score has no parent but can have a label. The label can match a dimension name without error. SHL does not recommend assigning the same question to more than one section within a test. WARNING: SHL recommends previewing and testing each assessment before administering. Verify the presentation and functionality of the test questions, that the score report distinguishes correct and incorrect answers as intended, and that the score report is retrievable through the Select2Perform application. NOTE: Some question types cannot be combined into a single test. For more information, please contact the Previsor Technical Support Center. To create a new test from existing questions, use the following steps: 1. Click the CAB menu, and under CAB, click Test. NOTE: The CAB menu will only display if your company has purchased this option. The Search for Existing Test(s) screen displays. 2. Click the Add button. The Enter Test Information screen displays. 3. In the Name field, enter the name of the test. The text you enter will display as the name of the test in a candidate's test session. If this is going to be a warm up test, Warmup must be the first word of the name. 4. Click the Check button. Page 14

16 5. Select2Perform searches the database for an identical name. If one is found, type a different name. If there is not an identical name, click OK in the Results dialog box. 6. Under the General tab, in the Report Label field, enter a brief label for the test that will display in the Job Summary Report and the Test Session Status page. 7. In the Descriptive Label field, enter the display name of the test. 8. In the Description field, enter the full name of the test and any description information. 9. The Avg. Time to Complete option has a default value of 1200 seconds. This option is associated with the progress bar, which gives candidates an indication of their progress through an entire test session or sitting. The progress bar does not move during the test. You can modify this value. The system computes the relative length of each test to more accurately indicate the progress. If Avg. Time to Complete option is not set, no progress bar will display. For one-question tests such as Typing, the Avg. Time to Complete field must be blank. One-question tests should not have the progress bar display. 10. The Active option is selected by default so that the test will be available for creating test sessions. De-select this option if the test will not be ready to use in a test session OR the test you are creating will be used as a Warm up Test. 11. If a warm up test is needed for this test, click the Select button to the right of Warmup Test field. Then click the list arrow and select the appropriate warm up test. Click OK. NOTE: Warm up Tests must be Inactive to display in the available Warmup list. Adding Sections The UnitValue is calculated automatically based on the number of questions added to a test. Questions can be grouped into sections with specific instructions and options for each section. Each test must have at least one section and one question. Sections of questions can be presented in the order you assign or they can be presented randomly. Select either Sequential or Random from the Section Order list. The Random option delivers the sections in random order except instruction-only sections. Each instruction-only section will attach to the next sequential section so that they accompany the related question section. To add a section, use the following steps: 1. Click the Sections tab. Section 1 is inserted automatically with no questions. Page 15

17 2. Click the Edit icon of Section 1. The Edit Test Section screen displays. Instructions 1. If you want instructions to display at the top of the page of questions for this section, click Enable under Section Instruction Page. Each instruction-only section will attach to the next sequential section so that the sections accompany the related question section. Page 16

18 2. Click the + button in the Click + for formatting options field below the Heading field. The text editor displays. For assistance using the editor, refer to the Help file Using the Edit HTML Editor. 3. Type a title text for the instructions and use any of the formatting buttons if necessary. The Enter Test Information screen displays the entered text with the assigned formatting. 4. Click the + button in the Click + for formatting options field below the Text field. The text editor displays. For assistance using the editor, refer to the Help file Using the Edit HTML Editor. 5. Type instructions for this section of questions and use any of the formatting buttons if necessary. The Enter Test Information screen redisplays. Options 1. The default option for Question Order is Fixed. If you want the questions to be presented randomly in this section, click the list arrow and select Random. Page 17

19 2. Click the Presentation list arrow and select an option. All Questions on one page (several multiple-choice or multiple-answer questions on a page and can include the instructions at the top of the page) If consecutive questions within a section share the same stem, the stem is automatically collapsed when the test is displayed so that more questions can display on the page without scrolling. Likewise, if the answers are the same for consecutive questions, the response labels are displayed in a legend above the response column and the response options are displayed horizontally to conserve space. One Page Per Question (single question on a page and can include instructions at the top of the first page. You can mix question types in a test with this option.) One Question Per Page With Repeating Instructions (single question on a page, but the instructions repeat on each page in the section). 3. Click the Question List tab. Question List 1. Click the Product list arrow and select a product line (such as Technical IT) from which you will choose questions. If you have created custom questions for your test, select CAB in the Product drop-down list. 2. Click the Category list arrow and select a category (such as Database Design and Administration) from which you will choose questions. If you have created custom questions for your test, select Custom in the Category drop-down list. 3. If not already selected for you, click the Application list arrow and select an application (if applicable). You will usually select an application for Software Skills. If you have created custom questions for your test, select Custom in the Application drop-down list. Page 18

20 4. Click the Load Available Question(s) button. The list of available questions displays. Select a question from the available questions box and click the Add button. You can select more than one question by holding down the Ctrl key while selecting other questions. NOTE: After adding some questions, you can choose another product and category to select different types of questions for your test. Some question types, such as simulation questions, will not work if more than one question is assigned to each section. Make sure All Questions on One Page presentation type is selected. Preview the section to make sure all questions are displayed appropriately. NOTE: If you are creating a test with simulation questions, select the Do Not Force Full Screen option to avoid a Windows XP/Vista focus issue that could cause misinterpretation of responses and inability to type in input fields in the simulation questions. If more than one question is assigned to a section, Question Order and Auto Advance are ignored when set in the test Options tab. To preview a question before adding to a test, click the Description button. When the View a Question window displays, select the Add to Question List button to select the question for your test or click the Close button to return to the available questions list. Click the Add All button to include all the available questions. To reorder the questions in the Selected Questions box, select a question and click either the Up or Down button to move the question. To move questions between sections, select the appropriate option from the Move To pulldown menu. To remove a question from the Selected Questions box, select the question and click the Remove button. To delete all of the questions from the Selected Questions box, click the Remove All button. To view the test with the selected questions as it will appear online to the test taker, click the Preview button. When you are finished adding questions to the test, click Done. The Enter Test Information screen redisplays and the section is added. Page 19

21 To add another section to the test, click Add Section and repeat steps beginning with Instructions. To review the section as a candidate would view it, click the Preview icon of the section you want to review. To rearrange the sections, click Up or Down within the section. To remove a section, click the Delete icon within the section. To preview the entire test as the candidate would view it, click the Preview button at the bottom of the screen. Options 1. Click the Options tab to select the available test options. Refer to the table below: Test Option Navigation Description Exit - displays the Exit button in the test. Consequently, the test is scored and documented as complete. Preload - used for tests with large graphic files in the test questions. This option loads all graphics before the first test question (slight delay), eliminating the load delay per question. Not compatible with Restart Where Left Off or Review Skipped options. Auto Advance - answering a question will automatically display the next question. Commonly used on multiple choice, multiple answer, and true false type questions and is used currently by Primary Skills tests. Finish - displays the Finish button for one-question test. Skip - allows the candidate to skip the current question and displays the Next button. Page 20

22 Jump - allows the candidate to go to any question in the test. Also displays First, Back, Next, and Last buttons. All Required - each question must be answered before advancing to the next question. The Next button is disabled until an answer is selected. If you select All Required, then Auto Advance, Skip, and Jump options are ignored. Restart None - restricts candidate from restarting if intentionally or accidentally exits. Do not use this option with Allow exit and re-entry. If used in combination, the result is Test Locked screen. From Beginning - restarts a test from the first question if the test is interrupted (lost Internet connection, reboot, etc.) or the candidate exited the test using Allow exit and re-entry option. Where Left Off - restarts a test from the first question not answered if the test is interrupted (lost Internet connection, reboot, etc.). Allow exit and re-entry Review allows a candidate to intentionally exit and then re-enter the test at a later time. Exiting the test under this option doesn't close the test or tabulate the scores until the candidate returns and completes it. Must have Restart Where Left Off selected and not From Beginning or None. If an Expiration Days value has been entered in the test session, the system alerts the candidate of the duration when he or she can re-enter and finish the test. All - allows the candidate to click Review All or Review Skipped button. Review All option displays the first question in the test and allows the candidate to change his/her answers when reviewing the questions. Review Skipped displays only those questions that the candidate skipped for review. The Review Skipped button will not display for a preloaded test with Review All option. None - restricts the candidate from reviewing questions after completing. Timing Time limit (Seconds) Test - time limit is assigned to the entire test. Question - time limit is assigned to each question in the test. The timer restarts at each question. All questions in the test are assigned the same time limit. duration permitted for the test or each question. For example, a 30 minute test is 1800 seconds. If you do not want a time limit for the test or question, keep the field blank. Page 21

23 Alert Limit Question Order Proctored only Require experience level Allow Clear Selection Display answer labels in score report displays a red alert in the test when the time limit is nearing. Select from the following options: no limit 30 seconds 1 minute 3 minutes 5 minutes Fixed - the sequential method (the question order is defined when the test was created) is used. Random - presents questions without a fixed order. Allow Choice - enables a test administrator (when creating a new test session) to choose type of order when creating the library or job. These options apply to one-section tests. Settings in the section options tab define the order of items within sections. for specific tests that require an administer to be present during testing. If the option is selected, a screen will prompt the administrator to log in the test session before the candidate begins the test session. requires the test taker to enter his/her experience level (years, months, type of experience) information, which is captured for the test. This option is not used and is being phased out. adds a Clear button to the bottom of each test page. When clicked, it removes any entry the candidate has made but does not reset the timer, if one exists. This option only applies to Multiple Choice, Multiple Answer, preload tests, and multiple questions per page. displays the answer labels in the score report. The detail score report shows the answer label in the Response column instead of the corresponding letter. For multiple-choice questions, the answer text displays for the selected answer. For typing questions, the text that candidate types displays; for true/false questions, True or False displays. This is useful for creating screening tests that ask questions such as "how much experience do you have with Excel?" since it will display an answer label of "2-3 years" rather than the label sequence of "b." No scores in Table Reports Display or hide scores on the Job Summary Report as well as table reports. When checked, it displays Multiple. This is used for tests with multiple scores and no overall score. Do Not Force Full Screen allows the candidate to minimize the screen and search the Internet for answers. This option is typically used for IT Page 22

24 assessments. NOTE: If you are creating a test with simulation questions, select this option to avoid a Windows XP/Vista focus issue that could cause misinterpretation of responses and/or the inability to type in input fields in the simulation questions. Scoring Administrator Passing Score -- when creating a job or library, the Test Administrator can enter a passing score in the Passing Score field in the Advanced Options screen. Label -- if the Administrator Passing Score option is enabled, designate a label for the passing score by entering the criteria in the Label field. For example, NWPM for net words per minute or /40 would indicate a score out of 40 possible. Early Termination -- if Passing Score is enabled, indicates that the test session will terminate if the passing score criterion is not met. The system recalls unused units for terminated test sessions. If Early Termination is enabled, then the progress bar will not display. Scoring Standard - scoring is defined by the question type. For example, gives a weight value of one for each correct answer and does not assign a weight value to incorrect responses. This type of scoring is also for tests such as typing that do not have correct or incorrect answers. Wrongs Worth 1, Wrongs Worth 1/4, Wrongs Worth 1/3, Wrongs Worth 1/2 - used for Essential Skills tests. This scoring option calculates penalties for guessing. Incorrect answers are weighted against correct answers. 2. If you want overall instructions for the test, click the Instructions tab. Adding Instructions If you want instructions that pertain to the overall test, you can create your own instructions. If you choose Standard instructions, the test description displays from the General tab. SHL does not recommend displaying the test description to the candidate. Select None if you do not want test instructions to display to the candidate. If you want your own instructions for the test, use the following steps: 1. From the Instructions tab, click the Instruction Page list arrow and select Custom. Page 23

25 2. The default template is Standard. The standard template pulls test options such as time limits, review options, and navigation and displays the information at the top of the instructions page before the candidate begins a test. Finish 1. When you are finished adding sections and questions, click Add. A confirmation dialog box displays. 2. Click OK. The test is saved. NOTE: Please verify the presentation and functionality of the test questions to ensure correct test behavior and scoring. You may edit the test and then click Preview to run through the test. Editing a Test To modify a test, use the following steps: NOTE: Changing test questions many not allow test validation practices when scores are compared with the previously calculated scores. 1. Click the CAB menu, and under CAB, click Test. Page 24

26 NOTE: The CAB menu will only display if your company has purchased this option. The Search for Existing Test(s) screen displays. 2. Click the Edit button of the test you want to change. The Update Test Information screen displays. 3. To change the name of the test, click in the Name field and enter the name of the test. The text you enter will display as the name of the test in a candidate's test session. If this is going to be a warm up test, Warmup must be the first word of the name. Click the Check button. Select2Perform searches the database for an identical name. If a match is found, type a different name. If there is not an identical name, click OK in the Results dialog box. 4. If applicable, modify the label in the Report Label field. 5. If applicable, modify the label in the Descriptive Label field. 6. If applicable, modify the description in the Description field. 7. The Avg. Time to Complete option has a default value of 1200 seconds. This option is associated with the progress bar, which gives candidates an indication of their progress through an entire test session or sitting. The progress bar does not move during the test. You can modify this value. The system computes the relative length of each test to more accurately indicate the progress. If Avg. Time to Complete option is not set, no progress bar will display. For one-question tests such as Typing, Avg. Time to Complete field must be blank. One-question tests should not have the progress bar display. 8. The Is Active option is selected by default so that the test will be available for creating test sessions. De-select this option if the test will not be ready to use in a test session OR the test you are creating will be used as a Warmup Test. 9. To select a warm up test, click the Select button to the right of Warmup Test field. Then click the list arrow and select the appropriate warm up test. Click OK. Page 25

27 NOTE: Warmup Tests must be Inactive to display in the available Warmup list. The UnitValue is calculated automatically based on the number of questions added to a test. 10. Click the Sections tab to edit specific test sections. Sections 1. Sections of questions can be presented in the order you assign or they can be presented randomly. Select either Sequential or Random from the Section Order list. The Random option delivers the sections in random order except instruction-only sections. Each instruction-only section will attach to the next sequential section so that they accompany the related question section. 2. Click First Section Not Experimental if you do not wish the test to be scored. When all the questions in the section are experimental, the section is assumed to be experimental regardless of the checkbox setting. 3. If you do not want the experimental sections to present in sequence, click Experimental Sections Not Consecutive. Section 1 is inserted automatically with no questions. 4. Click the Edit icon of Section 1. The Edit Test Section screen displays. NOTE: The product and category search fields will default to the product and category you selected on the general tab of the test when you are completing Edit Test Section. Refer to the following table when selecting Edit Test Section options: Instructions Standard -- the test description displays from the General tab. None -- no test instructions to display to the candidate. Custom -- Template: standard template pulls test options such as time limits, review options, and navigation and displays the information at the top of the instructions page before the candidate begins a test. Title -- heading at the top of the instructions page. Instructions -- custom instructions that display to the candidate before the candidate begins a test. Each instruction-only section will attach to the next sequential section Page 26

28 Options so that they accompany the related question section. Question Order Fixed indicates that the questions will be presented in the order that they were assigned when the test was created. Random indicates. If the question order is set here, the system ignores the question ordering on the test Options tab. Presentation displays the organization option for that section. The options are: All Questions on one page (multiple questions on a page and can include instructions) One Page Per Question (single question on a page and can include instructions) One Page Per Question With Instruction (single question on a page but the same instructions repeat on each page in the section). Question List When the administrator selects multiple items on a page for a test section and the stem and responses are the same for consecutive questions, the system collapses the stem and the response labels when the candidate is taking the test. displays the available questions for each test section. Once questions have been added to each section you can move questions between sections by selecting the appropriate option from the Move To pulldown menu, Options 1. Click the Options tab to edit the available test options. Refer to the table below: Test Option Navigation Description Exit -- displays the Exit button in the test. Consequently, the test is scored and documented as complete. Preload -- used for tests with large graphic files in the test questions. This option loads all graphics before the first test question (slight delay), eliminating the load delay per question. Not compatible with Restart Where Left Off or Review Skipped options. Auto Advance -- answering a question will automatically display the next question. Commonly used on multiple choice, multiple answer, and true false type questions and is used currently by Primary Skills tests. Finish -- displays the Finish button for one-question test. Page 27

29 Skip -- allows the candidate to skip the current question and displays the Next button. Jump -- allows the candidate to go to any question in the test. Also displays First, Back, Next, and Last buttons. All Required -- each question must be answered before advancing to the next question. The Next button is disabled until an answer is selected. If you select All Required, then auto advance, Skip, and Jump options are ignored. Restart None -- restricts candidate from restarting if intentionally or accidentally exits. Do not use this option with Allow exit and re-entry. If used in combination, the result is Test Locked screen. From Beginning -- restarts a test from the first question if the test is interrupted (lost Internet connection, reboot, etc.) or the candidate exited the test using Allow exit and re-entry option. Where Left Off -- restarts a test from the first question not answered if the test is interrupted (lost Internet connection, reboot, etc.). Allow exit and re-entry Review allows a candidate to intentionally exit and then re-enter the test at a later time. Exiting the test under this option doesn't close the test or tabulate the scores until the candidate returns and completes it. Must have Restart Where Left Off selected and not From Beginning or None. If an Expiration Days value has been entered in the test session, the system alerts the candidate of the duration when he or she can re-enter and finish the test. All -- allows the candidate to click Review All or Review Skipped button. Review All option displays the first question in the test and allows the candidate to change his/her answers when reviewing the questions. Review Skipped displays only those questions that the candidate skipped for review. The Review Skipped button will not display for a preloaded test with Review All option. None -- restricts the candidate from reviewing questions after completing. Timing Test -- time limit is assigned to the entire test. Question -- time limit is assigned to each question in the test. The timer restarts at each question. All questions in the test are assigned the same time limit. Page 28

30 Time limit (Seconds) Alert Limit (seconds) Question Order Proctored only Require experience level Allow Clear Selection Display answer labels in score report duration permitted for the test or each question. For example, a 30 minute test is 1800 seconds. If you do not want a time limit for the test or question, keep the field blank. displays a red alert in the test when the time limit is nearing. Select from the following options: no limit 30 seconds 1 minute 3 minutes 5 minutes Fixed -- the sequential method (the question order is defined when the test was created) is used. Random -- presents questions unordered. Allow Choice -- enables a test administrator (when creating a new test session) to choose random ordering of questions. These options apply to one-section tests. for specific tests that require an administer to be present during testing. If option is selected, a screen will prompt the administrator to log in the test session before the candidate begins the test session. requires the test taker to enter his/her experience level (years, months, type of experience) information, which is captured for the test. This option is not used and is being phased out. adds a Clear button to the bottom of each test page. When clicked, it removes any entry the candidate has made but does not reset the timer, if one exists. This option only applies to Multiple Choice, Multiple Answer, preload tests, and multiple questions per page. displays the answer labels in the score report. The detail score report shows the answer label in the Response column instead of the corresponding letter. For multiple-choice questions, the answer text displays for the selected answer. For typing questions, the text that candidate types displays; for true/false questions, True or False displays. This is useful for creating screening tests that ask questions such as "how much experience do you have with Excel?" since it will display an answer label of "2-3 years" rather than the label sequence of "b." No scores in Table Reports displays or hides the main score on Job Summary report as well as table reports. When it is checked, it hides the main score. Page 29

31 Do Not Force Full Screen Scoring allows the candidate to minimize the screen and search the Internet for answers. This option is typically used for IT assessments. NOTE: If you are creating a test with simulation questions, select this option to avoid a Windows XP/Vista focus issue that could cause misinterpretation of responses and/or the inability to type in input fields in the simulation questions. Administrator Passing Score -- when administering a test or creating a library, setting criteria will allow the Test Administrator to enter a passing score in the Passing Score field in the Advanced Options screen. Score -- if the System Passing Score option is selected, enter the score to be used as the passing score for all companies that use the test. Label -- if the Administrator Passing Score option is selected, designate a label for the passing score by entering the criteria in the Label field. For example, WPM for words per minute or /40 would indicate a score out of 40 possible. Early Termination -- if Passing Score is enabled, indicates that the test session will terminate if the passing score criterion is not met. The system recalls unused units for terminated test sessions. If Early Termination is enabled, then the progress bar will not display. Scoring Method Standard -- scoring is defined by the question type. For example, gives a weight value of one for each correct answer and does not assign a weight value to incorrect responses. This type of scoring is also for tests such as typing that do not have correct or incorrect answers. Norm Group Wrongs Worth 1, Wrongs Worth 1/2, Wrongs Worth 1/3, Wrongs Worth 1/4 -- used for Primary Skills tests. This scoring option calculates penalties for guessing. Incorrect answers are weighted against the correct answers. select from the pull-down menu. Score Report Text displays the selected text on the Score Report. Page 30

32 Finish 1. To preview the test as it will display to applicants, click Preview. The test will open in a new window. 2. When you are finished editing sections and questions and to save the test under a different name, click Save As. A confirmation dialog box displays. 3. To save the changes to the test, click Update. A confirmation dialog box displays. Page 31