Test Pilot User Guide

Transcription

1 Test Pilt User Guide Adapted frm Accessing Assessments and Surveys Test Pilt assessments and surveys are designed t be delivered t anyne using a standard web brwser and thus are accessible by simply clicking upn a web page link r typing in an apprpriate URL. All Test Pilt surveys use.tp3 as the file extensin (example: Getting Started When yu begin editing an assessment, yu'll ntice that the screen is divided int three sectins. The left hand panel is, as shwn t the left, a list f the majr functinal areas f editing an assessment. lk and feel - when yu click n this link, the right hand panels will ffer ptins fr adjusting the presentatin f the assessment as web pages. This includes ptins like the title and instructins as well as hw questins are presented (e.g. all at nce r ne at a time) create questins - clicking n this link allws yu t add a questin t yur list f questins. Yu can als click upn a questin title in the list prvided t edit that questin. Nte that nt every questin in the list need appear n the assessment presented t the participants. chse questins - this link prvides yu with the functins fr gruping, categrizing and/r selecting thse questins that yu wish t appear n the web pages presented t participants. submit actins - this link prvides access t the features that determine what actins shuld be taken nce a participant submits their respnses t yur questins. These culd include issuing custm scre-based feedback r transferring the participant t anther web page based upn their scre. security - the ptins available frm this link allw yu t determine t whm yur assessment is ffered, at what time and lcatin and hw many times the assessment may be accessed. 1

2 The Shw Test buttn allws yu t preview yur assessment in a separate windw at any time. This is an especially pwerful feature t use when editing. Yu may actually participate in yur assessment at any time t test its features and see hw it will appear t yur assessment's participants. Saving yur Changes - Dn't frget t Update! It shuld be nted that n all editing panels, yu will see ne r mre Update buttns. Whenever yu adjust a cntrl r make changes t any item, yu must click an Update buttn t recrd the changes. Yu may make multiple changes and then click Update, but if yu fail t click the Update buttn, yur changes may nt be recrded. Editing Lk and Feel (See Figure 1 n the next page.) Editing the lk and feel f an assessment is brken dwn int three areas. Edit Headers & Fters - this allws yu t edit the title, heading, instructins, attributin, and fter messages shwn n web pages generated by Test Pilt fr the assessment participants. Define Page Layut - this allws yu t cntrl hw yur questins are presented n web pages generated by Test Pilt. This includes features such as: ffering all questins at nce versus ne-at-a-time r a grup-at-a-time shuld questins be numbered shuld Test Pilt branch t anther questin based n the participant's respnse what clr and size shuld be used fr questin text and many mre such features... Set Editing Defaults - this allws yu t set up sme default values fr use when editing questins. This includes features such as: default questin type default questin grup membership default text bx size fr essay questins and ther such features... 2

3 Figure 1 Editing Headers & Fters Title - this text is shwn in the brwser title bar when the test is generated. Header - this text is shwn in large bld text centered at the tp f the assessment's web page(s). Instructins - this text is shwn in nrmal sized text indented belw the title at the tp f the assessment's web page(s). Prepared by - this text is shwn italicized and right justified belw the questins n the assessment's web page(s). Fter - this text is shwn as nrmal sized text indented at the bttm f the assessment's web page(s). 3

4 Creating and Editing Questins In the next step f assessment creatin, yu authr questins. The questins need nt appear n the assessment. That is, yu can create a large pl f questins and then later manually r autmatically select the nes yu wish t be included n the assessment. The prcess begins with clicking n the Create Questins link in the left hand panel f the editing screen. Once a new questin is created, it is assigned a unique id and then added t the list shwn belw the Create Questins link. At any time, yu may click upn an item in this list t edit the questin. Cmmn Questin Cntrls There are a number f cntrls cmmn t every questin type. Cnsider the fllwing: Questin - this is the text f the questin ffered t the participant. The text will be frmatted accrding t the layut specificatins that yu have selected fr the assessment. 4

5 Creating Questins When yu click the create questins link, yu are asked t select the type f questin that yu wish t authr. The default chice fr questin type can be set in the Lk & Feel, Editing Defaults area. Once yu have made a selectin, click the Create buttn t create the questin and begin editing it. Questin Types Yes r N and True r False - These are typically tw chice questins. They may include an ptinal respnse f nt applicable. Yu may als ptinally include a custm, unscred, fllw-up text entry questin such as If yes, why? r the like. Custm feedback messages may be defined and be issued based upn each pssible participant respnse. Differing pint values may be assigned t either f the questin's pssible respnses. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the participant's respnse t the current ne. Multiple Chice - Yu may define any number f pssible chices fr this type f questin. They may include an ptinal respnse f ther with a custm-sized text entry bx. Custm feedback messages may be defined and be issued based upn each pssible participant respnse. Differing pint values may be assigned t each f the questin's pssible respnses. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the participant's respnse t the current ne. Fill in the Blank - This type f questin includes shrt answer and numeric respnse questins. Custm feedback messages may be defined and be issued based upn whether the questin is evaluated as crrect r incrrect. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the evaluatin f the participant's respnse. Essay - This type f questin is nt autmatically scred. Hwever, using the administrative ptins built int Test Pilt, yu may manually scre them nline at any time. 5

6 Check All That Apply - Yu may define any number f pssible chices fr this type f questin. Custm feedback messages may be defined and be issued based upn whether r nt each pssible participant respnse is selected. Differing pint values may be assigned t each state f the questin's pssible respnses. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the scre evaluated fr a participant's respnses. Survey - Yu may define any number f pssible chices fr this type f questin. They may include an ptinal respnse f nt applicable. This questin type differs frm multiple chice in that pint values and custm feedback may nt be assigned t any f the questin's pssible respnses. Hwever, Test Pilt generates aggregate statistics n the participant s respnses t survey questins autmatically. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the participant's respnse t the current ne. Matching - Yu may define any number f pssible matches in this type f questin. Custm feedback messages may be defined and be issued based upn whether r nt each pssible participant match is made. Differing pint values may be assigned t each state f the questin's pssible matches (that is, whether r nt a match has been crrectly made). When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the scre evaluated fr a participant's matches. Sectin Break - This type f entry is used fr a number f purpses. While n participant respnse data is cllected r evaluated, sectin breaks permit the easy interjectin f additinal text r media items in an assessment. Typical uses include: separatrs between sectins f an assessment additinal instructins preceeding a new sectin a graphic item t preceed several related questins a text item t preceed several related questins an animatin t preceed several related questins a web link t material relavent t a particular questin r set f questins Submissin Actins When a participant submits respnses t the questins n yur assessment, yu determine what will ccur using the ptins and cntrls in assessment creatin, setting the submissin actins. Yu may: d nthing, and Test Pilt will issue a simple thank yu message the instructr (Nte: nt available) 6

7 issue a custm message shw survey statistics send the participant t a particular web site r web page perfrm sme cnditinal feedback actin. These may include: issuing a custm message based upn their ttal scre issuing a custm message based upn their scre n a particular questin grup sending the participant t anther web site r web page based upn their ttal scre sending the participant t anther web site r web page based upn their scre in a particular questin grup 7

8 Security Authrized Participants Yu may specify a list f participants wh are authrized t access yur assessment. The list cntains user ids and ptinally may include names and addresses. It is the ids frm this list that users may enter int the Test Pilt lgin screen's user id bx t secure access t yur assessment. Cmparisn IS CASE sensitive! Owner Optins Assessment Administratin If, as the test creatr, yu wish t edit questins r access and analyze participant respnses, yu need t use Test Pilt's administrative r wner ptins. Using the administrative ptins, yu can: view participant respnses dwnlad a spreadsheet f participant respnses fr further analysis view questin statistics including: frequency analysis f respnses with a bar graph mean, maximum and minimum pint awards survey questin statistics and ther statistical items f interest define and generate custm reprts as: web pages spreadsheets server files fr autmated analysis scre essay questins nline 8

9 rescre any participant respnse scre all respnses t any questin view a list f participant scres dwnlad a spreadsheet f participant scres manage yur respnse data edit yur assessment's questins n the fly Yu may access the administrative ptins f yur assessment by lgging int it with the wner id and passwrd that was specified when creating the test. Viewing Submissins The respnse viewing ptins permit yu t view participant respnses in a number f ways. 1. as a table n a web page 1. as a table n a web page 2. as a web page shwning a particular participant's respnses 3. as a spreadsheet fr yur cmplete statistical analysis 4. as a statistical cmpilatin f user respnse data. 5. in a custm manner where yu define yur wn frmat and delivery methd. When yu click View Respnse Table buttn, a web page is generated frm all participants' respnses t yur assessment. The fllwing is a partial listing f a web page shwing all participant respnses t all questins n an assessment. Nte that crrect answers are clr-cded green while incrrect respnses are clr-cded red. This listing is typically used t get a general verview f an assessment's respnses. 9

10 Yu can click n a particular number t view that participant's respnses and any available evaluatin f their respnses. 2. as a web page shwing a particular participant's respnses When yu click n View Respnses, yu are taken t the first user's individual respnses and are given the pprtunity t view succeeding participants' respnses. The fllwing shws a typical questin's evaluatin as presented n an individual participant respnse web page. 3. as a spreadsheet When yu click n the Dwnlad Spreadsheet buttn, a tab-delimited file is generated frm the respnses t the questins n yur assessment. Each line f the file represents an individual's respnses t the assessment. Each clumn represents a respnse t a questin n the assessment. Additinal clumns include infrmatin such as: 10

11 the user id the ip address f the cmputer used t take the assessment the number f secnds it tk fr the participant t cmplete their respnses the scre as an abslute number f pints the scre as a percentage A prperly cnfigured brwser can autmatically dump this int yur favrite spreadsheet r statistical analysis sftware. With all f the raw respnses at yur fingertips, yu can perfrm any analysis imaginable upn the data. 4. as a statistical cmpilatin When yu chse t see a statistical analysis f the respnses by clicking the View Statistics buttn, a web page is generated t shw a frequency analysis f the respnses t each questin n yur assessment. Cnsider the fllwing example shwing just ne questin's analysis. 5. in a custm manner where yu define yur wn frmat and delivery methd 11