Test Pilt User Guide Adapted frm http://www.clearlearning.cm Accessing Assessments and Surveys Test Pilt assessments and surveys are designed t be delivered t anyne using a standard web brwser and thus are accessible by simply clicking upn a web page link r typing in an apprpriate URL. All Test Pilt surveys use.tp3 as the file extensin (example: http://tpilt.mcps.k12.md.us/tpilt/departments/tp.tp3). Getting Started When yu begin editing an assessment, yu'll ntice that the screen is divided int three sectins. The left hand panel is, as shwn t the left, a list f the majr functinal areas f editing an assessment. lk and feel - when yu click n this link, the right hand panels will ffer ptins fr adjusting the presentatin f the assessment as web pages. This includes ptins like the title and instructins as well as hw questins are presented (e.g. all at nce r ne at a time) create questins - clicking n this link allws yu t add a questin t yur list f questins. Yu can als click upn a questin title in the list prvided t edit that questin. Nte that nt every questin in the list need appear n the assessment presented t the participants. chse questins - this link prvides yu with the functins fr gruping, categrizing and/r selecting thse questins that yu wish t appear n the web pages presented t participants. submit actins - this link prvides access t the features that determine what actins shuld be taken nce a participant submits their respnses t yur questins. These culd include issuing custm scre-based feedback r transferring the participant t anther web page based upn their scre. security - the ptins available frm this link allw yu t determine t whm yur assessment is ffered, at what time and lcatin and hw many times the assessment may be accessed. 1
The Shw Test buttn allws yu t preview yur assessment in a separate windw at any time. This is an especially pwerful feature t use when editing. Yu may actually participate in yur assessment at any time t test its features and see hw it will appear t yur assessment's participants. Saving yur Changes - Dn't frget t Update! It shuld be nted that n all editing panels, yu will see ne r mre Update buttns. Whenever yu adjust a cntrl r make changes t any item, yu must click an Update buttn t recrd the changes. Yu may make multiple changes and then click Update, but if yu fail t click the Update buttn, yur changes may nt be recrded. Editing Lk and Feel (See Figure 1 n the next page.) Editing the lk and feel f an assessment is brken dwn int three areas. Edit Headers & Fters - this allws yu t edit the title, heading, instructins, attributin, and fter messages shwn n web pages generated by Test Pilt fr the assessment participants. Define Page Layut - this allws yu t cntrl hw yur questins are presented n web pages generated by Test Pilt. This includes features such as: ffering all questins at nce versus ne-at-a-time r a grup-at-a-time shuld questins be numbered shuld Test Pilt branch t anther questin based n the participant's respnse what clr and size shuld be used fr questin text and many mre such features... Set Editing Defaults - this allws yu t set up sme default values fr use when editing questins. This includes features such as: default questin type default questin grup membership default text bx size fr essay questins and ther such features... 2
Figure 1 Editing Headers & Fters Title - this text is shwn in the brwser title bar when the test is generated. Header - this text is shwn in large bld text centered at the tp f the assessment's web page(s). Instructins - this text is shwn in nrmal sized text indented belw the title at the tp f the assessment's web page(s). Prepared by - this text is shwn italicized and right justified belw the questins n the assessment's web page(s). Fter - this text is shwn as nrmal sized text indented at the bttm f the assessment's web page(s). 3
Creating and Editing Questins In the next step f assessment creatin, yu authr questins. The questins need nt appear n the assessment. That is, yu can create a large pl f questins and then later manually r autmatically select the nes yu wish t be included n the assessment. The prcess begins with clicking n the Create Questins link in the left hand panel f the editing screen. Once a new questin is created, it is assigned a unique id and then added t the list shwn belw the Create Questins link. At any time, yu may click upn an item in this list t edit the questin. Cmmn Questin Cntrls There are a number f cntrls cmmn t every questin type. Cnsider the fllwing: Questin - this is the text f the questin ffered t the participant. The text will be frmatted accrding t the layut specificatins that yu have selected fr the assessment. 4
Creating Questins When yu click the create questins link, yu are asked t select the type f questin that yu wish t authr. The default chice fr questin type can be set in the Lk & Feel, Editing Defaults area. Once yu have made a selectin, click the Create buttn t create the questin and begin editing it. Questin Types Yes r N and True r False - These are typically tw chice questins. They may include an ptinal respnse f nt applicable. Yu may als ptinally include a custm, unscred, fllw-up text entry questin such as If yes, why? r the like. Custm feedback messages may be defined and be issued based upn each pssible participant respnse. Differing pint values may be assigned t either f the questin's pssible respnses. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the participant's respnse t the current ne. Multiple Chice - Yu may define any number f pssible chices fr this type f questin. They may include an ptinal respnse f ther with a custm-sized text entry bx. Custm feedback messages may be defined and be issued based upn each pssible participant respnse. Differing pint values may be assigned t each f the questin's pssible respnses. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the participant's respnse t the current ne. Fill in the Blank - This type f questin includes shrt answer and numeric respnse questins. Custm feedback messages may be defined and be issued based upn whether the questin is evaluated as crrect r incrrect. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the evaluatin f the participant's respnse. Essay - This type f questin is nt autmatically scred. Hwever, using the administrative ptins built int Test Pilt, yu may manually scre them nline at any time. 5
Check All That Apply - Yu may define any number f pssible chices fr this type f questin. Custm feedback messages may be defined and be issued based upn whether r nt each pssible participant respnse is selected. Differing pint values may be assigned t each state f the questin's pssible respnses. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the scre evaluated fr a participant's respnses. Survey - Yu may define any number f pssible chices fr this type f questin. They may include an ptinal respnse f nt applicable. This questin type differs frm multiple chice in that pint values and custm feedback may nt be assigned t any f the questin's pssible respnses. Hwever, Test Pilt generates aggregate statistics n the participant s respnses t survey questins autmatically. When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the participant's respnse t the current ne. Matching - Yu may define any number f pssible matches in this type f questin. Custm feedback messages may be defined and be issued based upn whether r nt each pssible participant match is made. Differing pint values may be assigned t each state f the questin's pssible matches (that is, whether r nt a match has been crrectly made). When branching is enabled n a test ffered ne questin-at-a-time, yu can define which questin will be ffered next based upn the scre evaluated fr a participant's matches. Sectin Break - This type f entry is used fr a number f purpses. While n participant respnse data is cllected r evaluated, sectin breaks permit the easy interjectin f additinal text r media items in an assessment. Typical uses include: separatrs between sectins f an assessment additinal instructins preceeding a new sectin a graphic item t preceed several related questins a text item t preceed several related questins an animatin t preceed several related questins a web link t material relavent t a particular questin r set f questins Submissin Actins When a participant submits respnses t the questins n yur assessment, yu determine what will ccur using the ptins and cntrls in assessment creatin, setting the submissin actins. Yu may: d nthing, and Test Pilt will issue a simple thank yu message e-mail the instructr (Nte: e-mail nt available) 6
issue a custm message shw survey statistics send the participant t a particular web site r web page perfrm sme cnditinal feedback actin. These may include: issuing a custm message based upn their ttal scre issuing a custm message based upn their scre n a particular questin grup sending the participant t anther web site r web page based upn their ttal scre sending the participant t anther web site r web page based upn their scre in a particular questin grup 7
Security Authrized Participants Yu may specify a list f participants wh are authrized t access yur assessment. The list cntains user ids and ptinally may include names and e-mail addresses. It is the ids frm this list that users may enter int the Test Pilt lgin screen's user id bx t secure access t yur assessment. Cmparisn IS CASE sensitive! Owner Optins Assessment Administratin If, as the test creatr, yu wish t edit questins r access and analyze participant respnses, yu need t use Test Pilt's administrative r wner ptins. Using the administrative ptins, yu can: view participant respnses dwnlad a spreadsheet f participant respnses fr further analysis view questin statistics including: frequency analysis f respnses with a bar graph mean, maximum and minimum pint awards survey questin statistics and ther statistical items f interest define and generate custm reprts as: web pages spreadsheets server files fr autmated analysis scre essay questins nline 8
rescre any participant respnse scre all respnses t any questin view a list f participant scres dwnlad a spreadsheet f participant scres manage yur respnse data edit yur assessment's questins n the fly Yu may access the administrative ptins f yur assessment by lgging int it with the wner id and passwrd that was specified when creating the test. Viewing Submissins The respnse viewing ptins permit yu t view participant respnses in a number f ways. 1. as a table n a web page 1. as a table n a web page 2. as a web page shwning a particular participant's respnses 3. as a spreadsheet fr yur cmplete statistical analysis 4. as a statistical cmpilatin f user respnse data. 5. in a custm manner where yu define yur wn frmat and delivery methd. When yu click View Respnse Table buttn, a web page is generated frm all participants' respnses t yur assessment. The fllwing is a partial listing f a web page shwing all participant respnses t all questins n an assessment. Nte that crrect answers are clr-cded green while incrrect respnses are clr-cded red. This listing is typically used t get a general verview f an assessment's respnses. 9
Yu can click n a particular number t view that participant's respnses and any available evaluatin f their respnses. 2. as a web page shwing a particular participant's respnses When yu click n View Respnses, yu are taken t the first user's individual respnses and are given the pprtunity t view succeeding participants' respnses. The fllwing shws a typical questin's evaluatin as presented n an individual participant respnse web page. 3. as a spreadsheet When yu click n the Dwnlad Spreadsheet buttn, a tab-delimited file is generated frm the respnses t the questins n yur assessment. Each line f the file represents an individual's respnses t the assessment. Each clumn represents a respnse t a questin n the assessment. Additinal clumns include infrmatin such as: 10
the user id the ip address f the cmputer used t take the assessment the number f secnds it tk fr the participant t cmplete their respnses the scre as an abslute number f pints the scre as a percentage A prperly cnfigured brwser can autmatically dump this int yur favrite spreadsheet r statistical analysis sftware. With all f the raw respnses at yur fingertips, yu can perfrm any analysis imaginable upn the data. 4. as a statistical cmpilatin When yu chse t see a statistical analysis f the respnses by clicking the View Statistics buttn, a web page is generated t shw a frequency analysis f the respnses t each questin n yur assessment. Cnsider the fllwing example shwing just ne questin's analysis. 5. in a custm manner where yu define yur wn frmat and delivery methd 11