Content Creation and Management System. External User Guide 3 Question types in CCMS (an overview)

Transcription

1 Content Creation and Management System External User Guide 3 Question types in CCMS (an overview) External User Guide 3 Mar 2015

2 CONTENTS 1. INTRODUCING THE SYSTEM AND ACCESS Audience Background Benefits to authoring in XML BEGINNING TO AUTHOR The Structure Panel Inserting content above, below and within COPYING AND PASTING AND EXAMPLES Deleting Questions/Content QUESTION TYPES OVERVIEW INSERTS EQUATIONS INSERTING IMAGES Uploading an Image from your computer Search for an image in the image bank Adding a placeholder Copyright Editing images INSERTING OTHER KEY FUNCTIONS Symbols (including Scientific) Whitespace Footnotes Stage Excerpts Contents Pages Statistics INCOMPLETE RULES AND GUIDELINES PREVIEWING MATERIALS WORK COMPLETION Save and close from the Authoring screen Completing and submitting a task External User Guide 3 Mar 2015 Page 2 of 31

3 You will find the following symbols in this document: Helpful hints and tips Things to note External User Guide 3 Mar 2015 Page 3 of 31

4 1. Introducing the System and Access 1.1. Audience The intended audience for this user guide are the authoring team (setters, revisers, chief examiners, chairs pre-testers, scrutineers, language modifiers, etc.) and process management teams (known as Project Administrators in CCMS). These roles need to either write and/or amend assessment materials for syllabus components in CCMS: Author Background CCMS is a system for creating, reviewing and managing assessment materials. It will replace existing materials management systems and processes and bring improvements to the materials production process, in particular item and question paper production, while giving us all additional capabilities. At a very high level, there are 4 steps which describe how material is created and reviewed using CCMS: An author is commissioned to author material within CCMS (optional templates and instructions are added). Material is authored in an Extensible Markup Language (XML) tool., XML is standard English, that unknowingly to the author, includes a set of rules for formatting and encoding. This allows material to be written only once, for both paper and computer based tests, increasing the speed in which we can create materials. Material is tagged against agreed attributes for the syllabus, e.g. content, assessment objectives (tagging of material allows for linking, searching and other allied educational processes). Material moves from stage to stage (reviewing, etc.) on a pre-defined electronic workflow. all editing of material when reviewed is version controlled Benefits to authoring in XML Rules can be set against content so that it can be rendered (generated) automatically, eradicating the need to typeset content. Content can be rendered directly into HTML format, which can be used for Computer Based Testing. Material only needs to be keyed in once therefore. Content can be tagged to taxonomies, providing the capacity to store and re-use material when appropriate to do so. External User Guide 3 Mar 2015 Page 4 of 31

5 2. Beginning to Author When you select a task from your list and select edit you will be taken to the authoring area. The main screen appears in 3 panels: Structure Panel Authoring panel Attribute panel The attribute panel has 6 tabs and the content in each can change depending on the actions you are taking and against which part of the structure you are taking it. Depending on the role you have, some of these tabs will only allow you to view the content and others will allow you to and or control your authoring activity. The structure panel may already contain some content, even if you are the first person in the process. CCMS allows us to add standard information (such as the front cover and candidate information). This has all been designed to meet the new OCR question paper House style, which may differ from that you have used in the past. Your Process Management team will have created your authoring task on an agreed template. This leaves you free to author the questions in particular ways. Some of these templates may define the question in particular ways (font, spacing, type) as appropriate to the question paper you are authoring. The Process Manager can make changes to the template that you may be unable to do. If you are having a problem displaying content in a particular way please discuss this with them. External User Guide 3 Mar 2015 Page 5 of 31

6 2.1. The Structure Panel Inserting Questions and Question Groups To begin authoring right click on Assessment Test and choose the appropriate option under the Insert Within drop down menu. Start with a task in which you can enter your Questions or question groups The most frequently used options are Question and Question Group. Question Groups determine numbering. They are ordinarily added before questions (although questions can be dragged and dropped into question groups after they have been added). The two reasons you need question groups are: 1. Questions added beneath question groups appear as 1(a), 1(b), etc.) 2. If questions share one common stimulus and numbering goes down to 1(a)(i), then two question groups should be added before the first question. Tasks and Sections are used, as and when the assessment materials being authored include them. There are a number of different question types you can insert and several have a number of different presentation options (for example across or down the page for multi-choice options. Each of the question types and their characteristics are explored in individual supplements 2.2. Inserting content above, below and within Once content is authored, you may right click on any element (Question, Question Group, etc.) in the Structure Window and choose to insert other elements (Question, Question Group, etc.) above, below or within the element highlighted. See below. External User Guide 3 Mar 2015 Page 6 of 31

7 Any element can be dragged and dropped within the Structure Window as appropriate. When dragging and dropping any element within the Structure Window the blue line and blue dot illustrate where the element you are dragging will be dropped. This is shown in the below image. If you change the question order the numbers will automatically change to reflect the new order If this order change happens AFTER commenting has taken place the comments need to be moved to keep the association. You can do this by creating new comments and copying the content across External User Guide 3 Mar 2015 Page 7 of 31

8 3. Copying and Pasting and examples Choose Insert Duplicate Below to copy the question highlighted at the bottom of the assessment materials written thus far. See below. This will create the next question as a complete duplicate of the original with the exception of the mark scheme details To set a question as an example, choose Set as Example. The example will appear ABOVE the question selected thus External User Guide 3 Mar 2015 Page 8 of 31

9 3.1. Deleting Questions/Content Highlight the element in the Structure Window you would like to delete, right click on it and choose Delete. Using this function deletes all content that may be within the element highlighted (e.g. if you delete a Question Group, all questions within it will be deleted too - see below). External User Guide 3 Mar 2015 Page 9 of 31

10 4. Question Types Overview There are a number of different types of question you can insert. Each question type is defined by how a candidate would interact with them. For this reason, they are referred to within this document as Interaction types. The following lists all of the different interaction types CCMS holds: Date / Time Question Extended Text Graphic Map Inline Choice Inline Common Choice Inline Text Entry Matching Multiple Choice Multiple Choice Table Fill-in-the-gap Table Speaking Interaction True/False The candidate is given a time or date format to complete in response to a question. The candidate is given a designated area in which to write or draw a response to a question. The response area can contain lines (for writing) or be left blank (for drawing). To be added The candidate is presented with a block of text which contains a number of gaps. The candidate is presented with a set of choices for each gap from which to choose an answer. The choices are different for every gap in the block of text. The candidate is presented with a block of text which contains a number of gaps. The candidate is presented with a set of choices for each gap from which to choose an answer. The same choices are available for each of the gaps. The candidate is presented with a block of text which contains a number of gaps. The candidate inserts an answer into each gap. The candidate is given 2 sets of data and asked to match them. The matches may be one to one, one to many, or many to many. The candidate is presented with a set of options from which to choose an answer to a question or statement. There may be stimulus content included. The candidate can select one answer, or more than one answer from the list of options. The candidate is presented with a set of options from which to choose an answer to a question or statement. There may be stimulus content included. The candidate can select one answer, or more than one answer from the list of options. The options are laid out in a table. The candidate is presented with a table with some missing data. They are required to fill in the missing data. To be added Currently Cambridge English specific. The candidate is presented with a statement and is asked to decide whether it is true or false. The labels True and False can be changed. External User Guide 3 Mar 2015 Page 10 of 31

11 Your Process manager may have elected to limit the types of question type you can use based on the needs of the question paper and regulatory requirements Inserting each question can offer a number of different attribute options. These are covered in the relevant detailed supplements. The common steps and main differences are outlined below. Examples of each type of question are on the Example tab. For example The Insert Question window is a pop up. If you can t see it, check that your pop up blocker is released or the CCMS site is listed as a trusted site in the pop up settings External User Guide 3 Mar 2015 Page 11 of 31

12 The names shown on this list may not be reflected in the task list In this example, the question type chosen is Date/Time and this appears in the middle screen as such but it is referenced in the structure window. Further details of managing each question type can be found in the relevant detailed supplements: Supplement 1 Supplement 2 Supplement 3 Supplement 4 Supplement 5 Supplement 6 Supplement 7 Supplement 8 Extended text questions Date/Time Questions Multiple choice questions True/False questions In line choices Tables Fill in the Gap questions Matching questions The Stimulus is the context or scenario in in which the question has been set. Not all questions require a stimulus. The prompt is the actual question and should always be completed To remove any superfluous line, click inside and use your backspace. This can be used to remove a stimulus entry as well as the standard Delete from the menu in the structure bar External User Guide 3 Mar 2015 Page 12 of 31

13 5. Inserts Right click on the Assessment Test, Question Group or Question you would like to add to. Select either Insert above, below or within and click on Stimulus. When using the Insert function, it will generate as a separate document. See below. Click on the Stimulus in the Structure window on the left of your screen... External User Guide 3 Mar 2015 Page 13 of 31

14 On the right hand side of your screen find the the Properties tab and view the Common Attributes that apply to a stimulus, which are now visible. Under the Output dropdown menu tick Insert. Tick within the Number Lines box if you require lines to be numbered in the Insert and type the number of lines you need counted and displayed within the Line Number Interval box (e.g. 5 or 10, etc.), see below. External User Guide 3 Mar 2015 Page 14 of 31

15 If you need to exclude some text within the insert from the line numbering, highlight the text in question in the authoring pane and then select Exclude From Line Numbering (e.g. you may want to exclude the Title of the Insert from the numbering), see below. Select Preview and Insert from the Create Preview menu to preview the Insert, see below. External User Guide 3 Mar 2015 Page 15 of 31

16 6. Equations To insert equations into any part of the content of a question, place your cursor where you require your equation to be inserted and use the insert equation icon on the menu bar, as seen below. The Equation Editor will launch, as seen below. Create your equation and press Insert. Your equation will appear in CCMS: Author. You can now select the Equation in the Structure Window and select the Properties tab on the right to align the Equation as desired as standard it should be in line with the content. Don t forget to use the equation function to help you insert fractions in the format you require (e.g. or ) : Pressing Wolfram Alpha, will take you to the Wolfram Alpha website where your equation will be solved. External User Guide 3 Mar 2015 Page 16 of 31

17 7. Inserting images Images can be added to Stimulus, Prompt, Option & Table elements. To insert an image, once you have inserted your question, place your curser where you would like your image to be inserted and press the insert image icon on the menu bar at the top, as shown below. The Upload Image window box will launch, as shown below. only the following image types are valid Images found on the internet can be opened in Paint and re-saved easily as one of the above file types. External User Guide 3 Mar 2015 Page 17 of 31

18 There are now 3 options: Searching for an image from the image bank Uploading an image from your computer Inserting a placeholder and describing the image you seek 7.1. Uploading an Image from your computer You can add a picture from your own picture collection. Browse to the relevant folder, select the required image and insert. Select the Source radio button entitled Upload. Then select Browse for the image which will take you to your own file structure. When you find the image you require press Open. You can add further comments if you wish (for example I need this to only show the pier not the funfair) > Press Insert. Once you have inserted an image you can resize it. By selecting image from the structure pane, you will be given the option to resize in the Properties on the right hand side. A warning appears in the Incomplete tab once an image has been uploaded. This is due to the system requesting that you declare copyright for each image you upload (excluding placeholder images or images you have sourced from the Image Bank) Search for an image in the image bank The image bank contains images that have been used on previous papers and is changing regularly as new images are added. You can search for an image within the Image Bank by: Select Image Bank You can search by key words or name. When you have selected the criteria you want to use, select Search. Images that meet the criteria you searched by are returned. When you find a suitable image, click Insert. External User Guide 3 Mar 2015 Page 18 of 31

19 Search options Each image has a number of generic key words attached to help you find a suitable image. For example these images may both have clock, time piece clock face but one may also have 3 o clock or 7:31 Select Name and Contains from the drop-down menus, and type the name in the text box. Click Search This will show you any image name which contains the letters selected. As you can see the name car doesn t only return motor vehicles! Keywords any keywords associated with the image Name a dynamic search on the name of the image Products if the image has been linked to any (e.g. 0610) Usage where used in a live or pre-test. External User Guide 3 Mar 2015 Page 19 of 31

20 If the images available are not exactly what you require (for example the clock should show 4:25, select the nearest image and add comments giving an exact description of the changes you seek. The more detail you can give will help the person finding or creating a replacement to get it right Adding a placeholder When you cannot find an example image you can insert an image place holder and tell us what type of image is required. To do this, select the Placeholder Add a description of what it is you would like the image to convey in the comments and Press Insert Copyright Copyright needs to declared on all images uploaded. Copyright can optionally be declared on text content in the same manner as image copyright is applied. It is also declared when the item or whole test is completed on the Task Management screen. Navigate to the Copyright tab on the right hand panel, as seen below and declare whether the image has copyright or not. External User Guide 3 Mar 2015 Page 20 of 31

21 If the image does have copyright you will need to enter details of the copyright, see below. if you need to highlight that the image inserted is culturally sensitive or not, this can be done within the Keywords and Cultural Sensitivity window on the Properties tab of the right hand side pane in CCMS: Author Editing images Within the Properties tab of the right hand pane of CCMS: Author you can: Edit the size and position of the image you have inserted. To do this, overwrite the Height or Width accordingly with your desired dimensions, see below the image scale will always be preserved, e.g. if you change the Width the Height will be adjusted automatically External User Guide 3 Mar 2015 Page 21 of 31

22 Select the alignment of the image via the Alignment drop down menu. Select whether text wraps around the image or not, via the Wrap text to image drop down menu, see below. External User Guide 3 Mar 2015 Page 22 of 31

23 8. Inserting other key functions 8.1. Symbols (including Scientific) To insert symbols, select from the top toolbar. Symbols are categorised as shown below., those that you have already used in your document are within the In Document section. Symbols include the following that will be used in Science Question Papers Whitespace To insert whitespace where your curser is placed, select the + symbol on the top toolbar and choose Insert Whitespace, as shown below. External User Guide 3 Mar 2015 Page 23 of 31

24 The whitespace is inserted. To extend the whitespace place your curser within it and either use the space bar or the tab key on your keyboard to extend, as shown below Footnotes To insert a footnote where your curser is placed, select the + symbol on the top toolbar and choose Insert Footnote, as shown below. The footnote is inserted directly beneath where you have inserted it. when you preview the Assessment Material the footnote will appear correctly at the bottom of the passage of text, not within the text, as is seen in CCMS: Author. See below. In CCMS In the Preview External User Guide 3 Mar 2015 Page 24 of 31

25 8.4. Stage Excerpts To insert a Stage Excerpt, select the stimulus you would like to insert it within, as shown below. Choose the number of rows. Press Add Stage Excerpt Contents Pages To insert a Contents Page, select from the top toolbar. Specify the type of border you would like around the Contents Page from the Contents Page table border dropdown menu, as shown below. Press Generate Contents Page. Overwrite any text in the Contents Page which is not correct. External User Guide 3 Mar 2015 Page 25 of 31

26 8.6. Statistics Statistical data can be seen at Assessment Test, Question Group or Item level, if those elements have been used in tests before (pre-tests or live tests). Click on the to launch statistical information. For example the following is displayed at both Assessment Test and Question Group levels Statistics Group Statistic Name Type Information Number of Items : integer Descriptive Statistics Number of Examinees : Context : Statistics Type : Mean : Mean p : Variance : Standard Deviation : Minimum : Maximum : Median : Skew : Kurtosis : Alpha : integer ID String 2 decimal places 2 decimal places 2 decimal places 2 decimal places integer integer integer 2 decimal places 2 decimal places 2 decimal places Backhouse p : 2 decimal places Discrimination Statistic Sem : Mean pbc : 2 decimal places 2 decimal places External User Guide 3 Mar 2015 Page 26 of 31

27 9. Incomplete Rules and Guidelines Warning in the Incomplete tab are launched when: 1. Marks are not tagged with taxonomies see section The Copyright on images is not declared see section A syllabus rule has not been met (e.g. 50% of the marks which should be at AO1 are not AO1 calculated using the taxonomy tags see section 25). : - The warnings numbered 1 and 2 stop you submitting work back to Cambridge Assessment. - Syllabus rules and your progress in authoring to them can be viewed by selecting the symbol on the top toolbar. Rule Goals Vs. Actuals are listed on the left hand side of the Test Construction Profile Rules window box that will open as a separate window, as shown below. External User Guide 3 Mar 2015 Page 27 of 31

28 10. Previewing materials To preview a rendition of some content you have written: Press the Preview button, as shown below. You can do this at any stage of the process. Previews of renditions take longer to generate if there is more content to render. You will see additional information on previewed renditions, e.g. wording such as Turn over at the bottom of each 2 nd page, a front cover, blank pages, etc. All of these things will be driven by rules applied to a rendering engine. These will be linked to templates for each test. The window box as seen below will launch. External User Guide 3 Mar 2015 Page 28 of 31

29 Select which document you would like to preview. Tick to Include the Cover in the Preview or not. Click Create Preview. A PDF will open in a separate window. If this does not happen, your computer may be blocking pop ups. See user guide 1 for help in resolving this issue External User Guide 3 Mar 2015 Page 29 of 31

30 11. Work Completion Save and close from the Authoring screen At any point whilst working on your content you are able to save it by clicking on the Save button in the top right hand corner. You are also able to close the authoring screen which will return you to the task management screen by selecting the close button (if you have not saved your work you will be prompted to do so) Completing and submitting a task When CCMS: Author is closed the task management screen will launch. To complete a task: Select the task in the left hand window. Task content can be seen in the right hand window. Click on the Actions button next to the task content you have completed. Select Complete Work Item from the drop down menu, as seen below. Completing Work Items is recommended for all users at all points between direct work on assessment material. you will be unable to complete your work if there are outstanding warnings in the Incomplete tab see section 27 of this guide. Confirm you would like to complete this work. Note this: Allows Cambridge Assessment staff to access the content authored, although doesn t remove the task from your Task Management screen. You can therefore re-open the task and edit content entered. Ensures your work is backed up on a Cambridge Assessment server, meaning it can be retrieved if a technical issue was experienced, meaning it is more secure. See the following image which shows the Confirm Window box. External User Guide 3 Mar 2015 Page 30 of 31

31 To submit the completed task to Cambridge Assessment click on the Submit button that can be found next to the task in the left hand window. This will submit all task content associated with the task. See below for a visual representation. Confirm that you are sure you want to submit the task. By ticking the I have filled out box and pressing Submit Task the task will be submitted to Cambridge Assessment and the task will be removed from the task management screen. External User Guide 3 Mar 2015 Page 31 of 31