University of Sussex Online marking with TurnitinUK GradeMark e-submission & e-feedback // Resources for staff About this guide: This document is a single part of a wider set of guidance produced and provided by Technology Enhanced Learning to support staff and students at the University of Sussex in the use and best practice of e-submission and e-feedback. This specific guide addresses Online Marking with TurnitinUK GradeMark, you can find more guides and introductory information on e-submission and e-feedback on our website: www.sussex.ac.uk/tel/esef 1
1. Introduction The University of Sussex uses software called TurnitinUK to manage the marking process of the e- Submission and e-feedback system. This document aims to inform staff in the use of various tools which can be used to provide feedback for students. GradeMark is one of the key features within the TurnitinUK toolset. It provides staff with an interface for electronically marking documents which have been submitted through Study Direct as a TurnitinUK assignment. GradeMark offers markers the ability to: Annotate documents with inline comments. Highlight or strikethrough passages of text. Utilise libraries of reusable comments or develop their own. Record short voice comments. Insert general text comments. Apply rubric scorecards and grading forms. Students will have online access to a read-only copy of their marked assignment in GradeMark which displays all feedback comments, document annotation and the grade as entered by staff. Access will only be available to students once the marking phase has finished and the Module Convenor has released feedback to students via Sussex Direct. Tip TurnitinUK provide an excellent online interactive GradeMark tutorial which is available at the following web address: http://turnitin.com/demo/dv 2
2. GradeMark overview Screenshot: an example of the GradeMark interface as displayed in the TurnitinUK Document Viewer. Key: 1. 2. 3. The document which the student has submitted to TurnitinUK. GradeMark tools and settings menu. Various grading and marking tools. GradeMark view navigation tab. 9. 10. 11. Rubric and Grading Forms button. An example of a text comment annotation. An example of a bubble comment annotation. 4. 5. 6. 7. Grade Submission Info button, a brief summary of information. QuickMarks and Comments button. Tools for adding document annotation. General Comment button. Provide a general text or audio comment. 12. 13. 14. 15. An example of a QuickMark comment annotation. An example of a highlighted text annotation. An example of a strikethrough text annotation. Last annotation action and undo button. 8. Comments List button. An index of all document annotations. 3
2.1. Submission info button The submission info button will display a brief summary of details within the Document Viewer. Clicking on the Submission Info button will display the following: Key: 1. 2. 3. GradeMark info: displays the number of in-document comments added to the assignment feedback and the date of the last action by a marker. There is no expectation or policy to suggest how many comments should be applied during marking. It is up to the marker to use their preferred marking style. Submission date: although this is displayed, it should not affect the marking process as deductions for late penalties will be applied automatically within Sussex Direct. Word Count: the method used by TurnitinUK to calculate the word count is inconsistent across submission file types and does not reflect University policy. Additional guidance is available at www.sussex.ac.uk/tel/esef 4
2.2. Overlaying the Originality Report onto GradeMark You can overlay the TurnitinUK Originality Report whilst marking in GradeMark. The ability to display information from both views is helpful when you want to add a feedback comment to the submitted assignment based on information cross referenced from the Originality Report. To view the originality report, just click the originality tab in the top left corner. Tip For more information about TurnitinUK Originality Reports, see the Understanding TurnitinUK Originality Reports guide available on the Technology Enhanced Learning website: www.sussex.ac.uk/tel/esef 5
3. Document annotation tools GradeMark provides a number of tools which allow markers to add personalised or predefined annotated comments directly onto submitted documents. This provides the equivalent feature of adding short feedback comments into the margin of a paper based assignment. Each comment can contain up to 1,000 characters and can be associated with specific passages of text or marking criteria included in rubric or grading forms. Types of annotation tools: 1. 2. 3. 4. 5. Text comment: a personalised text comment which displays directly onto the submitted document. Bubble comment: a personalised text comment which displays as a bubble icon and expands to reveal the comment when a student clicks on it. Bubble comments can be saved as QuickMarks. QuickMark comments: a preloaded library of reusable and editable comments which can help to speed up the marking process. Users can customise and create their own comments and libraries. Highlighted text: you can associate a QuickMark or Bubble comment with a passage of text using a coloured highlight. Strikethrough text: puts a red line through the selected text. 6
3.1. Using the text comment tool The text comment tool can be used to create personalised notes which can be positioned anywhere on a submitted document. However, it is the only type of GradeMark comment which cannot be associated with highlighted passages of text or marking criteria from rubric or grading forms. The text comment tool is represented in the Document Viewer by the icon displayed below which can be found on the QuickMark and comments panel. Follow the instructions below to add a text comment to an assignment using GradeMark. 7
You can edit, move or delete an existing text comment by moving your mouse cursor directly over the comment area in the document. Notice that your mouse cursor will change appearance to indicate different modification options depending on the position of your mouse. To edit the text within a comment; position your mouse in the centre of the comment box so that the edit (type) cursor appears and then click the button on your mouse. Click your mouse anywhere on the document outside of the comment box to save and finish. To delete an entire comment; position your mouse anywhere on the comment box so that the delete (bin) icon appears and then click the button on your mouse. Follow the instructions in the sequenced diagram below to move the comment elsewhere on the document. 8
3.2. Using the Bubble comment tool The Bubble comment tool can be used to create expandable text comments. This provides a useful space saving feature for long text-comments which can help to improve the organisation and presentation of feedback. The comment will include personalised text from the marker which can be positioned anywhere on a submitted document. You can also associate comments with highlighted passages of text and marking criteria from a rubric or grading form. A Bubble comment will appear on the document as a speech bubble icon, the comment will then display in full view when your mouse cursor moves over the icon. Follow the instructions below to add a Bubble comment to a submitted document using GradeMark. 9
You can modify an existing Bubble comment by moving your mouse over a displayed in-document Bubble comment icon. Options to edit, delete or move will display within the expanded comment box. To edit the text within a comment; click the Edit button to present the same interface which is available upon creation of a new Bubble comment. From here you can retype or edit the text of your existing comment, click the Save button to finalise your edit. To delete an entire comment; click on the delete (bin) icon in the top right corner of the expanded Bubble comment box. Follow the instructions in the sequenced diagram below to move the comment elsewhere on the document. 10
3.3. Using QuickMark comments QuickMark comments are predefined feedback notes which can be reused to make for faster document annotation. Much like Bubble comments, they display as expandable text comments which activate upon moving your mouse cursor over them. TurnitinUK provide a library of typical and frequently used QuickMark comments which come preloaded into GradeMark. The library consists of groups of related comments (for example Punctuation, Format, Composition etc.) otherwise known as QuickMark Sets. Markers can select comments from the predefined QuickMark Sets in the GradeMark interface and then drag-and-drop them anywhere on the submitted document. QuickMarks provide a much quicker and more efficient workflow for marking, as it saves the need to repeatedly type the same comments. Tip You can also edit, create and organise QuickMark Sets to suit your own marking style. However, the scope of this guide will only cover typical usage for markers. A separate guide for customising and managing QuickMarks is available at: www.sussex.ac.uk/tel/esef 11
You can use the QuickMarks and Comments panel on the right-hand side of the Document Viewer to navigate through QuickMark Sets and comments. You can add and position a QuickMark comment anywhere on the document by using your mouse cursor to drag it from the QuickMarks and Comments panel, then drop it onto the submitted document. 12
You can modify a QuickMark comment which has been positioned in the submitted document by moving your mouse over the title of an in-document QuickMark comment. Options to add additional comment text, delete or move are available within the expanded comment box. To add an additional comment; click on the Edit button and type additional notes in the text-box and click Save. Both the QuickMark comment and additional text will now display for this unique instance of the QuickMark. To delete an entire comment; click on the delete (bin) icon in the top right corner of the expanded QuickMark comment box. Follow the instructions in the sequenced diagram below to move the comment elsewhere on the document. 13
3.3.1. Saving Bubble comments as QuickMark comments The main difference between Bubble and QuickMark comments is that you can enter customised text for Bubble comments, whilst the contents of a QuickMark comment is predefined within GradeMark. Bubble comments can be saved and repurposed as QuickMark comments. This feature allows markers to produce their own personalised and reusable QuickMark sets. Move your mouse cursor over an existing Bubble comment in the TurnitinUK Document Viewer to edit a new or existing Bubble comment: 3.4. Highlighting text Highlighting text allows you to associate Bubble or QuickMark comments with specific passages of text within the submitted document. You must have the Bubble comment button selected from the top right-hand corner of the QuickMarks and Comments menu before selecting a passage of text within the document. 14
Select a passage of text to highlight by pointing your mouse cursor at the start of the passage, then click and hold your mouse button and drag your cursor to the end point of the passage. You can now choose to associate the highlighted text with either a QuickMark or Bubble comment. Note A coloured text highlight cannot exist independently without an associated comment. You must delete the associated comment in order to remove the highlight from the submitted document. You can change the colour of a highlight by opening the edit menu on the associated comment. Then choose from five different colours; blue, green, yellow, pink or purple which display as selectable options on the comment editing box. Tip See the above sections on QuickMark comments (5.3) and Bubble comments (5.2) to find out how to edit or delete these types of comments. 15
3.5. Strikethrough text You can use the strikethrough tool to cross out unnecessary words or sentences. First, use your mouse to select and highlight the text in a submitted document, then press the Delete key on your keyboard to add a strikethrough to the selected text. 3.6. Comments List The comments list provides a paginated navigational index of all document annotations, including strikethroughs as well as all in-document comment types. You can use this list to quickly find and navigate to the position of a specific annotation within the document. 16
4. Grading & general feedback After you have read through the student s submitted assignment and added your QuickMarks, text and/or Bubble comments you may want to add a general comment for the assignment. General comments can be left either in a typed format in the general comment box (4.1) or orally using the embedded audio recorder (4.2). Before completing your marking, you will also need to enter an overall grade for the assignment (4.3). 4.1. General Text Comment In order to insert a general comment to the submitted assignment you need to first click on the general comment (speech bubble) icon situated on the tabbed menu in the bottom right corner of the interface. Once you have clicked on the icon you will be given the opportunity to add either a text or a voice comment. The general text comment box, titled text comment allows you to type up to 5,000 characters and you will need to press save after completing your feedback. You can edit your text again after you ve pressed save by selecting the pencil icon in the top left hand corner of the box. If you are unhappy with your comment and wish to start again then you can delete it by selecting the bin icon in the top right hand corner. 17
18
4.2. General Audio Comment In order to attach a general audio comment to the submitted assignment you will require a microphone or headset that is tested and ready to record. Recording Instructions: 1. 2. 3. 4. 5. 6. 7. 8. Click on the microphone icon to begin your recording. Click to pause your recording. During pause, click the microphone to continue recording or click the stop button and you will be given the option to play back your recording, which can then be saved or deleted. This gauge will give you a visible representation of the volume of your voice on the recording. If this isn t fluctuating then your audio may not be being recorded. Press the stop icon to stop your recording. You will then be able to listen to it back and decide whether you want to save or delete the recording and start again. The counter will indicate the duration of your recording. Remember you have up to 3 minutes to record your audio comment. Click the play icon to listen back to what you have recorded so far. Click the arrow icon to save your file. You can listen to it again and delete it if you are unhappy with it. Throughout the process you can use the delete (bin) icon to erase your recording. Tip To ensure that the audio feedback is audible, try recording an audio comment and listening back to it. If your audio is unclear or inaudible then try adjusting your microphone/headset and recording again. 19
4.3. Grading When you have finished adding your specific and general comments, you will need to insert an overall grade. You can find the area to input this mark in the top right hand corner of the screen. The mark given here must be a numerical figure out of 100. Any penalties for late submission or academic misconduct will be applied in Sussex Direct so the figure added here need just be the overall academic mark given for the assignment. 20
5. Rubrics and Grading Forms Rubrics and grading forms can be created, imported and attached within TurnitinUK. The guide for doing this can be found here: www.sussex.ac.uk/tel/esef The information in this guide will focus on accessing the rubrics within GradeMark and using them to assist your grading. The rubrics and grading forms within TurnitinUK s GradeMark software can be set either as a reference or to automatically generate a grade for each submitted assignment based on a total of the combined rubric criteria scores which have been selected by the assignment marker. The value and weight of the scores for each of the rubric criteria can be customised when creating a rubric in GradeMark. Types of GradeMark rubrics You can choose to use several scoring methods: 5.1. 5.2. 5.3. Scored rubric: allows you to score the assignment against scale values for each column and weight criteria percentages for each row or allows you to enter a different selectable numeric score (between 0-99) directly into each of the rubric cells. NB: For Module Convenors there are two different types of scored rubrics, information for which can be found in the separate rubric guide. Qualitative rubric: prevents selected criteria from affecting the grade as no numeric score is produced. Grading form: allows you to provide freeform feedback or scores from a list of criteria. Grading forms don t have a weighting option. Grading forms are not available on the TurnitinUK ipad app. To find your module s rubric, select the grid icon in the bottom right hand corner: 21
5.1. Scored Rubrics Once the rubric has been attached to an assignment it will then be available to all assignments that are allocated to that module so will not need to be reattached to every student submission. This means that when you come to mark, if your module has been given a rubric, it should already be visible within GradeMark. After pressing the grid icon the rubric will appear on the right of the screen. To see the rubric in full, click the icon with four arrows pointing in different directions (2). To grade with the rubric scorecard, click on the scale the paper has met for the criteria (3). When you scroll over the scale (4) an explanation of each criterion appears in the box below (7). The "rubric score" below the scorecard displays the total of all the selected cell values (5). The "rubric percentage" displays the percentage of the total points out of points possible for the rubric scorecard (6). Click on the "Apply rubric percentage to grade" button at the bottom of the rubric sidebar to apply this percentage to the assignments total point value (8). Once a grade is applied from the rubric scorecard it will appear in the "Grade" field at the top right corner of the document viewer (1). 22
There are potentially two different types of rubric that can be displayed, depending on whether they are weighted or non-weighted. Here are examples of the two types of scored rubrics. The one on the left does not contain weighted criteria whereas the one on the right does. TurnitinUK automatically works out the Rubric score (1 and 3) and percentage (2 and 4) which, in the below examples, differ due to the criteria being weighted differently in the two rubrics. 23
5.2. Qualitative Rubrics A third type of rubric, qualitative, can also be assigned to the document by the module convenor or the Technology Enhanced Learning team. If a qualitative rubric is attached to the assignment then you will still be able to mark the scale against each criterion but no scores will be counted and you cannot apply a percentage to the grade. As such, it is used mainly as a reference point and guide for markers in the way a standard rubric would. Example of qualitative rubric: 24
5.3. Associating comments with Rubric criteria QuickMark comments or Bubble comments can be associated with an individual rubric criterion. To do this you must click on the QuickMark or Bubble comment and select the criterion you wish to associate it with from the drop down menu (1). When a QuickMark or Bubble comment has been associated with a rubric criterion, you are able to quickly view the number of comments associated with each criterion by clicking on the number of comments displayed within the comment icon next to the criterion title (3). You can jump to where that comment appears in the document by clicking the show link (2). To view where the comment is located within the paper, hover over the comment and click on the Show link (2). Note The expanded rubric presents a clearer view but contains the same mark criterion association information as the rubric as displayed in the Document Viewer sidebar. 25
5.4. Grading Forms To mark with the grading form, click on the text box for each criteria and type the feedback for the selected criteria (1). To view the criterion description click on the i icon (3). If the grading form has scoring enabled, enter the value merited for each criterion in the scoring field (2). As with the rubrics, click on the Apply score to Grade button at the bottom of the rubric sidebar to apply this value to the assignment's total point value. Once a grade is applied from the rubric scorecard it will appear in the Grade field at the top right corner of the Document Viewer. Note A separate guide for creating Rubrics and Grading Forms is available from the Technology Enhanced Learning website: www.sussex.ac.uk/tel/esef Troubleshooting A list of frequently asked questions on TurnitinUK Originality Reports is available at: www.sussex.ac.uk/tel/submission/staff/faqs Help and support for esubmission and efeedback is provided by Technology Enhanced Learning. Please contact us if you have any specific queries or visit our website for additional guides and resources: Email: tel@sussex.ac.uk Website: www.sussex.ac.uk/tel/esef 26