How to use the Jisc Student Digital Experience Tracker

Transcription

1 How to use the Jisc Student Digital Experience Tracker Overview This document provides information about: 1. How to access your BOS (Bristol Online Surveys) account 2. How to customise the Tracker by editing questions 9, 10 and How to launch your survey 4. How to review the data collected during and after the survey is live 1. Accessing your BOS account 1. The person named as primary contact on your application will receive an from BOS (Bristol Online Surveys) asking you to join the Jisc prototype services account. To create a personal BOS login you must click on the link in this and follow the instructions to set up a username and password (this takes no more than 5 minutes). You are now ready to start customising your survey. Jisc Student/Learner Digital Experience Tracker 1

2 2. Customising the tracker You should have read through and discussed the document 'How will you customise the Tracker?' before you begin editing. If you have not done so please go back to the guidance page and download this document. Please DO NOT CHANGE any options other than the ones outlined in this guidance. In particular, please do no change the survey name you have been allocated, or the design and background including the Jisc logo, or any features of the survey lay-out. 2. If you are not already logged in, log into BOS at and click on the 'Sign in' button, top right. 3. You will see your BOS dashboard. (If you already have a BOS account, you will have to select 'Jisc prototype services' from the drop-down menu in the top, shaded area to access your Tracker survey in the next step). 4. We have created a customised survey for you. Because you did not create the survey yourself, you need to UNTICK the box next to 'JUST MY SURVEYS' so you can see it. Your own institutional survey should now be visible. Each survey title is unique, so yours will not be identical to the one shown. If after unticking the 'JUST MY SURVEYS' box you still cannot see your institutional survey, please tn@timmuslimited.co.uk for help. Jisc Student/Learner Digital Experience Tracker 2

3 5. Under the survey title, click 'Design' to open an editable version of the survey, ready to begin editing questions 9, 10 and You are now in the survey editing space. Notice that you cannot edit most questions. Scroll down or use the 'Jump' button to reach page 3. Notice that you can edit (but not delete) questions 9, 10 and 11 on page To edit question 9, click on the little pen icon top right of the question. This opens a new window. Jisc Student/Learner Digital Experience Tracker 3

4 8. In the new window you can edit the question text and the text for each answer option. (Note that the sample answer options for HE differ from the ones shown here). Refer to the decisions you made in the document 'How will you customise the Tracker?' To edit simply type over the text provided. To add an answer option, type in the white box at the bottom of the list and click 'Add another answer option'. To delete an answer option, hover over it and click on the blue dustbin icon. We recommend that for this survey you use no more than 4 to 6 answer options. Please do not change any other options. 9. Click the green 'Save' button to save the changes. Click 'Cancel' to return to the survey without saving any changes. Jisc Student/Learner Digital Experience Tracker 4

5 10. Repeat this process for question 10. Note that the sample answer options for HE differ to the ones shown here. 11. Edit question 11 by selecting the text [VLE / LMS name] in the question text and replacing it with the name of your institutional VLE/LMS (i.e. the name by which learners will know it). We do not recommend that you change the answer options for this question. 12. You can now preview the survey as your learners will see it by clicking on the 'Preview survey' button in the authoring pane at the top left of your screen. (You can do the same by clicking on the the eye icon from the main dashboard.) Make sure you are happy with your customised questions 9, 10 and 11. If you need to make further changes to a question, return to the 'Design' screen and click on the little pen icon again. Preview in design space: Preview from dashboard vie eye icon: Remember that once the survey is launched you will not be able to make any changes. Jisc Student/Learner Digital Experience Tracker 5

6 13. You can now return to your dashboard (top left 'Dashboard' button) ready to set the launch date. Alternatively you can 'Sign out' of BOS to end this session. Jisc Student/Learner Digital Experience Tracker 6

7 3. Launching your survey 14. If you are not already logged in, log into your BOS dashboard and locate your institutional survey as before. Click on 'Distribute' to access the Launchpad. 15. From the left hand blue block, select 'Distribution settings'. 16. By default the opening time is set in the past to allow you to launch the survey whenever you want. Notice that the closing date and time is set to 29th April 2016 at 23:40. For this pilot, all surveys will close at the same time to allow Jisc to provide you with comparative data from other institutions in your sector. No-one can see or complete the survey until you send the link to them. 17. By default the URL is taken from the long survey name shown on your dashboard. We have created a shorter 'public survey name' for you, which students will see on the first page Jisc Student/Learner Digital Experience Tracker 7

8 of the surveys. Please do not change the public survey name. You can however change the 'survey short name' to create a shorter URL. We recommend the following format: your institution name or initials dash tracker dash 2016 for example: When you have set and saved the dates and URL, click back to the survey launch pad (under 'Distribute'). 19. Check all the details, and make sure your communication channels are ready to share the URL with students. Then click the 'Launch survey' button. Now you need to distribute the URL to your target students, for example via s, Twitter, Facebook, desktops and web pages. Don t forget to send reminders to students whilst the survey is live. The higher your response rate, the more reliable your findings. Jisc Student/Learner Digital Experience Tracker 8

9 4. Viewing, downloading, analysing and benchmarking your data 20. You can access your data at any time by logging on to BOS, locating the survey, and clicking on the 'Analyse' tab. 21. Whilst the Tracker is live you can regularly check in and see the data, plotted live. 22. The Tracker closes on the night of 29 th April After this time you can log in at any time and download your completed data set. You can download data in two ways: 'Download PDF' replicates the graphical summary you see in the 'Analyse' area of BOS. 'Export response data' downloads an file of the raw data that you can open and view in a spreadsheet or data analysis program. 23. By default, BOS presents you with a summary of your data in the form of a bar chart comparing percentage responses within each question. This is often but not always a useful way of looking at your data. Jisc Student/Learner Digital Experience Tracker 9

10 BOS also shows you the raw score in bold and the percentage score (in brackets) for each response. 24. You can view or download the data for your different groups of learners in separate data sets for analysis and comparison. You do this using 'Filter based on responses' which is at the bottom of the blue panel on the left of your 'Analyse' screen. (If you are downloading data into another analysis tool then you may want to download the full set and filter your data using that tool rather than using BOS). To do this in BOS, click on '+ Add filter' 25. You are now in the filter editor. You will see a drop down menu showing the first Tracker question. Use the down arrow to scroll to either Question 9 or Question 10, depending on how you want to group your responses. Click on this question. Jisc Student/Learner Digital Experience Tracker 10

11 26. Select the first of the options available under this question. A tick box will appear. This indicates that you have set up a filter to extract all the sets of data where the respondent is in this particular group. Click on 'Save and enable' and return to the 'Analyse' screen. 27. In the blue panel you will see that you have set up a filter and applied it. You can now view the data 'Summary' for just this group of learners, or you can choose to 'Download' the data for just this group of learners. Repeat for all the possible responses (i.e. all the different groups of learners) in this question. Note that next time you log into BOS you will be prompted as to whether you want to view the filtered version that you last viewed, or start afresh. 28. The option to benchmark your responses to a particular question is now available within the BOS system. This means that you can compare your data with the average data from other institutions using the Tracker. From the 'Analyse' screen, click on 'Benchmark survey' in the 'Advanced' menu. Jisc Student/Learner Digital Experience Tracker 11

12 29. Select 'Jisc benchmarking' from the drop-down menu. 30. Click on 'Benchmark' and wait for BOS to calculate your comparative data. This can take a while, as there may be thousands of separate responses to calculate. 31. For each question you will now see all the responses from your survey (column one) set alongside all the responses from learners in your sector but not at your institution (column two), and finally both sets of data combined to give you the sector as a whole, including your survey (column three). This allows you to visually compare your data with the rest of your sector. (Note that these examples are based on a dummy survey with very little data.) Comparisons are helpful, but beware of making assumptions without checking whether any difference between two figures is statistically significant. For our data, a very rough rule of thumb is to take notice when your data differs from the benchmarking figure by more than 6% in either direction. To statistically compare your data with the benchmarking group, check out the information in the Guide to Analysing and Understanding your responses. Jisc Student/Learner Digital Experience Tracker 12

13 32. The BOS help pages are very useful if you want a better understanding of these and any other features of the software. If this Tracker is rolled out as a full Service, users will need to rely on these guidance notes and the 'Help & Support' available in BOS. We therefore politely ask that you use these as your first port of call to ensure the pilot is as authentic as possible. Jisc Student/Learner Digital Experience Tracker 13

14 5. If you need help 20. The BOS help pages are very useful if you want a better understanding of these and any other features of the software. If this Tracker is rolled out as a full Service, users will need to rely on these guidance notes and the 'Help & Support' available in BOS. We therefore politely ask that you use these as your first port of call to ensure the pilot is as authentic as possible. Jisc Student/Learner Digital Experience Tracker 14