Enhance Exam Integrity with Online Proctoring

Transcription

1 Enhance Exam Integrity with Online Proctoring Chloe Mendonça UK Marketing Manager, Questionmark

2 Agenda What is online proctoring and how does it work? What are the benefits of online proctoring? Managing test security threats Considerations & Best Practices

3 A bit about us Background Founded in 1988 Offices in US, UK, Canada; Distribution partners in 27 countries Products & Services Multilingual Assessment Management System Questionmark OnDemand (Cloud/SaaS) Questionmark Perception (Installable software) Assessment technologies and portal solutions that enable organisations to measure knowledge, skills, and attitudes securely for certification, regulatory compliance and learning Customers Enterprise customers worldwide within the corporate, government; higher education; awarding body; test publisher sectors

4 Online Proctoring / Online Invigilation We used to use the term invigilation With the proliferation of US Companies providing Online Invigilation the industry appears to be accepting the term Online Proctoring

5 Online Proctoring Candidates can take exams Xonline from their home or office using their own laptop A webcam is used to authenticate the candidate s identity The proctor observes the candidate as they complete their exam

6 Options for Proctoring Tests and Exams Record & Review Dedicated Kiosk with multiple cameras Test Centers Events (Classrooms or Conventions) Remote real-time webcam Un-Monitored

7 ID Fraud Protect Content Minimizes Cheating Comparing the options Events (Classrooms or Conventions) Test Centers Dedicated Kiosk with multiple cameras Remote real-time webcam Convenient, personable, consistent Proctor vulnerable to unfair influence Personable, consistent Proctor vulnerable to unfair influence Proctor is less vulnerable New and not yet widespread Proctor is less vulnerable Easy to deploy for use at home Record & Review More cost effective than remote real-time Nothing for content theft X Un-Monitored Works for employees Nothing for content theft X X

8 Traditional Proctoring Proctor observes test taker physically in person / in the same room Online Proctoring Proctor observing test taker live via webcam Internet connection must be continuous

9 Typical Candidate Experience 1 Candidate login and system-check Initiates proctored session 2 Verification of candidate ID and work space Exam released to candidate 3 Candidate begins exams Candidate minimizes proctor window 4 Candidate completes exam and proctored session ends

10 Who is using it?

11 Higher Education and Certification Institutions

12 What is driving this need? Explosion of MOOCs Students definitely prefer online proctoring. It s more convenient and affordable than going to a testing centre. - Chris Heather, Product Manager, Coursera

13 What is driving this need? Reducing time-to-market Release Cycles Happen More Frequently Which means that. Qualifications for credentials/certification need to keep pace Which means that. Exam content needs to be updated more frequently (sometimes several times a year) Release cycles are getting quicker and quicker. For certification, this means that consultants and others have to show that they are always up to date and are certified on the latest release. But of course if you are taking certification exams more often, certification costs have to be much lower. In some regions, people have to travel large distances to get to a test centre. Our aim is to allow certification anytime and anywhere using the cloud. - Ralf Kirchgaessner, Manager of Global Certification, SAP

14 What is driving this need? Enhancing Exam Integrity Student visa system fraud exposed in BBC investigation. At least 29,000 exam results were invalid! Director Varinder Bajarh, Director of Studentway Education told the undercover test taker: "Someone else will sit the exam for you. But you will have to have your photo taken there to prove you were present. The researcher was told a "guaranteed pass" would cost about three times the proper fee for the exam

15 Benefits of using Online Proctoring Independent Proctors Professionally trained Technology Supported Fairness Candidate Satisfaction Lower Costs

16 How does online proctoring deal with exam security threats? Impersonation. Cheating. Content Theft.

17 Key threats to consider Candidate Impersonation Collusion Content Theft Access to restricted aids Reliability and robustness Privacy & data protection

18 Dealing with impersonation / proxy test takers Options for REC SAVE Authenticating candidates Enabling proctor controls, e.g. pause stop etc. Recording / storing session and time stamping any incidents

19 Dealing with cheating aids / collusion Camera can see large portion of the room Camera & microphone pick up sounds / talking Secure browser to restrict access to online aids Checking of area with reflective surface Panning of room with webcam Proctors can be prohibited from seeing test taker screens

20 Mitigating risk of content theft Live monitoring throughout the exam Secure browser to restrict right click, copy paste and other functions

21 Considerations for Online Proctoring Must have high speed internet connection Reasonably comfortable with tech Proctor language Breaks are restricted Computers not standardised Test program customisation

22 Online Proctoring Best Practices Six Tips Copyright Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.

23 #1 Develop & Define Policy Anticipate problems and have a way to manage them Policies for technical problems Policies for accessibility accommodations Policies for following up on infractions

24 #2 Set Candidate Expectations Prepare and educate candidates with training resources Videos Online Information Blog Articles

25 #3 Use a comprehensive lock-down program Should allow prevention of: Printing Screen capture Copy/ Paste Launch of applications and communication tools Task switching Browser control / navigation Control/system keys Right-click / context menu options View source Accidentally exiting exam Should be compatible across multiple devices and operating systems: Windows Mac ipad

26 #4 Allow communication between proctor and test-taker throughout session Participants should be able to communicate via: Audio Video Chat

27 #5 Allow proctor to control test session Proctor controls should include the ability to pause, suspend or cancel the test.

28 #6 Record and store exam sessions (including chat log) Record entire session including all communications Time stamp incidents to make them easy to review

29 Online Proctoring in the future It s only going to get better

30 Online Proctoring is broadening the horizon for candidates and test sponsors More options for candidates

31 Keep in touch! Follow our blog blog.questionmark.com Connect with us on social media YouTube, Twitter, Instagram, LinkedIn, Google+, Facebook

32 Thank you for attending! Watch out for our next session: An Introduction to Questionmark Chloe Mendonca UK Marketing Manager