IMS Assessment Interoperability Update

Transcription

1 IMS Assessment Interoperability Update Learning Impact Leadership Institute Atlanta, Georgia 5 May 2015

2 Assessment Delivery with Accessibility Test Candidate Assistive Technology Devices Delivery System, Assessment System PNP Server, Companion Tools Assessment Administration, Registering, Rostering Item Bank, Test Bank Assessment Results, Outcomes, Analytics Core Network Item Bank, Test Bank Curriculum Standards, Common Core PNP Tool, Companion Tools Authoring System, Test Construction Assessment Authoring with Accessibility Assessment Author

3

4 QTI and APIP Workgroup Participants

5 Digital Assessment Interoperability It s working!.. but we have more to do

6 QTI Background Version Date Description QTI v1.0 June 2000 Original QTI release based upon basic research by ETS and the Four Process Cycle. QTI v1.1 Mar 2001 Inclusion of new flow structure to support block-based content. Release of QTI-Lite. QTI v1.2 Feb 2002 Addition of Results Reporting, Selection & Ordering of Sections, Outcomes Processing for Tests. QTI v1.2.1 Mar 2003 Set of corrections to the QTIv1.2 release. QTI v2.0 Jan 2005 New QTI Item model based on XHTML. Reworking of question structures using new set of Interactions. QTI v2.1 Jan 2013 Full QTI reworking to include Tests and Section. New support for QTI Metadata, Results Reporting and Usage Data Statistics. QTI v2.2 May 2015 Minor changes and improvements especially around accessibility capabilities

7 APIP Background Version Date Description APIP v1.0 Candidate Final APIP v1.0 Final APIP v1.1 Public Draft Apr 2012 May 2014 Summer 2015 First Public Draft of the profiled set of specifications for public comment and feedback. Final Specification approved with some new QTI and accessibility features and functionality introduced. Includes the full set of new features added to the QTI v2.2 specification. 7

8 QTI and APIP: Related Specifications APIP and QTI influence each other IMS Content Packaging IMS Access For All Several metadata standards IMS Learning Tools Interoperability IMS Common Cartridge epub3 EDUPUB W3C Standards

9 QTI and APIP: Current Status IMS Technical Advisory Board approved the APIP v1.0 Final specification (May 2014) Working on updates and new features/functionality to QTI v2.2 Examining long-term strategy for QTI and APIP (combining and improving the standards, closer alignment to web accessibility standards and HTML5, developing services, etc.)

10 QTI and APIP: Workgroup Activities Identifying and making improvements to the current specifications Defining profiles: Smarter Balanced, PARCC, Dutch Ministry of Education, Australia Working with end users to improve adoption practices, develop tools like a PNP builder Setting scope for next major iteration (aqti combining QTI and APIP)

11 Race to the Top Assessment Initiatives Smarter Balanced Assessment Consortium: 21 States + Partnership for Assessment of Readiness for College and Careers: 12 States + Defining requirements and creating a conformance certification program Adopting and profiling IMS APIP v1 11

12

13 Dutch Ministry of Education Deploying a country-wide schools-level online assessment system for assessment authoring, delivery and results reporting Adopting and profiling IMS QTIv2.x Working with IMS to develop the appropriate Dutch MoE Assessment systems conformance certification process 13

14 QTI v2.2 APIP v1.0 assumes QTIv2.2 hence the revision Tidy-up features Improve validation power of the XSDs New features Exchange of AssessmentSections Introduction of Shared Stimulus Support for WAI-ARIA Adoption of some HTML5 elements/attributes 14

15 QTI v2.2 / APIP v1.x Features Non-Manifest-Embedded Resource-specific Metadata Support for the Exchange of Shared Stimulus Content Support for W3C Speech Standards - Speech Synthesis Mark-up Language (SSML), Pronunciation Lexicon Standard (PLS), Cascading Stylesheets (CSS) v3 Added Support for 'textentryinteraction' Response Format, gapimg, inlinechoice, gaptext, coords attribute on mediainteraction Provision for the Exchange of a Set of PNP Records Support for Mixed Source Scoring in Response Processing Added Support for MathML v3 Support for BIDI (R-L writing) Support for HTML5 figure and fig caption elements and custom data- attributes Support for Support for HTML5 Audio/Video and specific elements for accessibility needs Support for W3C WAI-ARIA standard

16 Executive Board on Assessment Charter Members

17 Milestones Strawman Proposal Improve QTI 2.x compliance First proposal floated April 30 Vendors to demonstrate Silver or Gold compliance Oct-Dec Ensure aqti 3.0 compliance Start developing aqti 3.0 products and/or content upon availability of 1st internal draft Attend series of plugfests to test aqti compliance and interoperability, starting 3-6 months after availability of 1st internal draft European QTI user group Cito, CvTE and O.A.T. to report back to EBA and aqti committee in Sep Engaging AT community Milestones to be determined

18 QTI and APIP Conformance Certification Paths

19 8 APIP 12 QTI Conformance Certification products certified: PNP systems, delivery systems, test banks, authoring systems, and content See imscert.org

20

21 End-to-End Assessment (aqti v3) Objectives: o Address Assessment creation, delivery and results reporting using an integrated set of interoperability standards o Embed accessibility within each phase of the Assessment content development, delivery and reporting workflow o Minimize the use of content transformation and facilitate as broad a range of Assessment delivery tools and engines

22 aqti v3 Leadership Working Group Leadership: ETS NWEA OAT Pearson

23 How to Get Involved Participate : imsglobal.org Contribute : imsglobal.org/joinims.html Lead : imsglobal.org/leadership.html