Ensuring Quality in the Cisco Networking Academy Program Jackie Barker, Global Field Quality Assurance Manager CISCO Networking Academy Program 1
With Appreciation The Academy Program continues to become stronger in the US because of all you do. 2
Warm Up Draw a picture of the Academy Program as it exists today by drawing it as a mode of transportation and label it accordingly. You can use a real or imagined mode of transportation. 3
So what does that tell us? Program? Features? Models? Users? 4
Agenda Quality Definitions A look at the Metrics Documented Field Quality Assurance Process (QAP) Academy Quality Management Tool (AQMT) 5
Quality Definitions and Metrics 6
Quality Framework Program Mission Quality Program Operational Excellence Academies Instructors Metrics Operational Metrics Academies Field Teams Instructors Partners Students Customer Sat Metrics Academies Employers Instructors Partners Students Outcome/Success Metrics Academies Others Instructors Employers Students 7
Program Quality Definition Administrative Support Product Effectiveness (Curriculum & Assessment) Provides processes, procedures and tools for implementation of the program and monitoring of quality while clearly specifying desired outcomes and indicators of success. Provides a skilled and Qualified Field Operations team that is highly involved with CATC and Regional academies, promotes partnerships with Government, Education, and Industry leaders and actively monitors academy performance. Provision of high quality curriculum and assessment materials that are up to date, technically relevant and aligned to market requirements. Instructor Excellence Provide resources and training opportunities designed to promote instructor effectiveness. 8
Academy Quality Definition Administrative Support Infrastructure A quality Networking Academy has the following characteristics: Implementation of a program that is well aligned to the Networking Academy mission, relevant for the institution and it s students and is well funded and supported. Existence of a trained and dedicated staff that is motivated to support and monitor it s academy ensuring effective communication and responsiveness. Effective and sustained Student Recruiting Provides students and instructors with adequate teaching facilities to include ample access to functioning lab equipment. Instructor Effectiveness Provide instructors who are pedagogically skilled and are highly trained in Academy Curriculum and Administration. 9
Instructor Quality Definition Trained in Academy Curriculum & Administration Instructors that are technically competent in course material and use that knowledge to successfully integrate teaching tools to instruct students in all aspects of the courses, including but not limited to hands on activities. Teaching Skills (Pedagogical Ability) Instructors with demonstrated pedagogical abilities that are able to create learning environments that instill confidence and motivate students to achieve success. 10
Quality Metrics 11
Quality Metrics Number of Academies Enrollment Instructors and CCNA Proficiency Satisfaction Course Completion Average Class Size 12
Number of Actively Teaching Academies Area May 2005 May 2004 % of Change Global 7789 8035-3.1% United States 3073 3670-16.3% 13
Global Enrollment by Year by Curricula 900000 800000 700000 600000 500000 400000 300000 200000 100000 0 2000 2001 2002 2003 2004 CCNA CCNP HP IT Java Panduit Security Unix Web Wireless Source: MRE February 2005 14
Global Enrollment by Year by Theater 900000 800000 700000 600000 500000 400000 300000 200000 100000 0 2000 2001 2002 2003 2004 AsiaPac Canada EMEA Japan Latin America United States Source: MRE February 2005 15
US Enrollment by Year by Curricula 300000 250000 200000 150000 100000 50000 0 2000 2001 2002 2003 2004 CCNA CCNP HP IT Java Panduit Security Unix Web Wireless 16
CCNA 3.x Proficiency All instructors who intend to use the CCNA 3.x English materials after July 30, 2005 must demonstrate proficiency or they will lose their ability to create classes 17
CCNA 3.x Proficiency CCNA 1 CCNA 1 CCNA 1 CCNA 2 CCNA 2 CCNA 2 Theater Total Certified (1.x, 2.x, 3.x) # Untrained 3.0 % Untrained 3.0 Total Certified (1.x, 2.x, 3.x) # Untrained 3.0 % Untrained 3.0 Global 18,468 2,933 15.88% 16,978 3,875 22.82% United States 5,242 980 18.70% 5,007 1,371 27.38% 18
CCNA 3.x Proficiency CCNA 3 CCNA 3 CCNA 3 CCNA 4 CCNA 4 CCNA 4 Theater Total Certified (1.x, 2.x, 3.x) # Untrained 3.0 % Untrained 3.0 Total Certified (1.x, 2.x, 3.x) # Untrained 3.0 % Untrained 3.0 Global 14,502 4,160 28.69% 13,606 4,216 30.99% United States 4,520 1,529 33.83% 4,394 1,591 36.21% 19
Average Class Size The average class size in the United States is 14. The average class size globally is 17. 20
Satisfaction Area May 2005 May 2004 % of Change Global 3.76 3.72 1.1 United States 3.71 3.72-0.3 21
Why is the Course Feedback Important? Students are the main consumers of the Networking Academy Program Need feedback from this critical group The ONLY REAL consistent way to get student feedback Taken at the end of every class by all students Have to finish course feedback form in order to complete their course Data are informative to: Instructors (self-evaluation) Program and Field Teams (monitoring & instructional evaluation) All Academies (instructional evaluation) Content development teams (materials and content evaluation) Program evaluation (student/instructor/academy success models, academy metrics, reporting) Also gain this information from instructors when they go through training, so all the same data can be used with CATC and Regional Academies 22
What does Course Feedback Measure? Overall: Students reported perceptions of course-related activities and student characteristics and plans Five Main Areas Being Measured (Subscales): Student Confidence Materials & Activities (provided by Cisco) Instruction Satisfaction Student Motivation Other components: Problem solving Accessibility of Learning Materials (labs, curriculum, etc.) Future Intentions 23
Course Completion May 2005 20,100+ Students completed a Cisco Networking Academy Course 2500+ Number of Students who are marked incomplete 24
Tools to Monitor Quality 25
Quality Tools Documentation Academy Quality Management Tool Reports Historical Assessment and Course Feedback Survey Results Page 26
Documented Field Quality Program Quality Assurance Program that consists of four components: Implementation Guide Training Guide Improvement plan Best Practices Powerpoint Look for new design in August! 27
Academy Quality Management Tool Goals Online Quality Process Continue to develop and strengthen the AQMT through customer feedback Functionality Support Visit Academy Performance Report Instructor Proficiency Plans http://netacad-quality.net 28
Support Visit 29
Support Visit (cont) 30
Academy Quality Management Tool (AQMT) Academy Level Reporting Academy 1 Academy 2 Academy 3 Academy 4 Academy 5 Academy 6 Academy 7 Academy 8 Academy 9 31
Why have an AQMT? What do we do with this information? Information is captured at the Academy Level Data is forwarded to the appropriate team to integrate into design of future planning What have you learned to date? Enrollment issues is a challenge in many areas in the US Need for more academic rigor Make it more exciting 32
Survey Results Page Location: AC Instructor Gradebook CF Exam details 33
Historical Class Assessment and Course Feedback 34
Q and A 35
36