Ensuring Quality in the Cisco Networking Academy Program

Transcription

1 Ensuring Quality in the Cisco Networking Academy Program Jackie Barker, Global Field Quality Assurance Manager CISCO Networking Academy Program 1

2 With Appreciation The Academy Program continues to become stronger in the US because of all you do. 2

3 Warm Up Draw a picture of the Academy Program as it exists today by drawing it as a mode of transportation and label it accordingly. You can use a real or imagined mode of transportation. 3

4 So what does that tell us? Program? Features? Models? Users? 4

5 Agenda Quality Definitions A look at the Metrics Documented Field Quality Assurance Process (QAP) Academy Quality Management Tool (AQMT) 5

6 Quality Definitions and Metrics 6

7 Quality Framework Program Mission Quality Program Operational Excellence Academies Instructors Metrics Operational Metrics Academies Field Teams Instructors Partners Students Customer Sat Metrics Academies Employers Instructors Partners Students Outcome/Success Metrics Academies Others Instructors Employers Students 7

8 Program Quality Definition Administrative Support Product Effectiveness (Curriculum & Assessment) Provides processes, procedures and tools for implementation of the program and monitoring of quality while clearly specifying desired outcomes and indicators of success. Provides a skilled and Qualified Field Operations team that is highly involved with CATC and Regional academies, promotes partnerships with Government, Education, and Industry leaders and actively monitors academy performance. Provision of high quality curriculum and assessment materials that are up to date, technically relevant and aligned to market requirements. Instructor Excellence Provide resources and training opportunities designed to promote instructor effectiveness. 8

9 Academy Quality Definition Administrative Support Infrastructure A quality Networking Academy has the following characteristics: Implementation of a program that is well aligned to the Networking Academy mission, relevant for the institution and it s students and is well funded and supported. Existence of a trained and dedicated staff that is motivated to support and monitor it s academy ensuring effective communication and responsiveness. Effective and sustained Student Recruiting Provides students and instructors with adequate teaching facilities to include ample access to functioning lab equipment. Instructor Effectiveness Provide instructors who are pedagogically skilled and are highly trained in Academy Curriculum and Administration. 9

10 Instructor Quality Definition Trained in Academy Curriculum & Administration Instructors that are technically competent in course material and use that knowledge to successfully integrate teaching tools to instruct students in all aspects of the courses, including but not limited to hands on activities. Teaching Skills (Pedagogical Ability) Instructors with demonstrated pedagogical abilities that are able to create learning environments that instill confidence and motivate students to achieve success. 10

11 Quality Metrics 11

12 Quality Metrics Number of Academies Enrollment Instructors and CCNA Proficiency Satisfaction Course Completion Average Class Size 12

13 Number of Actively Teaching Academies Area May 2005 May 2004 % of Change Global % United States % 13

14 Global Enrollment by Year by Curricula CCNA CCNP HP IT Java Panduit Security Unix Web Wireless Source: MRE February

15 Global Enrollment by Year by Theater AsiaPac Canada EMEA Japan Latin America United States Source: MRE February

16 US Enrollment by Year by Curricula CCNA CCNP HP IT Java Panduit Security Unix Web Wireless 16

17 CCNA 3.x Proficiency All instructors who intend to use the CCNA 3.x English materials after July 30, 2005 must demonstrate proficiency or they will lose their ability to create classes 17

18 CCNA 3.x Proficiency CCNA 1 CCNA 1 CCNA 1 CCNA 2 CCNA 2 CCNA 2 Theater Total Certified (1.x, 2.x, 3.x) # Untrained 3.0 % Untrained 3.0 Total Certified (1.x, 2.x, 3.x) # Untrained 3.0 % Untrained 3.0 Global 18,468 2, % 16,978 3, % United States 5, % 5,007 1, % 18

19 CCNA 3.x Proficiency CCNA 3 CCNA 3 CCNA 3 CCNA 4 CCNA 4 CCNA 4 Theater Total Certified (1.x, 2.x, 3.x) # Untrained 3.0 % Untrained 3.0 Total Certified (1.x, 2.x, 3.x) # Untrained 3.0 % Untrained 3.0 Global 14,502 4, % 13,606 4, % United States 4,520 1, % 4,394 1, % 19

20 Average Class Size The average class size in the United States is 14. The average class size globally is

21 Satisfaction Area May 2005 May 2004 % of Change Global United States

22 Why is the Course Feedback Important? Students are the main consumers of the Networking Academy Program Need feedback from this critical group The ONLY REAL consistent way to get student feedback Taken at the end of every class by all students Have to finish course feedback form in order to complete their course Data are informative to: Instructors (self-evaluation) Program and Field Teams (monitoring & instructional evaluation) All Academies (instructional evaluation) Content development teams (materials and content evaluation) Program evaluation (student/instructor/academy success models, academy metrics, reporting) Also gain this information from instructors when they go through training, so all the same data can be used with CATC and Regional Academies 22

23 What does Course Feedback Measure? Overall: Students reported perceptions of course-related activities and student characteristics and plans Five Main Areas Being Measured (Subscales): Student Confidence Materials & Activities (provided by Cisco) Instruction Satisfaction Student Motivation Other components: Problem solving Accessibility of Learning Materials (labs, curriculum, etc.) Future Intentions 23

24 Course Completion May ,100+ Students completed a Cisco Networking Academy Course Number of Students who are marked incomplete 24

25 Tools to Monitor Quality 25

26 Quality Tools Documentation Academy Quality Management Tool Reports Historical Assessment and Course Feedback Survey Results Page 26

27 Documented Field Quality Program Quality Assurance Program that consists of four components: Implementation Guide Training Guide Improvement plan Best Practices Powerpoint Look for new design in August! 27

28 Academy Quality Management Tool Goals Online Quality Process Continue to develop and strengthen the AQMT through customer feedback Functionality Support Visit Academy Performance Report Instructor Proficiency Plans 28

29 Support Visit 29

30 Support Visit (cont) 30

31 Academy Quality Management Tool (AQMT) Academy Level Reporting Academy 1 Academy 2 Academy 3 Academy 4 Academy 5 Academy 6 Academy 7 Academy 8 Academy 9 31

32 Why have an AQMT? What do we do with this information? Information is captured at the Academy Level Data is forwarded to the appropriate team to integrate into design of future planning What have you learned to date? Enrollment issues is a challenge in many areas in the US Need for more academic rigor Make it more exciting 32

33 Survey Results Page Location: AC Instructor Gradebook CF Exam details 33

34 Historical Class Assessment and Course Feedback 34

35 Q and A 35

36 36