Information Technology Applications Development Option Assessment Report 2012-2013 I. Program History History The Information Technology degree was first offered at OIT in 1999. In addition, the Management Department offered degrees in Management Information Systems and Management Information Systems, Management Accounting Option. Because of similarities across these degrees, and in response to student and employer requests, the Department restructured the Information Technology degree in 2006. Today the Information Technology degree allows students to choose from four specialty areas: Accounting, Applications Development, Business/Systems Analysis, and Health Informatics. The Applications Development Option focuses on the acquisition of theory and technical competencies to prepare students for successful careers as applications programmers. This degree option is offered in Klamath Falls and in Portland as well as online. Fall 2012 enrollment in Information Technology Applications Development was 76 students, including 46 students between the Klamath Falls and Portland campuses, and 30 students online. Nine students petitioned to graduate with an Information Technology Applications Development degree in June 2011. Employers of our 2013 graduates include Jeld-Wen, Google, and CorVel. Reported starting salaries ranged from $42,000 to $56,000. II. Program Purpose The Management faculty reviewed the program purpose, objectives, and learning outcomes during the fall faculty meeting in September 2012. Faculty realized that a future plan needs to be developed regarding outcome similarities between Application Development and Systems Analysis options. The faculty reaffirmed the statements below: Information Technology Applications Development Option Mission Statement: The Information Technology Applications Development Option degree provides students with the foundation necessary to enable them to design and implement business information systems. Educational Objectives: (1) The Information Technology Applications Development degree program prepares students to apply critical thinking skills to the ever changing Information Technology industry. IT Application Development Report 1
(2) The Information Technology Applications Development degree program prepares students to succeed in broad industry applications such as midlevel managers or as IT professionals. Student Learning Outcomes: The Information Technology Applications Development option consists of the eight core Management Department student learning outcomes as well as four student learning outcomes specific to this program. Upon completion of this program, Information-Technology-Applications Development graduates will be able to: 1. Demonstrate an understanding of the functional areas of accounting, marketing, finance, management, and economics. 2. Demonstrate an understanding of the legal and social environment of business. 3. Demonstrate an understanding of the global environment of business. 4. Demonstrate an understanding of the ethical obligations and responsibilities of business. 5. Demonstrate the ability to use business tools. 6. Demonstrate the ability to communicate effectively. 7. Demonstrate the ability to apply knowledge of business concepts and functions in an integrated manner. 8. Demonstrate the ability to work effectively in teams and/or groups. 9. Demonstrate the ability to analyze, design, implement, and support Relational Database Management Systems (RDMS). 10. Analyze business needs with the view to design and implement data networks. 11. Perform the general planning and analysis of business systems that will support the development of modern business information systems (IS). 12. Develop fundamental programming skills and apply those skills to solving business information system problems. IT Application Development Report 2
III. Assessment Cycle Assessment schedule IACBE requires all accredited institutions to complete a full assessment cycle for all IACBE core student learning outcomes (SLOs 1-8) on an annual basis. Program-specific learning outcomes (PSLOs 9-12) will be assessed as follows: Program-Specific 2011-2012 2012-2013 2013-2014 2014-2015 Learning Outcomes 9. Demonstrate ability to analyze, design, X X implement, and support RDMS. 10. Analyze business needs with the view to X design and implement data networks. 11. Perform the planning and analysis X of business systems to support IS. 12. Develop fundamental programming skills and apply those skills to solving business information system problems. Table 1: Assessment Cycle for Information Technology Applications Development PSLOs IV. 2012-2013 Assessment Activities Assessment results for the eight core student learning outcomes are reported separately and can be found on the Oregon Tech website under IACBE Public Disclosure of Student Learning. This report covers PSLO #11. PSLO #11: Perform the general planning and analysis of business systems that will support the development of modern business information systems (IS). Direct Assessment (KF): This outcome was assessed using the final project for MIS 312 Systems Analysis I scored using a rubric. There were 11 IT Students out of 20 students in the course. The below results are those IT students. IT Application Development Report 3
This outcome was assessed using the final project for MIS 322 Systems Analysis II. Scored using a rubric. There was 1 IT Application Development Student out of 10 students in the course. Direct Assessment (WLV): This Outcome was measured but not reported by the instructor on record for both MIS 312 and MIS 322. Direct Assessment (WEB): This outcome was assessed using the final project for MIS 312 Systems Analysis I scored using a rubric. There were 8 IT Application Development Students out of 24 students in the course. MIS 322 was not offered during the academic year. Performance Criteria Assessment Method Measurement Minimum Acceptable Performance (KF) (WLV) (WEB) 1. Employ SDLC to plan and design IS to meet business needs. 2. Design an IS that incorporates industry standards and best practices. 3. Generate system specifications and project plan. Rating of final project Rating of final project Rating of final project 1-4 Proficiency 1-4 Proficiency 1-4 Proficiency Table 2: Assessment for PSLO #12 in MIS 312 and MIS 322 3 or 4 rating 85% (312) 0% (322)* 3 or 4 rating 82% (312) 0% (322)* 3 or 4 rating 82% (312) 0% (322)*?* 75% (312) NA (322)?* 85%(312) NA (322)?* 85%(312) NA (322) *Note: 1) Wilsonville data was unattainable for this report, see weaknesses. 2) There was only one student for Application Development registered in MIS 322 whom did not perform up to expectations. Strengths: 1.) The department has begun to re-hire full time faculty to increase continuity and program outcomes. Weaknesses: 1) Not having Wilsonville data available by the instructors on record has created a report that is difficult to analyze. 2) Low enrollment cancelled MIS 322 this academic year through distance education. IT Application Development Report 4
Indirect Assessment Actions: In 2013-2014 the IT program will pursue better coordination between campuses to increase the sample size for results, specifically in Wilsonville. Currently and into 2014 the IT program will evaluate ways to consolidate program extension to entice program growth and improve quality outcomes. This process will require possible consolidation of options and developing new assessment criteria. Performance Criteria (PC): 1. Employ SDLC to plan and design IS to meet business needs. 2. Design an IS that incorporates industry standards and best practices. 3. Generate system specifications and project plan. Survey Question PC Assessment Method 1. I can complete SLO 9 2. I can complete SLO 10 3. I can complete 1 Student rating 1 Student rating 1 Student 2 rating SLO 11 3 Table 3: Assessment for PSLO #12 from Senior Survey Measurement 1-4 Proficiency 1-4 Proficiency 1-4 Proficiency Minimum Acceptable Performance 3 or 4 rating 3 or 4 rating 3 or 4 rating (KF) n=1 (WLV)* n=0 100% NA NA 100% NA NA (DE)* n=0 100% NA NA *Note: Wilsonville and DE students were provided a personalized email with a link to participate in the senior exit survey, but no students completed the exit survey from Professionalism Assessment Professionalism assessment was taken by faculty in a forum setting. Faculty rated students on 12 criteria points on a 3 point scale ( 0 = does not meet expectations, 1 = meets faculty expectations, 2 = exceeds faculty expectations ). Below are the results. There were 9 students rated, 2 from the Distance Ed Program, 2 from the Klamath Falls Campus and 5 from the Wilsonville Campus. IT Application Development Report 5
Category Percentage Met or Exceeded Faculty Expectations 1) Timeliness 100% 2) Quality-content 100% 3) Quality-delivery 100% 4) Attitude toward feedback 100% 5) Attitude toward tasks 100% 6) Punctuality 100% 7) Attendance 100% 8) Academic integrity 100% 9) Interpersonal skills 100% 10) Policies and procedures 100% 11) Work ethic 100% 12) Appearance 100% Table 4: Professionalism The Application development group for the Management Department s professionalism assessment all ranked at meets expectations or exceeds expectation in all categories reviewed. V. Summary The IT program is struggling to obtain quality data from all locations, and with low enrollment continuing to have small sample sizes that drastically affects the quality of our assessment measurements. Re-designing the IT curriculum and outcomes is a current initiative to improve quality and entice enrollment. VI. Changes Resulting from Assessment MIS 275, Introduction to Relational Databases, teaches the essential fundamental concepts necessary to understand and utilize Database Management Systems in today s business environment. These essential concepts include: Fundamentals of the Relational Model, Structured Query Language (SQL), Data Modeling, Database Design, and Database Administration. These concepts are essential for information technology majors and are the foundation for more advanced database courses. Overall, Information Technology students are not attaining the proficiency levels needed to succeed in MIS 341, Relational Database Design I. To improve student learning starting in 2013-14 introductory database courses will be offered according to major. MIS 113, Introduction to Relational Databases, will be offered for nonmajors, while MIS 275 will provide the more technical background needed by Information Technology majors. Faculty expect to see improvement by the next time database management systems (SLO #9) assessed in the program cycle. IT Application Development Report 6
Information Technology Applications Development SLO-Curriculum Map SLO #9: The student will demonstrate ability to analyze, design, implement, and support Relational Database Management Systems (RDMS). Courses that are shaded below indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced E = Emphasized Fr. Soph. Jr. Sr. Fall WRI 121 MIS 273 ACC 325 BUS 457 MATH 111 ACC 201 MIS 341 E MIS 496 R MIS 118 CST 116 MIS 351 MIS 375 MIS 275 I MIS 312 R MSSS Elective Tech Elective Win ECO 201N MIS 322 R MATH 371 MIS 497 R MIS 218 E SPE 321 MIS 342 E ANTH 452 or PSCI 326 MIS 256 WRI 227 MIS 352 Tech Elective SPE 111 MSSS Elective Tech Elective Hum Elective MIS 102 BUS 215 Lab Sci Elective Spr MIS 272 ACC 203 BUS 223 MIS 498 R MIS 311 PSY 201 BUS 356 BUS 478 ECO 202N MATH 361 MSSS Elective PSY 347 WRI 122 MSSS Elective Tech Elective Hum Elective WRI 327 MSSS Elective IT Application Development Report 7
Information Technology Applications Development SLO-Curriculum Map SLO #10: The student will analyze business needs with the view to design and implement data networks. Courses that are shaded below indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced E = Emphasized Fr. Soph. Jr. Sr. Fall WRI 121 MIS 273 E ACC 325 BUS 457 MATH 111 ACC 201 MIS 341 MIS 496 R MIS 118 CST 116 MIS 351 E MIS 375 MIS 275 MIS 312 R MSSS Elective Tech Elective Win ECO 201N MIS 322 R MATH 371 MIS 497 R MIS 218 SPE 321 MIS 342 ANTH 452 or PSCI 326 MIS 256 I WRI 227 MIS 352 E Tech Elective SPE 111 MSSS Elective Tech Elective Hum Elective MIS 102 BUS 215 Lab Sci Elective Spr MIS 272 E ACC 203 BUS 223 MIS 498 R MIS 311 I PSY 201 BUS 356 BUS 478 R ECO 202N MATH 361 MSSS Elective PSY 347 WRI 122 MSSS Elective Tech Elective Hum Elective WRI 327 MSSS Elective IT Application Development Report 8
Information Technology Applications Development SLO-Curriculum Map SLO #11: The student will perform the general planning and analysis of business systems that will support the development of modern business information systems. Courses that are shaded below indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced E = Emphasized Fr. Soph. Jr. Sr. Fall WRI 121 MIS 273 R ACC 325 BUS 457 MATH 111 ACC 201 MIS 341 MIS 496 E MIS 118 CST 116 MIS 351 E MIS 375 MIS 275 R MIS 312 E MSSS Elective Tech Elective Win ECO 201N MIS 322 E MATH 371 MIS 497 R MIS 218 R SPE 321 MIS 342 R ANTH 452 or PSCI 326 MIS 256 WRI 227 MIS 352 E Tech Elective SPE 111 MSSS Elective Tech Elective Hum Elective MIS 102 BUS 215 Lab Sci Elective Spr MIS 272 ACC 203 BUS 223 MIS 498 R MIS 311 I PSY 201 BUS 356 BUS 478 ECO 202N MATH 361 MSSS Elective PSY 347 WRI 122 MSSS Elective Tech Elective Hum Elective WRI 327 MSSS Elective IT Application Development Report 9
Information Technology Applications Development SLO-Curriculum Map SLO #12: Develop fundamental programming skills and apply those skills to solving business information system problems. Courses that are shaded below indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced E = Emphasized Fr. Soph. Jr. Sr. Fall WRI 121 MIS 273 ACC 325 BUS 457 MATH 111 ACC 201 MIS 341 R MIS 496 E MIS 118 I CST 116 R MIS 351 MIS 375 MIS 275 MIS 312 R MSSS Elective Tech Elective Win ECO 201N MIS 322 E MATH 371 MIS 497 E MIS 218 R SPE 321 MIS 342 E ANTH 452 or PSCI 326 MIS 256 I WRI 227 MIS 352 Tech Elective SPE 111 MSSS Elective Tech Elective Hum Elective MIS 102 BUS 215 Lab Sci Elective Spr MIS 272 ACC 203 BUS 223 MIS 498 E MIS 311 I PSY 201 BUS 356 BUS 478 ECO 202N MATH 361 MSSS Elective PSY 347 WRI 122 MSSS Elective Tech Elective Hum Elective WRI 327 MSSS Elective PSLO Outcome Draft IT Application Development Report 10
IT Application Development Report 11