Getting Started with eportfolios: A Framework for Effective Implementation Helen L. Chen Stanford University AAC&U Institute on General Education & Assessment June 3, 2014 In our general education programs, do students have the opportunity to demonstrate what they know and can do? Can they: 1. self-assess their own abilities; and 2. paint a picture of accomplishment for employers? -- Debra Humphreys, 6/1/13 1
eportfolios and Folio Thinking Portfolio: A purposeful selection of artifacts together with reflections that represent some aspect of the owner s learning A culture of Folio Thinking provides structured opportunities for students to: 1. create learning portfolios 2. reflect on learning experiences emphasizing integration, synthesis, and self-understanding Why eportfolios? Why now? 2
A Changing Educational Landscape Credit Hour Degree Learning? Amy Latinen, Cracking the Credit Hour, September 2012, New American Foundation and Education Sector 3
College transcripts are horrible when it comes to winnowing the field to 10 or 15 semifinalists, we have almost no useful information about what they learned in school. But what does a college degree really tell employers about how much an applicant knows, about how much they learned to earn that credential? 4
2006 Board of Trustees Leland Stanford Junior University 2012 ECAR National Study of Undergraduate Students and Information Technology 7x as many students used eportfolios in 2012 (52%) vs. 2010 (7%) 2013: 53% of students reported using eportfolios 5
Multiple curricula within higher education as they are Lived Delivered Lived & Experienced 6
Lived & Experienced we need to apply new technologies to the primary tool of traditional certification, the diploma. We need to take what now exists as a dumb, static document and turn it into a richer, updateable, more connected record of a person s skills, expertise, and experience. 7
eportfolios and/or degrees? degrees are a proxy for skill attainment, but they are far from a perfect one, as seen in the amount of retraining that employers do as well as the current unemployment figures. Real outcomes and real mastery as often shown in work portfolios for example are more important. -- Charles Kolb, president of the Committee for Economic Development (2011, Change Magazine) eportfolio Implementation Framework (Chen & Penny-Light, 2010; Penny-Light, Chen, & Ittelson, 2012) 1. Defining Learning Outcomes 2. Identifying and Understanding Learners and Stakeholders 3. Designing Learning Activities 4. Informing Assessment of Student Learning 5. Using eportfolio Tools and Technologies 6. Evaluating the Impact of Your eportfolio Initiative 8
Defining Learning Outcomes What learning outcomes are you currently implementing or considering for your eportfolio initiative? What types of learning do you want to capture and document? Association of American Colleges & Universities, http://www.aacu.org/leap/ 18 9
19 An ability to function on multidisciplinary teams FIRST Robotics 10
Identifying & Understanding Learners and Stakeholders Who are we designing the learning experience for? What are their characteristics? What technologies are they comfortable with? What support will they need to create their eportfolios? 11
What does your institution s learning career look like? What are the major milestones in the academic trajectory? When is reflection occurring, e.g. applying for jobs/internships, fellowships/scholarships? Who are students interacting with along the way? What offices, programs, services are supporting students in their educational trajectory? Sketch who are the stakeholders for your eportfolio project. 12
Designing Learning Activities Given your outcomes, what activities can you design to best guide the ways that learners use the eportfolio to document their learning? How will their learning be captured and documented in the eportfolio? 13
Alignment in Course/Program Design 14
15
The intent of this assignment was to help us to understand some of the ways trigonometry can be used in everyday life. At first I was really confused by this process, but in the end it all came together and made sense. 16
Informing Assessment of Student Learning How do eportfolios and their artifacts inform assessment of student learning? What evidence is needed for learners to document their achievements and competencies? Models of Assessing College Student Learning (Sternberg, Penn, & Hawkins, 2011) Standardized Instruments and Inventories Indirect Measures and Measures of Engagement Portfolios and Other Performance-Based Assessments Locally Designed Tests and Inventories 17
http://abcnews.go.com/us/wirestory/consumers-surveys-breed-feedback-fatigue-15312009#.txfi129st2y What are you taking away from your Stanford education? Skills Communication Teamwork Problem Solving Personal values & Attributes Discipline Adaptability Responsibility Integrity Experiences Courses Clubs & Organizations Events (Powwow, Luau) Outreach Projects Evidence Writing Samples Multimedia Promotional materials Multimedia Photos, Videos Wellness 18
19
39 Using eportfolio Tools and Technologies Which eportfolio features will support the collection of evidence that allows learners to document and demonstrate their learning? 20
1. Showcase Finding a job eportfolio Purposes (Lorenzo & Ittelson, 2005) Highlighting achievements, skills, and abilities 2. Assessment Tracking development within a course or program Performance monitoring and evaluation 3. Learning Educational Planning, advising, mentoring Documenting knowledge, skills, and abilities over time 4. Hybrid (some combination of the above) 21
Showcase Portfolios vs. Learning eportfolios Showcase eportfolio Learning eportfolio Purposes: Showcase Content: Curated collection highlighting exemplary work Focus: the eportfolio product Goals: Outward facing, networking; your professional identity Audience: Employers, grad schools, professionals, the public Purposes: Exploratory & Developmental over time Content: Could include works in progress, drafts, goals, plans Focus: the eportfolio process Goals: Self-knowledge and understanding; growth over time; your intellectual identity Audience: Selected mentors, advisors, faculty, alumni, peers & family Course/Program eportfolio Student eportfolio Template Student eportfolio created from program template 22
https://stonybrook.digication.com/biodesign_group_5/need Evaluating the Impact of eportfolios How will you evaluate the impact of your eportfolio project? How will you define success for you? Your students? Your faculty? Your institution? What constitutes evidence of YOUR success? 23
Defining Success (Venezsky, 2001) Imagine that your eportfolio project is completed and that it succeeded in all of its goals. You are to appear tomorrow at a press conference to explain what you have accomplished. Write a press release to distribute at this meeting Examples of Quantitative Evidence of Success (Eynon, Gambino, Török, 2012) Increase in GPA At Manhattanville College, the average GPA of eportfolio pilot students was 3.097 vs. 2.771 for students in a comparable, noneportfolio cohort. Higher Retention Rates At IUPUI, the one year fall-to-fall retention rate for students who complete an eportfolio (80%) was significantly higher than for students who did not (72%). 24
Studying abroad gives you the chance not only to see and travel in a foreign country, but to actually learn about how the people there have values that are different to those that your country holds. http://macaulay.cuny.edu/eportfolios/lilachgez/ Why eportfolios? Why now? 25
Employers say that an electronic portfolio of students work and knowledge areas would be useful in evaluating candidates for hire. In addition to a recent college graduate s résumé and college transcript... how useful would it be to see an electronic portfolio of student work that demonstrates accomplishment in key skill and knowledge areas (effective communication, knowledge in their field, evidence-based reasoning, ethical decision-making)? Only somewhat useful 13% Not useful 4% Very useful 43% Fairly useful 40% 51 It Takes More Than A Major January 2013 Hart Research for there s a need to examine and promote best practices in portfolios, and make sure that they are open for students to curate their work and make it available in different contexts, such as when applying to college or for a job. 26
By leveraging technology, we are striving to provide students with the ability to demonstrate their education in more ways than ever before through official and unofficial methods. Students will be able to request these records in creative new ways, including etranscripts and eportfolios. Enhanced Transcript Official academic information maintained and certified by institution Course Descriptions Faculty Profiles edissertations Grades / Grading Keys ediploma Learning Objectives Electronic Portfolio Greater breadth of unofficial information maintained and personalized by student Study Abroad Experience Individual Course Papers Internships Lab Research Service to the Community Certificates of Completion 27
Scholarship Record Quality Collaboratives Quality is key [I]t s not enough to make sure that many more Americans earn degrees or credentials: those degrees must have demonstrable value. -- Jamie Merisotis, president, Lumina Foundation (2012) http://www.aacu.org/qc/index.cfm 28
1. Set Ambitious Goals 2. Gather Evidence of Student Learning 3. Use Evidence to Improve Student Learning 4. Report Evidence and Results http://www.newleadershipalliance.org/what_we_do/committing_to_quality/download Thank you! Helen L. Chen, Ph.D. Director of eportfolio Initiatives Office of the Registrar Research Scientist, Designing Education Lab hlchen@stanford.edu EPAC Community of Practice http://epac.pbworks.com/ 29
eportfolio Resources 30
EPAC Community of Practice Virtual interactions through free online chats & discussions, audio and video conferences; Networking with EPAC members at conferences and meetings; Exchange of resources Tracking of international and national conferences, requests for proposals and funding opportunities; Active exploration and evaluation of eportfolio tools and practices http://epac.pbworks.com/ https://mailman.stanford.edu/mailman/listinfo/epaccoplist National & International eportfolio Initiatives 31
http://c2l.mcnrc.org/ http://www.aaeebl.org 32