Online Evaluation Tool: Dashboards and Reports

Transcription

1 Slide 1 Online Evaluation Tool: Dashboards and DeLea Payne, Tad Piner Donna Albaugh, Kim Simmons, Robert Sox, Savon Willard, & Beth Ann Williams Welcome to our Online Evaluation Tool: Completing the Teacher Summary Rating Form 1

2 Slide 2 NCDPI Educator Effectiveness DeLea Payne, Educator Effectiveness, Special Projects delea.payne@dpi.nc.gov Tad Piner, IIS Functional System Analyst tad.piner@dpi.nc.gov Kim Simmons, North Carolina Educator Effectiveness, System Consultant kimberly.simmons@dpi.nc.gov Donna Albaugh, PD Lead, Region 4 donna.albaugh@dpi.nc.gov Robert Sox, PD Leadership Coordinator robert.sox@dpi.nc.gov Savon Willard, PD Consultant savon.willard@dpi.nc.gov Beth Ann Williams, Web Content Manager beth.williams@dpi.nc.gov NCDPI Educator Recruitment & Development My name is DeLea Payne, and I am here with Donna Albaugh, Kim Simmons, Robert Sox, Savon Willard, and Beth Ann Williams. We welcome you to this webinar. We are members of Educator Effectiveness at Department of Public Instruction. Joining us today is Tad Piner, IIS Functional System Analyst at DPI. This webinar will provide you with an opportunity to review the process for accessing and creating several types of reports within the online evaluation tool. Webinar Protocol We have a few suggestions to ensure you have a successful webinar experience. You will see the Questions bar as indicated by the bubble chat icon. Use the questions bar to send questions directly to the facilitators. Throughout the session staff members will be responding to individuals in the questions bar privately. If there is a discussion item that seems pervasive among participants, that question may be address to all participants at an appropriate time in the webinar Because we have many participants, mute has been enabled for all participants to ensure audio quality for all. If you lose your connection please log back in using the webinar link. If you have any questions after the webinar, please feel free to those questions to the presenters to the addresses shown on the screen. 2

3 Slide 3 Mandy Taylor Jennifer Bass Professional Development Leads Map Each Region of North Carolina has been assigned two or more Professional Development Consultants who can support and provide training for you as you work with the North Carolina Educator Evaluation System. Please contact the Professional Development Consultants in your region if you need face to face support or training. 3

4 Slide 4 NC Educator Evaluation System (NCEES) Wiki NCEES Wiki Site This is an open wiki. Information is available to all. Membership is not required. If you are prompted to join, simply dismiss that pop up. You may access this webinar and other materials related to the NC Educator Evaluation System by visiting our NCEES Wiki at the top URL. You can also access the recording and the PowerPoint from today s webinar by visiting our NCEES Webinar Archive page at the second URL listed on the screen. Please bookmark the wiki and visit the site frequently to get all the latest updates. This is a public wiki, so you do not have to request membership to access this wiki. 4

5 Slide 5 Educator Evaluation The Process Is NOT Changing Educator Evaluation As you see from this slide the Online Evaluation rubric is the same and the process has not changed. The online Home Base North Carolina Educator Evaluation System (NCEES) instrument will automate the North Carolina Teacher Evaluation Process and the North Carolina School Executive Evaluation Process. The system will allow all employees to complete self-assessments and Professional Development Plans. The system will allow employees to set goals annually and will provide principals/supervisors the ability to modify goals and include feedback to employees. By importing student assessment data, the system will enable administrators to consider student growth as one of the measures of teacher effectiveness. 5

6 Slide 6 NCEES Platform Channels Tabs Channels Container Easy step-by-step interface Integrated feedback analysis Building level administrators can assign rights to others for certain parts of the process NCEES Platform Review New Platform The process is the same for the educator evaluation system but the look of the site and the layout is different. You will find an easy step-by-step interface which we will demonstrate using in the demo site today New Terminology Tabs digital pages with information and access to applications. The specific tabs that each user will see will depend upon the user s system level access rights for Teacher, Observer, and Principal. Channels different sections on the page. There are several channels on the home page: Welcome channel, Targeted Announcements channel and the Calendar channel. Containers within each channel users will find the containers. (ex. Initial Review, Mid- Year Review, End of Year Review) Sign Out link use the Sign Out link at the top right to sign out of the system. 6

7 Slide 7 Help Guides Help Guides By clicking on the tab Help Guides, users can access a number of documents and short videos. There are three channels within the Help Guide tab. Teacher Help Guides Evaluator Help Guides Trainer Help Guides Training Use Only These documents and captivate video clips will provide help and support as you complete documents within the online tool. The guides also provide steps for navigating within the online tool. 7

8 Slide 8 Webinar Outcomes Access Heat Maps and Dashboard Evaluation Completion System Provided Ad-Hoc Reporting Publishing Ad- Hoc Schedule and Export Ad-Hoc Webinar Outcomes Our webinar outcomes today are: How to access Heat Maps and Dashboard How to create Evaluation Completion Hoe to access System Provided How to create Ad-Hoc Reporting How to Publish Ad-Hoc How to Schedule and Export Ad-Hoc 8

9 Slide 9 Webinar Outcomes Access Heat Maps and Dashboard Evaluation Completion System Provided Ad-Hoc Reporting Publishing Ad- Hoc Schedule and Export Ad-Hoc Webinar Outcomes Let s begin with accessing the Heat Maps and Dashboard 9

10 Slide 10 Heat Maps and Dashboard Note: The system will default to show All Evaluations. To apply a filter to the heat map and dashboard reports, use the drop down menu to select the evaluation plan for which you desire to see details. Accessing Heat Map and Dashboard Click on the Staff Evaluations tab On the left side of the All Evaluations channel click on the bars down arrow You will see a list of reports to select from as shown in the bottom left of the screen 10

11 Slide 11 Webinar Outcomes Access Heat Maps and Dashboard Evaluation Completion System Provided Ad-Hoc Reporting Publishing Ad- Hoc Schedule and Export Ad-Hoc Webinar Outcomes Let s look at how to create an Evaluation Completion Report 11

12 Slide 12 Evaluation Completion Evaluation Completion The Evaluation Completion are designed to give site administrators a snapshot look at the evaluation progress in a given time period. Data is displayed at a plan level. After logging into the system click on My Staff tab On the left side of the screen you will see a list of choices as shown in the left screenshot Click on the Evaluation Status Dashboard link to launch this report. 12

13 Slide 13 Evaluation Completion Evaluation Completion Select the Start Date and End Date for the period of time you desire to view. Use the Dropdown Menu to select the plan you desire to see The system defaults to display all steps of the selected plan. Remove the checkmark to remove a given step from the dashboard report. While your report is generating you will see a Please Wait Icon at the top left. This indicates that the report is being generated. 13

14 Slide 14 Evaluation Completion Each field can be sorted by clicking on the arrows in the heading row Not Started In Progress Complete Evaluation Completion While your report is generating you will see a Please Wait Icon at the top left. This indicates that the report is being generated. A comprehensive data table will display at the bottom of the reporting window. Each field can be sorted by clicking on the arrows in the heading row. Click the + sign next to any of the elements to display the Graphic for the dashboard. The graphic depicts the overall percentage of the plans that appear within each category: Not Started, In Progress, or Complete. 14

15 Slide 15 Webinar Outcomes Access Heat Maps and Dashboard Evaluation Completion System Provided Ad-Hoc Reporting Publishing Ad- Hoc Schedule and Export Ad-Hoc Webinar Outcomes Now we re going to show you how to create System Provided 15

16 Slide 16 System Provided System Provided To begin, click on System Administration and select Reporting. 16

17 Slide 17 System Provided System Provided Next you will click on Create Report From Select the module you wish to run the report on: click the dropdown arrow. The choices are: Portal Management, Teacher Evaluation Process and Quick. Select Quick There are seven quick reports that you may select from. Evaluation Completion Exception Report Mentor Relationship Report Orientation Dates PDP Mentor Signature Dates PDP Signature Completion Status Peer Observation Relationships Record of PDP Activities We have selected 17

18 Slide 18 System Provided System Provided Once a report selection is made, you will see that the report is ready to be run. You will select Done. As you see in the screen shot on the right, the report will load. Next you see a screen shot of a completed report. You can review the report online or download the report as a PDF or excel document. 18

19 Slide 19 Webinar Outcomes Access Heat Maps and Dashboard Evaluation Completion System Provided Ad-Hoc Reporting Publishing Ad- Hoc Schedule and Export Ad-Hoc Webinar Outcomes Now we re going to show you how to create Ad-Hoc reports 19

20 Slide 20 Access Ad-Hoc Access Ad-Hoc After logging into the system click on System Administration Ad-Hoc can be generated by Super Users and published to different user groups. Using this tool, data can be populated to comprehensively survey the scope of data collected within the Home Base Portal. Today we will guide users through creating and publishing reports using the Ad-Hoc Reporting feature. Ad-Hoc reports can be filtered by the user where system provided reports cannot be altered. General Access To begin creating Ad-Hoc reports, click the System Administration tab. Scroll to the Applications section and click Ad-Hoc Reporting (Restricted). 20

21 Slide 21 Ad-Hoc Report Layout Ad-Hoc Layout On the left side of the screen, each reporting function is listed. Under the title is a brief description of what data the function allows a user to query or what task the function might be used to for. In addition to the reports shown on the screen you may also choose: Evaluation Statue Evaluations / Summations External Data Sets People Resources Roster Section / Class Times Sections Survey Answers (course) User Sites A full description of each Reporting Function can be found in the Ad-Hoc and Reporting document. On the right hand side of the screen, saved or memorized reports related to the corresponding function are displayed. These are reports that have already been created and may be published out to various users or user groups. 21

22 Slide 22 Create an Ad-Hoc Report Creating an Ad-Hoc Report Determine which reporting function is the most appropriate given the end goal. Once you have determined which report function to use, select New Report next to that function. If prompted, choose a site to ensure all sites associated with the user appear in one column. When we go to the Training Site you will be able to see that along with Search Assessment Completion and Include Assessment People there are these two additional choices: Include Roster Information Include User Sites 22

23 Slide 23 Create an Ad-Hoc Report Note: If you leave a field blank, the report will query ALL responses for that field. Create an Ad-Hoc Report Inputting data into the displayed fields will allow you to specify which components you may include, exclude and display. Use the Drop Down Menus and Text Fields to set inclusion/exclusion criteria. Choose the information you need from the dropdown boxes in each field 23

24 Slide 24 Create an Ad-Hoc Report Note: You can query a field without having it display on the final report. Create an Ad-Hoc Report In the same window, use the Checkboxes to indicate if you would like this field visible in the final report. Use the Radio Buttons to indicate if you would like the final report to be sorted according to this field. Select the data in ascending order by checking the appropriate radio buttons in the Sort columns The first column is the primary sort, and the second column is the secondary sort Think in terms of sorting data in an excel spreadsheet example, Sort by, Then by, etc. 24

25 Slide 25 Create an Ad-Hoc Report Create an Ad-Hoc Report Once you have filtered as desired and selected which fields will display, navigate to the right side of the page. To Save the report so it can easily be run again, give the report a Name and Description, then click Save Report. Note: This Name is the Display Name of the report that will appear to any individual whom you later target to receive this report. If you desire to include totals and averages in your report, click the checkbox next to Include Summary Rows. Note: Check Restrict Results by User Rights if you are publishing a report wherein all targeted users do not have access to all included data. Example: If your report contains information regarding employees at both School A and School B, checking this box will prevent School A Principal from seeing School B Data. Click Run Report Now to generate the report. Your report will display. At the top of the report, you will have additional options. Select Printer-friendly display to load a printable copy of this report. Click Download CSV to export a copy of this report for use in spreadsheet software. Click Start a new Ad-Hoc Query to return to the Ad-Hoc Reporting Menu. 25

26 Slide 26 Webinar Outcomes Access Heat Maps and Dashboard Evaluation Completion System Provided Ad-Hoc Reporting Publishing Ad- Hoc Schedule and Export Ad-Hoc Webinar Outcomes Now we re going to talk about publishing ad-hoc reports 26

27 Slide 27 Publishing Ad-Hoc Reporting Publishing Ad-Hoc Reporting Select the System Administration Tab Click on Ad-Hoc Reporting 27

28 Slide 28 Target Audiences Note: Check Restrict Results by User Rights if you are publishing a report wherein all targeted users do not have access to all included data. Example: If your report contains information regarding employees at both School A and School B, checking this box will prevent School A Principal from seeing School B Data. Target Audiences Look at the list of previously generated, saved, or memorized reports. Click Edit next to the report that you desire to publish. In the top screen shot we have chosen a Sample Test Report In the bottom screenshot, you can elect to publish the report to an Add Individual User or to a Target a Group, based on demographic data. 28

29 Slide 29 Publish to Individual User Publish to Individual User To publish a report to an individual, choose Add Individual User. Enter appropriate search criteria to locate the desired user. Click Search. 29

30 Slide 30 Publish to Individual User Publish to Individual User Search results will display. Place a check next to the desired recipient(s). Click Select. Click Finish. In the Published To section, the user will appear. Repeat this process to add additional users. 30

31 Slide 31 Note: Choose Set Dynamically Republish to cause the report to view this criteria each time it is run, thus preventing someone with updated demographics to receive the report if they no longer have permissions to view it. Publish to a Group Publish to a Group To publish this report to a group, click Target to Group. Use the various search features on the left to narrow your target audience. At any point, click Show Recipient List to view a list of individuals who are set to receive the report. When done, click Finish. In the Published To section, users associated with the targeted group will appear. 31

32 Slide 32 Webinar Outcomes Access Heat Maps and Dashboard Evaluation Completion System Provided Ad-Hoc Reporting Publishing Ad- Hoc Schedule and Export Ad-Hoc Webinar Outcomes And finally let s look at how to Schedule and Export an Ad-Hoc Report 32

33 Slide 33 Schedule and Export Schedule and Export From System Administration tab click on Ad-Hoc Reporting Look at the list of previously generated, saved, or memorized reports. Click Edit next to the report that you desire to publish. In the left pane, click the option to Schedule and Export. Fill in appropriate fields. Click Save. 33

34 Slide 34 Note: Export Title enter the title for the report being exported. File Name enter a file name. Use the date macro to have date and time replaced in the file name. Export Start Date indicate the date your export should begin. Export Time indicate the time of day export should be sent. Recurring Indicate if export should recur daily, weekly, monthly, on specified dates, or only run once. Recipients enter address of all export recipients FTP Server/FTP Port enter information to post report to a server. Column Order reorder the order of the columns by dragging and dropping column names. Currently Scheduled Exports lists any exports currently scheduled to run. These may be deleted as desired by clicking the x to the left of each export name. Schedule and Export Remember to work from the top down. To the right is an explanation of the field to be selected for the schedule and export. 34

35 Slide 35 Schedule and Export Schedule and Export The last item to review are the Currently Scheduled Exports. This is where you will find a list of any exports currently scheduled to run. These may be deleted as desired by clicking the x to the left of each export name. As shown in this screen shot we don t have any currently scheduled export reports. Once all fields are completed click Save. 35

36 Slide 36 Test Site Test Site Now we will demonstrate these steps in the Test Site 36

37 Slide 37 Questions Questions Are there any questions we need to answer before we close today s webinar? 37

38 Slide 38 Survey Live survey link: go.ncsu.edu/webinar An will be sent to all registered webinar participants with the survey link. Survey Before we end the webinar today we ask you to complete an evaluation survey for the Online Evaluation Tool: Teacher Observation webinar. A link to this survey will be ed to you following the webinar, so you can respond by providing meaningful feedback that will enable us to better support you. Thank you for your participation in this webinar. We solicit your feedback about your webinar experience with a brief online questionnaire. In addition, please use the questions bar to request future webinar content that may be helpful to you as you fulfill your role and responsibilities related to the North Carolina Educator Evaluation Process. 38

39 Slide 39 Upcoming Webinars Online Evaluation Tool: End of Year Wrap-Up May 14 10:00 12:00 pm May 15 4:00 6:00 pm Online Evaluation Tool: Wrap-Up Principal/Assistant Principal Form June 3 10:00 12:00 pm June 4 4:00 6:00 pm NCEES Wiki Site Upcoming Webinars Upcoming Webinars This webinar will be offered again this Tuesday, March 11 from 4:00 to 6:00 pm. Please check the NCEES wiki site Upcoming Webinars to find future webinars and registration links. Thank you for attending today s webinar. 39