LifeSkills Training 3.0 Data Collection and Analysis Tool How-To-Guide

Transcription

1 LifeSkills Training 3.0 Data Collection and Analysis Tool How-To-Guide The following how-to-guide describes how to use the EPISCenter Data Collection and Analysis Tool for the LifeSkills Training program. PCCD grantees will use this reporting tool each quarter to collect and report data. Grantees should use a new reporting tool for each year of their grant. This document uses screenshots of the various tabs within the LST Reporting Tool and provides instructions for using each. The tabs are explained in the order they appear in the spreadsheet, from left to right, beginning on the left-most tab called Instructions and moving to the right, finishing with the Logic Model tab. Each tab is listed below (A-J) and clicking on the title will jump you to that section of this document. Table of Contents: A.) Instructions B.) Process Performance Measures (Data Entry Required) C.) Outcome Performance Measures D.) Observation Log (Data Entry Required) E.) LST Youth Survey (Data Entry Required) F.) LST Tracking (Data Entry Required) G.) Descriptives Youth H.) Descriptives Survey I.) Descriptives ATOD J.) Logic Model

2 A.) Instructions The first tab of the spreadsheet is the Instructions. This page outlines and summarizes the tabs within the spreadsheet, their general characteristics, and also includes a section outlining how to submit this spreadsheet as an attachment in E-grants. You may find it helpful to print this tab in order to review these detailed instructions. For PCCD grantees, it is essential to return to this tab and click the green button prior to submitting this spreadsheet to E-grants. This will run a macro that will replace all identifying information that you may have entered in the LST Survey tab with an anonymous code. The last step before submitting your spreadsheet to Egrants is to click this green button. It will ensure that you do not submit any identifying data.

3 B.) Process Performance Measures (PMs) Data Entry Tab Cells where you will enter data are highlighted in yellow (rows 1-14). By hovering over each PM description in the Performance Measure column with the mouse, a more detailed description of the PM and how it is calculated can be viewed. Cells with a small red triangle in the top right corner indicate more information can be viewed by hovering. Rows 1-4: Grant and Agency Information In row 1, click on the dropdown box to select the month that the grant began; this will generate the appropriate quarter numbers in row 5. In row 2, use the dropdown box to select the first year of the grant, and then enter the PCCD grant number and county of implementation. In row 4, fill in your agency and contact information. Rows 8-14: Process Information Please only enter data pertaining to LST programs that have ended. Enter data in the quarter in which the program cycle ended. You will complete rows 8-13 each quarter. If there is no data to enter, please enter 0 so it is clear that data was not accidently missed. Don t forget to enter the month and year your grant started here! Enter contact information in this row. Enter data into EVERY yellow cell for the quarter you are reporting on. There are times when you will need to enter a 0. That s ok! As you continue to enter data each quarter over the course of a grant year the cumulative totals in this column will grow. Data in these rows will automatically populate when you enter data in other tabs.

4 C.) Outcome Performance Measures (PMs) Informational tab - This tab provides a summary of the program s impact on youth based on the youth survey responses. This data can be used to report to your collaborative board and stakeholders. The PMs in this tab are calculated for you using the data you enter in the other tabs. You do not need to enter any information into this tab. Each quarter the total number of youth and percent with positive change will be shown in these columns. The tool also provides a total for the year.

5 D.) Observation Log Data Entry Tab - Please enter data from the LST checklists that were completed on the Year 1 (Level 1) Core Lessons during the school year. Each row represents data from one observation. A minimum of 20 percent of the Year 1 Core Lessons should be observed. Total observations and number meeting minimum fidelity summarize here and in the Process Tab. The quarter of observation must be entered in order for this data to summarize correctly.

6 E.) LST Youth Survey Data Entry Tab - Please enter data from the Developer s 2011 LST-MS Youth Survey plus Section E (PRE and POST) for all students who received the Year 1 (Level 1) Core Lessons. Each column represents data from one student. Please ensure that POST data is matched to the corresponding PRE data for each student. The Post-test data section begins in Row 99. Up to 800 student pre/post surveys can be entered and analyzed using this tool. If you have more than 800 youth please contact the EPISCenter for assistance. Be sure to enter the Quarter that the Post-Test was completed in row 100 for each student. In order for data to summarize correctly use the drop down menu to select the quarter the post test was completed. The numbers in column A correspond to PM numbers in the Outcome PMs Tab. Each column should contain pre and post data for one student.

7 F.) LST Tracking Data Entry Tab- This tab is provided for your convenience. It can be used to enter information on each cycle or set of LST lessons taught. Include school, classroom, teacher, number of youth, level, grade, dates of start/end and dates of pre/post survey administration. The tool will automatically calculate the number of youth served, completed, and number of cycles completed in these cells. In order for data to summarize quarter ended must be selected. Columns K-R can help coordinators monitor pre/post administration and data entry.

8 G.) Descriptives Youth Informational tab summarizes demographic data from pre-test survey data. This tab helps provide a descriptive summary of the youth participating in the pre-test survey. You do not need to enter any information into this tab. This descriptive data can help LST providers understand some general characteristics of the group of students they are serving.

9 H.) Descriptives Survey Informational tab summarizes survey data for individual items related to changes in knowledge, skills, use, and perceptions. You do not need to enter any information into this tab. The information in this tab will give LST providers information about how the students performed on each survey item at Pre and Post.

10 I.) Descriptives ATOD Informational tab summarizes youth responses to ATOD use, intention to use ATOD, and peer use perception items. Analyzes and presents data by combining youth data into three categories that represent low-risk, medium-risk, and high-risk categories according to their responses to each group of survey items. You do not need to enter any information into this tab. Data specific to cigarette, alcohol, marijuana, cocaine, and inhalants is provided for each of the three categories. ATOD Use descriptive data illustrates youth report of past 30 day use of alcohol, tobacco, and other drugs. ATOD Intent descriptive data illustrates youth report of their intent to use alcohol, tobacco, or other drugs in the future. Peer Use Perception descriptive data illustrates youth report of how much they think their peers are using alcohol, tobacco, or other

11 J.) Logic Model Informational tab includes the logic model for the program with notes illustrating each performance measure and its corresponding short or long term outcome.