Test Generator. TG Reports: Analysis Overview

Transcription

1 Test Generator TG Reports: Analysis Overview

2 Introduction [about this tutorial] This tutorial is intended for TG customers and prospective customers who: Have had individuals take tests using TG s windows or web Tester Want to learn more about the available analysis options in TG Reports If you are familiar with TG Reports analysis tools, you can skip this tutorial. [options] TG Help includes TG Reports topics under Help > Contents > Reports Customers can schedule a TG Reports-specific online training session Note: an active maintenance subscription is required. [questions?] Please contact us or support@testshop.com.

3 Introduction [reports overview] If you haven t already done so, we recommend reviewing the TG Help topic, Reports Overview found under TG Help > Contents > Reports.

4 Introduction [TG designations] By default, TG uses Course as a folder label for the directory under which tests are organized, and Test Taker as the label designating a set of users who will be taking tests. If you prefer other labels, you can change the default designations under TG's System module: System > Settings > Designations). Your changes will be reflected in TGReports.

5 Introduction [TG Reports] TG Reports (TGR) enables admin-level users to display, review and analyze test data. TGR can be opened from within Test Generator or launched as a separate application. TG Reports replaces the Reports module found in pre- TG versions of TG. [reports] TGR includes 16 separate reports organized into three groups, by frequency of use: 1) Reports 2) Analysis 3) Misc

6 Introduction [analysis] This tutorial will review TGR s analysis reports. These reports are grouped under the Analysis module and include: * Question analysis * Subject analysis * Answer analysis * P-Value analysis [about test data] In order to use TGR, you must have some test data to work with. By test data we mean tests that have been taken by your test-taking audience, using TG s window s or web Tester. The resulting test data is stored in TG s database. This data can be accessed using TGR.

7 Individual test-taker performance [analysis reports] Do not provide performance data per individual. These TGR reports do: 1) Test Taker Scores 2) Test Taker by Subject and 3) Study Guide We also develop customized reports. Please contact us for details.

8 question and subject analysis reports [what are they] The Question and Subject Analysis reports provide data that is useful in determining how well all of the individuals who took a test did per question or per subject. These reports display results in performance categories organized into columns: <60% - F, 60-69% - D, 70-79% - C, B and A. Which columns are displayed will depend on whether or not one or more or your test takers scored within that performance range. If there are no scores within the <60% performance range, that performance column will not appear.

9 analysis report toolbar [the question and subject analysis toolbar] The icon toolbar at the top of the window includes: 1) Close button 2) Navigation and page number display 3) Print and Printer Setup 4) Export 5) Magnification % 6) Search field The report header displays the name of the test, description, date. The description is optional and based on your Test Properties settings.

10 answer analysis report [what is it] The Answer Analysis Report displays detailed information on how each question in a test was answered by [takers]. The report is displayed in a table: gray blocks represent the correct answer. The number of times a wrong answer is chosen, is displayed under the corresponding answer (A, B, C ). This report is suitable for multiple choice, checkbox and true / false question types, and is useful in analyzing the quality of test items and evaluating instructional approaches / strategies.

11 p-value analysis report [what is it] The point-biserial correlation is the correlation between the right/wrong scores that takers receive on a question and the total scores of the remaining questions. The p-value simply tells us the proportions of takers that answered the question correctly. NOTE: if a question is not answered, it is treated as wrong. Also, if partial scoring is applied, any question score less than 100% is treated as wrong.

12 test data queries [the free query report] This report is designed to allow t.admins to create and run a sql query from within TG Reports. This report is intended for customers who have a technical background or who have technical staff familiar with writing sql queries. In order to use this resource effectively, TG s data map and schema are available to customers upon request. Once a query is written, the t.admin can type in, or cut/paste, the query into the field displaying the Type the query and press Enter text. Or, if you prefer, queries can be run by using the SQL reporting tools available to the technical staff.

13 This concludes our tutorial. We hope you found it helpful. We welcome your comments and feedback. Thank You