Winscribe Speech Recognition Reporting

Transcription

1 Winscribe Speech Recognition Reporting 4.1 Copyright 2013, Winscribe Inc. All rights reserved. Publication Date: April 2013

2 Copyright 2013 Winscribe Inc. All Rights Reserved. Portions of the software described in this document Copyright Microsoft Corporation. All Rights Reserved. Information in this document is subject to change without notice. The software described in this document is furnished under a license agreement or nondisclosure agreement. The software may be used or copied only in accordance with the terms of those agreements. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or any means electronic or mechanical or photocopying and recording for any purpose other than the purchaser's personal use without the written permission of Winscribe Inc. Winscribe is a registered trademark of Winscribe Inc. in New Zealand and other countries. Microsoft is a registered trademark, Windows NT and Windows is a trademark of Microsoft Corporation. Dragon NaturallySpeaking is a trademark of Nuance, Inc. and is used here under license. Other brands and their products are the trademarks or registered trademarks of their respective holder and should be noted as such. Winscribe Inc. P.O. Box Takapuna Auckland New Zealand support@winscribe.com Visit our web page: 2

3 Contents Contents Introduction... 4 System Requirements... 4 Localisation... 4 Reports Package... 4 Setup and Installation... 5 Configure SQL Server 2008 R Install Speech Recognition Submitter... 5 Update WSDataProvider.dll... 8 Install Reports Speech Recognition Reporting Report Parameters Report Controls Speech Recognition Dashboard Open the Speech Recognition Dashboard Dashboard Reports Average Transcription Speed Proportion of jobs that are SR Average SR Accuracy Average Spoken WPM Transcription Speed by Accuracy SR Accuracy Distribution Reports Index

4 Winscribe Speech Recognition Reporting Introduction Winscribe Speech Recognition Reporting reports are intended to provide an overview of how well the speech recognition system is working on a site who is using it well, who is not, and whether it is working efficiently as a supplement to human transcription and as a facility for SR measurement and performance tuning. System Requirements SQL Server 2008 R2 SQL Reporting Services 2008 R2 Winscribe Dictation Database Microsoft SQL Server Report Builder 3.0 Runtime components of Web Services Enhancements (WSE) 2.0 (Microsoft WSE 2.0 SP3.msi) Localisation The speech recognition reports are provided in English only, however, the reports are easily modified through SQL Report Builder 3.0 to convert labels and text to another language as required. Reports Package The reports package contains the files needed to install Winscribe Speech Recognition Reporting. Inside the folder are: Submitter setup files WSDataProvider.dll (Important Note: This is not required for Server-Side speech recognition.) Set of speech recognition.rdl report files Following are instructions on how to install and implement these files. 4

5 Setup and Installation Setup and Installation The installation assumes a SQL Server 2008 R2 with SQL Reporting Services is operational on the target system with the Winscribe Dictation database installed. Configure SQL Server 2008 R2 1. Configuration of the Winscribe database: By default, the Winscribe Dictation database is set to compatibility level (80), which enables support for SQL Server SQL Reporting Services does not support this compatibility level. a. Change the Winscribe Dictation Database compatibility level to a minimum level of (90). b. For Winscribe version 4.0, setting the database compatibility level to a level other than (80) will require an update to the Winscribe Web Manager Winscribe Web Manager v4.0 SR1 Update2 (this patch can be found in the patches folder of the distribution package). Install Speech Recognition Submitter Important Note: Not required for WSR installation, see WSR Server Side Installation Guide. 5

6 Winscribe Speech Recognition Reporting Ordinarily, you would only install the Speech Recognition Submitter when using server-side speech recognition, as the Submitter communicates with the (server-side) Speech Recognition Controller. However, as the data required by the Speech Recognition Reporting is calculated by the Submitter, you will also need to install the Submitter when using client-side speech recognition. To install the Submitter: 1. Click Next to begin the installation process: 2. Select the location for the installation folder (the path should be automatically loaded for you) and click Next 3. Specify the controller and click Next 6

7 Setup and Installation NOTE: Unless you are using server-side speech recognition (where the path to the controller is required), the controller field may take any value. 4. Click Next to confirm installation: Note: If you are using client-side speech recognition, you will get the following warning. This may be ignored simply click OK 7

8 Winscribe Speech Recognition Reporting 5. The installation is complete. Click Close Update WSDataProvider.dll Important Note: This is not required for Server-Side speech recognition. Installation of Winscribe Speech Recognition Reporting requires replacing the existing WSDataProvider.dll with the new one provided. 1. Stop the DefaultAppPool in the Application Pool: 8

9 Setup and Installation 2. If running as a Server application in Component Services, stop the COM+ object: i) Right-click Winscribe WEB Components ii) Click to Disable iii) Click to Shut down 3. Locate the folder containing the current WSDataProvider.dll file This file is typically located at: C:\Program Files (x86)\complus Applications\{9E4A7526-5AB3-41F8-8C45-4B1568E25F5E} or C:\Program Files\COMPlus Applications\{9E4A7526-5AB3-41F8-8C45-4B1568E25F5E} 4. Rename the current WSDataProvider.dll file extension (keeping the file for backup purposes): 9

10 Winscribe Speech Recognition Reporting e.g. WSDataProvider.dl_old 5. Drag and drop, or copy and paste the new WSDataProvider.dll file into the folder. 6. Open the command prompt: Note: CMD needs to be run elevated. Right-click and select to Run as administrator: 7. Enter the cd command to change directory to that of the WSDataProvider.dll file. e.g. cd C:\Program Files\COMPlus Applications\{9E4A7526-5AB3-41F8-8C45-4B1568E25F5E}\ 8. Enter the regsvr32 command to register the file: regsvr32 WSDataProvider.dll 9. The file will now be registered: Click OK 10. If the the COM+ object was stopped at #2 above, it will need to be restarted, i.e. click Enable and then Start. 11. Restart the DefaultAppPool in the Application Pool. Install Reports The following steps are required to install the reports into a SQL Reporting Services environment, and must be completed in the order presented below. Note: The following steps require Administration rights to the SQL Reporting Services environment. 10

11 Setup and Installation To install the speech recognition reports: 1. Navigate to the reporting services via MS Internet Explorer: 2. Create a new folder called "Winscribe Reports": a. Click New Folder b. Enter the Name: Winscribe Reports c. Click OK 11

12 Winscribe Speech Recognition Reporting 3. Within the Winscribe Reports folder, create a new folder called "Data" (this folder will hold the data source component and the shared datasets used by the reports): 4. Within the Data folder, create a new data source called "Winscribe Dictation Datasource": a. Click New Data Source b. Configure the new data source: Enter the Name: Winscribe Dictation Datasource Point the datasource to the SQL Server that hosts the Winscribe Dictation database Enter the connection string: Enter the database login credentials Data Source=localhost\;Initial Catalog=WinScribe 12

13 Setup and Installation c. Test that the correct connection string and credentials are entered by clicking Test Connection: d. When the test of the connection is successful (the message "Connection created successfully" will display), click OK. 5. Navigate back to the Winscribe Reports directory: 6. Upload the reports to the Winscribe Reports directory: Use the Upload File menu item and upload each.rdl report file. 13

14 Winscribe Speech Recognition Reporting Speech Recognition Reporting The Speech Recognition Reporting interface comprises of (in descending area layout): Report Parameters Report Controls Report Display Area Report Parameters The Report Parameters enable custom reports to be created from a specified set of criteria. Select a date range and leave all parameters set to "ALL" to create a report for all speech recognition jobs for that period, or set specific parameters to filter the report. 14

15 Speech Recognition Reporting From / To Determines the date range for the report. From and To dates can be manually entered, or click on the calendar icon to the right of each field to pop-up a calendar (click on the date required for the field). The date format is: dd/mm/yyyy Job Type Select ALL or a specific job type. Author Select ALL or a specific author. Department Select ALL or a specific department. Transcriptionist Select ALL or a specific transcriptionist. Transcriptionist Group Select ALL or a specific transcriptionist group. 15

16 Winscribe Speech Recognition Reporting View Report Click to create a report based on the current criteria set. Show/Hide Parameters Click the Show/Hide button to hide the parameters. Click it again to return them to view. Report Controls The Report Controls provide the user with a variety of useful tools for using with a report. Page Navigation Enables navigation between pages of a report (if a report comprises multiple pages). Zoom Enables the adjusting of the view size of a report. Find Text in Report Enables searching for instances of a text string within a report. 16

17 Speech Recognition Reporting Export Enables a report to be exported. A variety of popular file formats can be selected from. Refresh Refreshes the current report. The report will be updated with any new data added since it was created. Print Prints the current report (requires a connected printer). Export to Data Feed Exports the report to a data feed. 17

18 Winscribe Speech Recognition Reporting Speech Recognition Dashboard The Speech Recognition Reporting dashboard comprises of six graphs/gauges. Each reports a set of data interrelated to the others. Open the Speech Recognition Dashboard To open the Speech Recognition Dashboard, click on Speech Recognition Dashboard in the Winscribe Reports folder: 18

19 Speech Recognition Dashboard Dashboard Reports Average Transcription Speed This graph shows the averaged transcription speed. The speed is measured as the number of words typed in the time taken. The time taken is measured using the total time taken by the transcriptionist for the job (typing, correcting, formatting everything from when the job is first opened to when it is finally completed). The number of words typed is estimated using the average dictation speed across all audio in the period (in WPM) and multiplying by the length of the audio for each job (in minutes). Proportion of jobs that are SR This chart shows the total job count divided between SR jobs and manual transcriptions. 19

20 Winscribe Speech Recognition Reporting Average SR Accuracy This gauge shows the average accuracy of all SR jobs. This is calculated by looking at all of the text typed or corrected in the correction dialog during the period, and looking at how much of it was produced by the engine accurately. Average Spoken WPM This gauge shows the average speed that the authors were talking considering all audio for SR jobs in the system. This is calculated by looking at the total text size of the jobs compared to the audio length. Any pauses in the audio will affect the overall WPM calculated. WPM is calculated using the industry standard of Total Characters divided by 5 giving Words, divided by audio length in minutes. Transcription Speed by Accuracy This graph shows how fast jobs are being completed, when the SR system accuracy is good, and how slow they are when the accuracy is bad. The time is not just the correction time, it is the total typist time, so other factors like formatting may play a part in the results. 20

21 Speech Recognition Dashboard SR Accuracy Distribution This graph shows how many jobs have good recognition, and how many have poor recognition. This is the same X-axis scale as the Transcription Speed by Accuracy graph, so the two graphs together should give you a picture of how many slow inaccurate jobs you have compared to the fast and accurate jobs. 21

22 Winscribe Speech Recognition Reporting Reports The dashboard offers the convenience of collating reports on one screen, but all reports can be run and used individually by directly clicking on them. Two reports not included in the dashboard: SR Accuracy Input Source, which graphs speech recognition accuracy based on input source and allows for comparison of all input sources. Transcription Speed Dictation WPM, which graphs typing speed against the number of words spoken per minute in the dictation. 22

23 Index Index A Average Spoken WPM 20 Average SR Accuracy 20 Average Transcription Speed 19 C Configure SQL Server 2008 R2 5 D Dashboard Reports 19 I Install Reports 10 Install Speech Recognition Submitter 5 Introduction 4 L Localisation 4 O Open the Speech Recognition Dashboard 18 P Proportion of jobs that are SR 19 R Report Controls 16 Report Parameters 14 Reports 22 Reports Package 4 S Setup and Installation 5 Speech Recognition Dashboard 18 Speech Recognition Reporting 14 SR Accuracy Distribution 21 System Requirements 4 T Transcription Speed by Accuracy 20 U Update WSDataProvider.dll 8 23