Articulate Assistant User Guide

Transcription

1 Articulate Assistat User Guide Versio. Address: Articulate Istrumets Limited Quee Margaret Campus, Quee Margaret Uiversity Drive Musselburgh EH2 6UU UK Phoe: Fax: Iformatio i this documet is subject to chage without otice ad does ot represet a commitmet o the part of Articulate Istrumets Ltd. The software described i this documet is furished uder a licese agreemet ad may be used ad copied oly i accordace with the terms of the licese agreemet. It is agaist the law to copy the software o ay other medium except as specifically allowed i the licese agreemet. No part of this maual may be published, reproduced or trasmitted i ay form or by ay meas, electroic or mechaical, icludig photocopyig ad recordig, for ay purpose without the writte permissio of Articulate Istrumets Ltd. Copyright Articulate Istrumets Ltd

2 Copyright Articulate Istrumets Ltd 2

3 System Setup... 6 Istallig Articulate Assistat Software... 6 Eablig the software with the USB key... 6 Cofigurig EPG ad Audio settigs... 6 Commuicatio port settig... 7 Audio... Advaced Audio... 9 Usig Articulate Assistat Software... Software Features... Overview... The Basics... Loadig a Cliet... Creatig a List of Prompts... 2 Picture Prompts... 3 Audio Prompts... 3 Selectig a Task Widow... 3 The Record Task Widow... 4 Settig Prompts Makig Your First Recordig Redoig Your Recordig... 5 Makig Your Secod Recordig... 5 Selectig ad Playig a File... 5 Groupig Recordigs ito Sessios... 5 Deletig Files... 6 Cotrollig the Prompt List Display... 6 Cotrollig the Prompt List box ad fot size... 7 Selectig ad Zoomig ito a Regio... 7 Movig the cursor through the recordig... 7 Deletig a Regio of a File... 7 Automatic Prompt Advace... Sigle Palate Display... Palate Colour Scale... 9 Copy to clipboard Variability Scores... 2 Cumulative Checkbox... 2 Freezig the Palate Display... 2 The File Status Pael... 2 The Data Values Status Pael The Aalysis Task Widow Waveform Display Save Selected to file Spectrogram Display Aotatio Aotatig the Waveform Aotatig Usig the Hotlist Sap-to-aotatio Addig Keywords ad Notes to the Aotatio Searchig for Aotatios usig the Filter Selectig Aotated Regios to Play, Aalyse or Edit Copyright Articulate Istrumets Ltd 3

4 Editig ad Deletig Aotatios Chagig Start ad Stop times Cocateatig aotated regios EPG Aalysis The EPG Palates Display Resizig Displays... 3 EPG Aalysis Values Fidig Frames of Maximum ad Miimum Cotact Closure detectio RMS Eergy detectio Defiig your ow EPG aalysis values Selectig Palate Cotact Weights to form the Basis for a Aalysis Value The mea Frot/Back (COG) measure... 3 Defiig your ow COG measure... 3 The mea Lateral measure The mea Asymmetry measure The Stadard Deviatio (SD) measure The Area Measure... 4 The Ateriority Measure... 4 The Posteriority Measure The Cetrality Measure Defiig your ow RMS eergy measure Future improvemets The EPG Feedback Task Widow Comparig EPG Patters Copyig EPG Patters to Referece Display Loadig Referece EPG Patters Savig Referece EPG Patters to Library Copyig the Referece Palate to Word Comparig the Live Palate to the Referece Palate Reward Display The Compariso Feedback Task Widow Exportig Data... 4 Specifyig the Export File... 4 Specifyig which EPG Frames to Export Specifyig which Data Values to Export... 5 Savig ad Retrievig Your Export Cofiguratio Setup Viewig Exported Data Exportig Movies Backup Copyig Displays (Pritig) Copyig to Word for Widows Specifyig Copy Colour... 5 The Copy Task... 5 Pritig Palates Copyig Palates Desigig Task Widows... 6 Eterig ad Exitig Desig Mode... 6 Savig Desig Chages Copyright Articulate Istrumets Ltd 4

5 Charts, Paels, Bars ad Displays Repositioig a module i a Task Widow Deletig a Module from a Task Widow Reorderig the Task Bar Buttos Creatig a New Task Widow Deletig a Task Widow Shortcut Keys Idex Copyright Articulate Istrumets Ltd 5

6 System Setup Istallig Articulate Assistat Software To istall the software, place the Setup CD i the CD player of your PC ad ru Setup.exe from your CDROM drive. This will istall the Articulate Assistat software uder the Program Files folder i ArticAsst folder. The program ca be ru from the Widows Taskbar Start Meu ( Start:Programs:ArticAsst:ArticAsst ). Eablig the software with the USB key The USB key should be plugged i AFTER Articulate Assistat v. or higher has bee istalled. Articulate Assistat requires a USB key plugged ito the usb port of the PC i order for the software to fuctio fully. A USB key is provided for each issued licese. Durig istallatio the ecessary USB hardware device drivers will be istalled o the PC. If the USB key is plugged i before Articulate Assistat (v. or higher) is istalled the widows will detect a ew device ad ask for the drivers. I this case simply isert the Articulate Assistat (v. or higher) CD ito the PC s CDROM drive ad direct Widows to locate the drivers o the CD. IMPORTANT: Keep your USB key safe whe ot i use as lost or stole keys caot be re-issued. Cofigurig EPG ad Audio settigs Switch o the SPI by operatig the switch o its rear pael. Observe the frot pael LED marked POWER to cofirm that the SPI is powered. Observe the similar LED o the frot pael of the EPG3 scaer to cofirm that the EPG3 scaer is powered. Ru Articulate Assistat software. The display should look similar to Figure. Copyright Articulate Istrumets Ltd 6

7 A. Captio bar B. Meu/Task C. Prompt D. Waveform display F. Prompt list G. Butto bar Figure Record Task Widow The cotact area should provide live feedback of cotact betwee the togue ad the EPG palate. If the display does ot respod, check that the hadgrip is plugged i ad beig gripped by the cliet. Try pressig the RESET butto o the rear of the SPI. You should hear a beep after 7 secods ad the palate display should go live. If there is still o respose it may be that the commuicatio port parameters ad eed to be chaged from the default. Commuicatio port settig Select the meu optio Optios the select the submeu Optios:Comms. The COM port etry should ormally be COM. If it reads COM, try chagig it to COM2. If it reads No port the try COM. Figure 2 Com port selectio dialogue TIP: If a EPG palate is ot available it is possible to check that the system is workig by strokig the multiplexer socket with a coi whilst holdig the chrome hadgrip. If COM is uavailable this is most likely due to the presece of other hardware o the PC. If your PC does ot have a secod serial port (COM2) the you must either: a) uistall the competig hardware to make the port available b) istall WiEPG o aother PC with a free serial (COM) port c) cotact Articulate Istrumets Ltd for advice regardig USB-to-serial adapters. If the PC has o serial port, a Serial-to-USB cable (compliat with USB. or higher) ca be used to coect the WiEPG system via the USB port. If a Copyright Articulate Istrumets Ltd 7

8 Serial-to-USB cable is used, the the comport is likely to eed to be set to COM4 or COM5. Test each settig to see o which settig the EPG palate display respods correctly. Audio Next, check the audio sigal level. If usig lie-level iput (see WiEPG Maual), the check that the audio meter is respodig to the microphoe sigal. Adjust the cotrol kob marked Microphoe util the eedle o the meter rises above but below 0 while speakig ito the microphoe. If lie iput is ot available o you computer the the microphoe should be coected directly to the PC soudcard microphoe iput. Now talk ito the microphoe ad the audio display should be similar to the oe below. If there is o sigal (a flat lie i the display) the the audio mixer settigs may eed to be chaged. Figure 3 Wave display showig audio sigal at correct level I Articulate Assistat, select the meu optio Optios:Audio The click o the tab marked Recordig Cotrol or similar (the exact wordig may vary betwee soudcards). If lie-i is beig used the make sure the lie i checkbox marked select is checked ad the microphoe checkbox marked select is uchecked. If Larygograph is ot beig used the the box marked Moo/Stereo should also show Moo. If microphoe is plugged directly ito the PC soudcard microphoe iput the the microphoe should be selected. Copyright Articulate Istrumets Ltd

9 Figure 4 Audio mixer setup for use with direct microphoe iput to soud card. Note. The appearace of this dialogue is liable to chage depedig o the soud card that is istalled Now adjust the slider cotrol o the microphoe or lie-i (as appropriate) util the waveform display respods to speech iput to the microphoe. The close the dialogue box by clickig the X at the top right corer. Advaced Audio Figure 5 Mutig microphoe ad lie-i playback IT IS RECOMMENDED THAT PLAYBACK CHANNELS THAT MONITOR THE MICROPHONE AND LINE-IN INPUTS ARE MUTED. (See Figure 5) Otherwise feedback betwee the microphoe ad speakers ca occur durig recordig. I additio the audible presece of the lie-i moitor durig recordig ca result i poor sychroisatio. As a precautio, a automatic playback mutig fuctio is activated by default. This has the effect of mutig ALL playback while the iput is live. Playback is restored whe a recordig is loaded for review. If the microphoe ad lie-i fuctios have bee muted maually, the Automute Copyright Articulate Istrumets Ltd 9

10 fuctio ca be disabled. The optio to reset the Automute is foud by clickig o the Show All checkbox i the Audio mixer. Figure 6 Audio mixer dialogue showig all cotrols The default (ad recommeded) recordig settigs are 22050Hz, 6 bits ad Moo. These settigs ca be chaged to other values withi the capabilities of the soudcard istalled i the PC. Copyright Articulate Istrumets Ltd 0

11 Usig Articulate Assistat Software Software Features Simple data maagemet. The software automatically maages files, groupig files accordig to cliet ad sessio without the eed to ope, save or ame idividual files. Cliet-based. Idividual cliets or experimetal subjects ca be called up ad otes take ad stored alog with recorded data. Easy to use. The software comes with a ituitive iterface desiged to be easy to operate for o-techical users. Flexible. Advaced users such as researchers ca build ad store display layouts to suit particular tasks. Such users ca also defie their ow aalysis values ad set parameters. Multilevel aotatio Data ca be labelled with ulimited keywords. These keywords ca be used to search ad retrieve data throughout all aotated files. Compatible. All aalysis values geerated by the program ca be exported to a tab delimited text file suitable for importig ito most statistical ad database packages. Coveiet. Graphics ad movies ca be copied directly to Powerpoit for easy presetatio of data. Overview Articulate Assistat is a full-featured articulatory display tool for Widows 95, 9, 2000, NT, XP ad Widows 7. Articulate Assistat is desiged to allow Speech & Laguage Therapists ad Speech Scietists to record ad aalyse data produced by articulatory istrumetatio such as EPG. Articulate Assistat is desiged to work o 2 levels. The first level requires o adjustmet of parameters or techical kowledge. It is simple to use the oscree buttos ad pre-cofigured task widows to achieve basic recordig, therapy ad aalysis fuctios. The secod level allows the user to desig their ow task widows ad maipulate parameters through meu optios ad dialogue boxes. This allows the advaced user to defie their ow measuremets. The Basics Loadig a Cliet The first thig to do whe the program is started up is to check that you have the correct cliet loaded. The cliet ame or referece umber is displayed o the Captio bar (Figure A) at the top of the mai widow. The first time the program is started, the tutorial cliet Jae Smith will be loaded. If a ew cliet is to be recorded or aalysed the the File:New Cliet meu optio Copyright Articulate Istrumets Ltd

12 should be selected ad the Cliet Dialogue Box should be filled i, i a similar maer to the tutorial cliet show i Figure 7. Figure 7 Cliet Dialogue Box Cliet details eed oly be etered oce. Thereafter, the cliet ca be reloaded usig the File:Ope Cliet meu optio. Notes may be added at ay future time by usig the Edit:Cliet meu optio. For coveiece, the cliet data that is beig worked o whe the program is closed, is automatically loaded whe the program is ext started up. NB. All the cliet details ad data files created i Articulate Assistat are automatically saved. The File:Save Cliet As meu optio provides a easy way to save a copy of the etire cliet data record to a backup device. Creatig a List of Prompts The list of prompts ca be chaged with the Edit:Prompt List meu optio which calls up the Prompt List Editor (Figure ). To create a ew list of text prompts, select the File:New meu optio i the Prompt List Editor as show i Figure. The type your prompts, oe per lie, ito the large blak widow. To save your prompt list. There is a limitatio o the character set that you ca use i the prompt list. Essetially, because the prompt is also used as the fileame, Widows gets cofused if you use the followig characters ad so they should ot be used: * Asterisk < >[ ] Brackets Pipe = Equal sig + Plus sig? Questio mark " Quotes \ / Slashes,. : ; Comma, Period, Colo, Semicolo Copyright Articulate Istrumets Ltd 2

13 Figure Prompt List Editor TIP: If you already have a list of prompts i a text file. Simply copy the list to the clipboard usig <Ctrl c> i your text editor ad paste ito the Prompt List Editor usig <Ctrl v> Picture Prompts A image ca be associated with each prompt. First create the image usig your favourite program (e.g. Pait, Boardmaker, Adobe Photoshop etc.). This ca be a drawig or a photograph. Copy the image to the clipboard from withi that program. The, from the Prompt List Editor meu, select Image:Paste. Audio Prompts A prerecorded utterace or soud ca be associated with each prompt. First record the audio prompt usig your favourite program (e.g. Widows recorder, Cool Edit, Articulate Assistat etc.). Remember which folder you saved it i. You ca use ay widows (wav) file as a audio prompt. The, from the Prompt List Editor meu, select Audio:Add ad select the appropriate wav file. You ca play the file to check that it is the oe you iteded by clickig the Play butto. Selectig a Task Widow Withi Articulate Assistat there are widows cofigured to help the user perform certai tasks like Recordig or Aalysig or providig EPG Feedback for therapy. A Task Widow is selected by clickig o the Task Bar. Copyright Articulate Istrumets Ltd 3

14 The Record Task Widow The recordig Task widow is show i Figure. It is desiged pricipally for the purpose of recordig sets of utteraces. The display provides the prompts for the speaker ad provides checks o the quality of the recorded data. Settig Prompts. By default the prompt will show the prompt text, ay image associated with the prompt, tur the text backgroud gree ad play a audio prompt. The audio prompt will be played whe the record butto is pressed. (Oce the audio prompt has fiished playig, the recordig process will progress as ormal). To hide the text or the image or to prevet audio prompts from playig, right click o the Prompt display ad ucheck the appropriate popup meu optio. Makig Your First Recordig. The first recordig i a sessio is achieved i the followig way:. Select the prompt to be recorded by clickig o the prompt i the prompt list (Figure 9C) so that the selected prompt is highlighted. 2. Check that the waveform display is live (i.e. respods to the microphoe). 3. Press the Record butto. 4. Oce pressed, the leged o the butto chages to Stop allowig the user to stop the recordig by pressig the same butto. TIP: If the Stop butto is ot pressed the the recordig will automatically stop after 6 secods. This default ca be chaged usig the Optios:Display: Utteraces:Maximum Duratio meu optio. After recordig has stopped, the software checks to see if the recordig is too loud (clipped) or too quiet. Ad gives a warig. The recordig has already bee saved. The waveform ad EPG files are displayed ad ca be visually checked ad played back if ecessary to cofirm that the recordig is OK. Copyright Articulate Istrumets Ltd 4

15 Redoig Your Recordig If a recordig is usatisfactory because it is too loud, too quiet or the cliet said the wrog thig, the it is easy to re-record usig the Redo butto. The Redo butto is available for up to miute after a recordig has bee made i order to provide a simple meas to overwrite the last recordig that was made. If a recordig eeds to be replaced after that time the it must be selected, deleted ad recorded agai. Makig Your Secod Recordig If you wish to record a secod repetitio of the same phrase, simply press the record butto agai. If you wish to record the ext prompt i the list, press the Go Forward butto. The press the record butto. Alteratively: You ca select ay prompt for recordig by simply clickig o the text i the prompt list (Fig. 2C). Selectig ad Playig a File A recorded file is represeted by a crossed box i the Prompt List display (Figure 9A). Empty boxes (Figure 9B) are simply place markers showig tha o data was recorded for a particular sessio or prompt. To play a file that has bee recorded by the curret cliet, simply select a file by clickig o a crossed box opposite a prompt. The crossed box will tur white. The file will be displayed i the wave trace display, the EPG palates display ad other data displays. The click o the Play butto to hear the whole file. Alteratively: Press the <F2> key o your keyboard to play. TIP: You ca also play the file back at half speed or more slowly by clickig the right mouse butto o the waveform display ad choosig the Play Slowly x 2 optio from the popup meu. Or you ca use <F6> x2, <F7> x4, <F> x Groupig Recordigs ito Sessios The date ad time of a recordig is automatically stored. All recordigs made i oe day are grouped ad separated by a blue sessio separator lie (Figure 9D). If you hover the cursor over a box i the Prompt List display the date ad time of the recordig are revealed as a Hit ext to the cursor. The date ad time of a recorded file are also displayed i the status pael (Figure 9H) if a file is selected. Copyright Articulate Istrumets Ltd 5

16 The sessio umber ad repetitio umber (withi each sessio) are show at the bottom of the Prompt List display. Sessio 3 Rep 2 circled above. Deletig Files Files may be deleted by usig a right mouse click i the Prompt List display to ivoke the popup meu. There are three optios for deletig files. Either: Delete File. Delete the selected file. Delete All Files o <date>. Deletes all files recorded i oe sessio. Note. This will delete files that are ot visible too. See ext sectio. Delete all Files for <prompt>. Deletes all recordigs of the selected prompt. Cotrollig the Prompt List Display The popup meu described i the previous sectio ca be used to determie the files which are visible i the Prompt List display. Show Prompt list. Whe egaged i the task of recordig files it is advatageous to show oly the prompts which you mea to record i.e. the prompts i the curretly loaded prompt list. Show Recordigs. Whe performig aalysis it is oly ecessary to see files which have bee recorded. Show Both. The default is to show both. The default umber of recordigs (colums of boxes) is 20. This ca be icreased by usig the Optios:Display meu ad clickig o the tab marked Utteraces. The Maximum Attempts ca be edited to icrease it above 20. There is also the optio to have the PC make a oise to mark the start ad ed of a recordig. The drop dow edit box shows all wav files i the folder cotaiig ArticAsst.exe. Delete the cotets of the drop dow edit box if o soud is desired. This soud differs from the audio prompt i that it is the same for all recordigs ad is played the istat that recordig goes live. Short souds Copyright Articulate Istrumets Ltd 6

17 should be used uder ormal circumstaces such as the BEEP ad BOOP samples that come with the istallatio. With a larger umber of Attempts selected it may be ecessary to use the scrollbar at the bottom of the Prompt List display to brig the sessio of iterest ito view. Cotrollig the Prompt List box ad fot size It is possible to icrease the size of the boxes i the prompt list by selectig the Fot optio from the popup meu ad icrease the fot size. The Checked Colour popup meu optio allows the colour of the checked boxes i the Prompts list to be chaged to suit. Selectig ad Zoomig ito a Regio To select a regio, click the left mouse butto ad drag o the waveform display. Alteratively: You ca use the <shift> key, click the left mouse butto ad drag to select i ay widow (except the spectrogram widow). To Zoom I to the regio, click o the cetre of the ico. To Zoom out to see the whole file, click o the cetre of the ico. Click the appropriate side of the ico to move backwards ( )or forwards ( )through the waveform whe zoomed i. Tip: Oce a regio is selected it is possible to adjust the left or right extet by usig the <Ctrl> key while clickig the left mouse butto ad draggig. Movig the cursor through the recordig The cursor ca be moved by clickig the left mouse butto ad draggig i ay widow (except the waveform widow). To move the cursor oe waveform sample at a time, left click o the Waveform widow ad use the left ad right cursor keys o the keyboard. To move the cursor oe EPG sample at a time, left click o the EPG palates display ad use the left ad right cursor keys o the keyboard. Deletig a Regio of a File To delete a regio of the file:. Select the regio to be deleted. (This might typically be some extra speech accidetally recorded at the begiig or the ed of the file.) Copyright Articulate Istrumets Ltd 7

18 2. Click o the right mouse butto i the Waveform widow to brig up the popup meu optio. ad click o the Delete Selected Automatic Prompt Advace For coveiece, it is possible to make the prompt advace automatically to the ext oe i the list by checkig the Auto Advace checkbox (Figure 9J). Whe Auto Advace is checked, the Go Forward butto is replaced by a Go Back butto. Usig the Go Back butto it is possible to move back to the last recorded file. Note: If you wish to redo a recordig whe Auto Advace is checked, you must press the Go Back butto the the Redo butto A. Crossed checkbox B. Empty checkbox C. Selected prompt D. Blue sessio separator lie E. Sessio scrollbar F. Play Butto G. Record/Stop Butto L. Data values status pael H. File status pael I. Go Back/Forward J. Auto Advace K. Redo Butto Figure 9 Recordig Listbox, Buttos ad Status bar Sigle Palate Display The Palate Display shows a average cotact patter for the curretly selected regio of the file. Or, it shows the curret palate frame if o regio has bee selected. TIP: To quickly sca through a EPG recordig, click the butto ad watch the Sigle Palate Display. Alteratively, click ad drag the mouse alog the Palates Display (Figure 22). Copyright Articulate Istrumets Ltd

19 A. Colour key showig rage from o cotact (0%) to costat cotact (00%) D. Variability scores. C. Cumulative checkbox. B. Palate frame umber(s) (46 to 97 i this example) Figure 0 Palate Displays Palate frames are umbered i sequece from the start of each file. The frame umber (or umbers, if a regio is selected) is displayed below the palate display (Figure 0B). Palate Colour Scale The colour key to the right of the sigle palate display maps the display colours to a scale which shows the percetage of selected frames for which each cotact is o. For example, i Figure 0, the bottom right-had cotact is dark i colour. By referece to the colour key this idicates that this cotact is o i all the frames i the selected regio (frames 46 to 97). The colours of the palate ca be chaged usig the Optios:Colors:Palate meu optio to brig up the dialogue box show i Figure. or A. Colour selector. Figure Palate Colours Dialogue Click o the colour selectors to get a colour selectio dialogue. The Mai Palate Touchig ad Not Touchig selectors idetify the ON ad OFF colours for the live EPG iput. The Compariso Touchig ad Not Touchig selectors cotrol the colours i compariso to a referece palate (see sectio i this maual o Compariso Feedback). For ormal EPG display with o superimposed referece template: Copyright Articulate Istrumets Ltd 9

20 Mai Palate, Touchig EPG cotact ON Mai Palate, Not Touchig EPG cotact OFF Compariso, Touchig Not used Compariso, Not Touchig Not used For compariso EPG display with superimposed referece template: Mai Palate, Touchig EPG cotact ON (ad ot matchig a superimposed referece patter) Mai Palate, Not Touchig EPG cotact OFF (ad is also OFF i the superimposed referece patter) Compariso, Touchig EPG cotact ON ad matchig a superimposed referece patter Compariso, Not Touchig EPG cotact OFF (but is ON i the superimposed referece patter) The shadig scale ca be substituted by other visual represetatios for the percetage cotact. Bars A bar fills each cotact square. The percetage of the cotact square filled represets the percetage of cotact. Shade Default represetatio. Nums Represets as a umerical percetage. Copy to clipboard This is a quick optio (see also Copy Palates) to copy a sigle palate patter to a documet i Word or similar. It differs i that the patter is prited i the selected colours. Copy to clipboard is also available from the referece palate display which allows patters to be created by had ad the prited. This is useful for geeratig templates for cliets to take home with them. Right click o the palate display ad select Copy to clipboard. The click o Paste or use <ctrl>v to paste ito Word. Copyright Articulate Istrumets Ltd 20

21 Variability Scores The Variability Idex provides a value for the stability/variability of articulatory gestures. To calculate the idex, the percet frequecy of activatio of each cotact across frames is measured. For each cotact, 00% ad 0% activatio frequecy represet ivariace ad are assiged a variace idex of 0. The variability idex icreases as cotact frequecy approaches 50%, which is assiged a maximum idex of 50. The overall variability idex is calculated i two forms. by summig the idex values for all cotacts with more tha 0% cotact ad dividig by that umber of cotacts. 2. by summig the idex values for all cotacts ad dividig by 62. These two idices are show i this order below the Sigle palate Display (Figure 0D). A idex value of 0 represets ivariace, the higher the variability idex the more ustable the EPG patters (maximum idex value is 50). Cumulative Checkbox If the Cumulative checkbox i the Palate Display is set, the whe a cotact comes o it will stay o util the checkbox is uchecked. TIP: Checkig the Cumulative checkbox is a good way to check whether all the cotacts o a users palate are still workig OK Freezig the Palate Display It is possible to freeze the Sigle Palate Display so that the palate patter does ot chage with live iput or with the movemet of cursors i a recorded file. Simply click aywhere o the Sigle Palate Display to freeze it ad do the same agai to ufreeze it. A label sayig UFreeze will appear to idicate that the display is froze. The File Status Pael The file status pael (Figure 9H) shows the sample rate (default = 22050Hz) umber of chaels (default = for moo recordig) ad the umber of bits per sample (default:6). Whe a recorded file is selected, the file status pael displays also shows the prompt text with the date ad time that the file was recorded ad the full path of the wav file. Copyright Articulate Istrumets Ltd 2

22 The Data Values Status Pael The data values status pael (Figure 9L) shows the data values relevat to each widow as the cursor is moved over it. Whe the cursor is over the Waveform or Palates displays it shows the time i secods from the start of the file, the duratio of the selected regio ad the palate umber (or rage of palate umbers whe a regio is selected). Over the Aalysis Values display the time i secods from the start of the file ad the values of all the EPG parameters are show. Over the spectrogram widow the time ad frequecy are show. The Aalysis Task Widow The Aalysis Task widow is show i Figure 5 It is desiged pricipally for the purpose of aalysig ad aotatig sets of utteraces. The display provides the waveform ad spectrogram displays ad provides meas for aotatig the data. Aalysis values derived from the EPG data are also displayed. Waveform Display The use of this display i selectig regios ad playig back was covered i the previous sectio. Additioal features useful for aalysis are the ability to superimpose tickmarks o the display. This ca be selected usig the right click popup meu i this display widow. The tickmark resolutio depeds o the amout of zoom ad is always marked i secods. Figure 2 Waveform Display with popup meu optios Save Selected to file It is possible to Save selected regios of a recordig to a file. To do this, right click o the waveform display ad select Save Selected to file to brig up the Save selected Dialogue box (Figure 3). The choose whether to save the audio data (Save Wav file), the EPG data (Save EPG file) or both. There is a further optio to preserve the aligmet of the audio with the EPG. If this optio is chose the audio data will iclude a few extra samples at the start so that the time of the first audio sample aligs with the start of the first EPG frame. If this optio is ot selected the the audio file will cosist of samples exactly as selected. Copyright Articulate Istrumets Ltd 22

23 Figure 3 Save Selected to file Dialogue box Spectrogram Display The spectrogram is based o a Haig widowed FFT with 0.97 preemphasis. The resolutio of this display ca be chaged usig the Optios:Display:Spectrogram meu optio. A value of 6 or 7 bits correspods to a Widebad spectrum which emphasises the format structure of the speech. A value of or 9 correspods to a Narrowbad spectrum which emphasises the harmoic (pitch) structure of the speech. The spectrogram colours ca be chaged to suit usig the right click popup meu to call up the spectrogram colours dialogue. Figure 4 Spectrogram Colours Dialogue The default colour scale is defied by oly 2 colours, however it is possible to create more exitig spectrograms usig a rage of colours. The Number box allows up to 6 colours to be chose. The rage of spectral power over which these colours are applied is determied by adjustig the cursors o the colour bar. Copyright Articulate Istrumets Ltd 23

24 Upper spectrogram Lower spectrogram The spectrogram disply ca be maually refreshed by usig the right click popup meu optio, Refresh. Aotatio The Aalysis Task Widow is show i Figure 5. It is desiged, pricipally, to allow the audio ad EPG data to be aotated. Aotatio ca be made o the basis of the audio data by observig the waveform, the spectrogram or by playback. Aotatio ca also be made o the basis of EPG by observig the EPG palate sequece (Figure 5D) or the aalysis values (Figure 5E) derived from the EPG such as total cotacts or Cetre of Gravity. Automatic aotatio is also possible by selectig maximum or miimum poits i a give aalysis value trace (e.g. Fid all the regios i a setece where there are more tha 4 cotacts o i the posterior palate row). A. Meu ad Task Bar B. Waveform ad Label display C. Spectrogram display D. Palate sequece display E. Aalysis values display F. Prompt List G. Butto bar H. Status bar I. Aotatio J. Spectrogram display colour scale K. Aalysis value key L. Sigle Palate display Figure 5 Aalysis Task Widow Copyright Articulate Istrumets Ltd 24

25 Aotatig the Waveform To aotate the waveform, place the cursor at the poit you wish to aotate. The press the Add butto i the Aotatio editor (Figure ). A aotatio marker will appear below the waveform ad the Aotatio Editor will show the default text. Replace this text with your ow label, which should ot have ay blak characters i it. A uderscore ca be used to separate words. It is also possible to select a regio of the waveform ad aotate it. Aotatig Usig the Hotlist The aotatio Hotlist is a quicker way to aotate if you have a set of labels ad associated keywords that you will use may times. For example, you may wish to aotate word-iitial ad word-fial velar ad alveolar stop closures for 0 repetitios of 6 seteces for 3 subjects repeated i 2 sessios. To add a aotatio usig the hotlist, right click o the waveform display ad select the Add Aotatio optio. A drop dow ist of aotatios the appears ad by clickig o oe of the etries the chose aotatio is automatically added for the selected regio. Copyright Articulate Istrumets Ltd 25

26 Figure 6 Addig a aotatio from the dropdow hotlist The hotlist ca be tailored for each aotatio task. To create ad edit a aotatio hotlist click o the butto i the Aotatio module. The type out your list of aotatios. You may wish to type them out i a word processor ad the copy ad paste ito the hotlist editor. Figure 7 Editig the hotlist Copyright Articulate Istrumets Ltd 26

27 Sap-to-aotatio The sap-to-aotatio fuctio allows selected regios to sap to earby aotatio boudaries. If you click ear (withi 4 pixels of) a aotatio boudary the selected regio boudary will jump to meet it. This is useful for esurig eighbourig phoetic segmets are cotiguous.this feature ca be switched off by right clickig o the waveform display ad ucheckig the Sap to Aotatio optio i the popup meu. Addig Keywords ad Notes to the Aotatio A aotatio keyword is ay text separated by a space character o the first lie of aotatio ad ca be used as the basis for searchig through all aotated files. The first aotatio keyword is also the label, which appears uder the waveform as described i the previous sectio. You ca add as may keywords as you like. Ay text typed o the secod ad followig lies i the lefthad pael of the Aotatio Editor are regarded as aotatio otes. Aotatio otes are stored ad ca be recalled but they are ot searchable. Figure Aotatio Editor Searchig for Aotatios usig the Filter The Aotatio Editor will, by default, display every aotatio for the curret recordig. However, it is possible to cotrol which aotatios are displayed by usig the Aotatio Filter (Figure 9). Filter Source The files to be searched ca be filtered accordig to: This recordig. Shows oly aotatios withi the curret file. This prompt. Shows aotatios for all repetitios ad across all sessios for the curret prompt. This cliet. Shows aotatios for all files recorded by curret cliet. All cliets. Shows all files recorded by all cliets. Copyright Articulate Istrumets Ltd 27

28 If This cliet or All cliets are chose the the search ca be arrowed by specifyig the prompt or part of the prompt. E.g. would arrow the search i the example set of prompts i Figure. to a soup the chalk the dolls the sugar, a shoe a soup houses a saw ad a soup a slide a trai a zoo while the sugar uiquely. is eough to specify a soup the chalk the dolls Figure 9 Aotatio Filter. The example show defies a search through all files for the curret cliet which have the word soup i the prompt ad fid all the aotatios with labels or keywords cotaiig s ad the keyword fricative i the first lie of the aotatio BUT ot with labels/keywords cotaiig sh, or dh Filter Aotatios The secod level of filterig refies the search accordig to the keywords i the first lie of the aotatio. The optios are: Show all. No filter is applied to the files selected i Filter Source. Filter. Filters the files to display i the Aotatio Editor oly the aotatios associated with the keywords typed i the first Iclude Text box but ot if they also cotai keywords typed i the secod ExcludeText box. Note that to show all aotatios but excludig selected keywords you ca leave the Iclude Text box blak. If is selected the all the specified keywords must be preset i the first lie of the aotatio for that aotatio to be displayed. If is selected the oly oe of the specified keywords eeds to be preset i the first lie of the aotatio for that aotatio to be displayed. The result of the filter settigs i Figure 9 o the tutorial cliet Jae Smith is show i Figure 20. Copyright Articulate Istrumets Ltd 2

29 Selectig Aotated Regios to Play, Aalyse or Edit There are two ways to select a existig aotated regio.. Click o the aotatio marker o the waveform display ( or ). If there are several markers close together the you will be give a choice. 2. Click o the aotatio listed i the Aotatio Editor (as i Figure 20). This has the added advatage that it will automatically load the correct file. Figure 20 Result of filter settigs show i Figure 9 for the tutorial cliet Editig ad Deletig Aotatios Select the aotatio by oe of the methods show i the previous sectio. The aotatio details appear i the left had widow of the Aotatio Editor. These may be edited. The selected aotatio ca be deleted by clickig o the butto marked Delete i the Aotatio Editor. All the filtered aotatio (i.e all aotatios collected i the right had widow of the Aotatio editor ca be deleted i oe go. To do this, right mouse click o the Aotatio editor ad select Delete Filtered Aotatios. Alteratively, select Edit Aotatios Delete Filtered Aotatios from the applicatio meu. Note, as a safeguard, cofirmatio is required after this optio is selected, however, oce deleted, aotatios caot be restored. Chagig Start ad Stop times Select the aotatio by oe of the methods show i the previous sectio. The aotatio start ad stop times appear at the top of the display. These times ca be edited. Start ad stop times ca also be adjusted by clickig ear the ed of the selected aotatio o the Wave display, holdig the <Ctrl> key dow ad draggig the cursor. Figure 2 Hold <Ctrl> key ad click (ad drag) ear selected aotatio boudary to adjust boudary Copyright Articulate Istrumets Ltd 29

30 TIP: Keep the Sap-to-aotatio feature o whe adjustig aotatio boudaries to make it easy to alig sequetial aotatios. Cocateatig aotated regios All the curretly filtered aotatios ca be cocateated together ad stored temporarily by pressig the butto. The butto chages to a butto that coveietly takes you back to where you were before the cocateatio. The data is stored i a cliet folder called cateated, files ad overwritte every time a ew cocateatio is performed. This facility assumes that all the wav files are i the same format. If a wav file cotaiig a filtered aotatio does ot match the format the a warig dialogue will be show ad the aotatio will be excluded from the cocateatio. NB. You must select a etry from the right-had Aotatio Editor widow. All subsequet wav files will be checked to see if they match the format of this selected etry. Cocateatio ca be used to calculate values calculated by selectig a regio. For example the variability of all maximum cotact EPG frames i target cosoats ca be calculated by cocateatig all such aotated frames the selectig the whole cocateated file. The variability score will be displayed uder the palate display widow as described o page Error! Bookmark ot defied. of this maual. By applyig the max threshold detectio to this same selectio the overall maximum cotact patter could be foud easily. It is sometimes the case that the cocateated audio data does ot display i the Spectrogram widow. This may be because there is ot a sufficiet dyamic rage i the audio sigal. A aotated segmet of backgroud silece icluded i the curret filter settig may resolve this. This will be improved i the ext versio of this software. EPG Aalysis The EPG Palates Display The EPG Palates display has tickmarks ruig alog the top of the display (Figure 22A). Each tickmark correspods to a EPG palate but there is oly room to display a few of the palates. The log tickmark (Figure 22C) that is coected to each displayed palate, idicates the momet i time that the palate was recorded. To see a sequece of EPG palates it is ecessary to zoom i or resize the EPG palates display. See the followig sectio o resizig displays. Reducig the height of the EPG Palates display will icrease the umber of displayed palates. Note that if there are tick marks Copyright Articulate Istrumets Ltd 30

31 betwee the palates that are displayed. The zoomig i or resizig the display will reveal them. A. Tickmarks B. Resize cursor C. Log Tickmark Figure 22 EPG Palates Display If zoomig i or reducig the size of the EPG Palates display is udesirable, there is aother way to view all the palates. Usig the right mouse butto, click i the EPG Palates widow to reveal the popup widow. The click o the Multiple Rows optio. The Multiple EPG palates display (Figure 23) will the create as may rows as ecessary to show all the palates. Tickmark idicates missig palate Multiple Rows reveals the missig palate aliged with the tickmark above Figure 23 EPG Palates Display (Multiple Rows) Resizig Displays As with ay Widows program, task widows ad dialogues withi Articulate Assistat may be resized by movig the cursor over the edge of the widow ad clickig ad draggig with the left mouse butto. Articulate Assistat also allows most displays withi a task widow to be resized. That is to say that some parts of a task widow may be made larger at the expese of others. This is mostly a matter of persoal preferece but you may wish to resize i order to: Make the cotets of the Prompt display more visible Figure 24. To show more palates (See previous sectio) To format a widow i preparatio for pritig. Click ad drag boudary dowwards to elarge. Copyright Articulate Istrumets Ltd 3

32 Figure 24 Resizig the Prompt display To resize ay display:. Move the cursor over the boudary to the left, right, top or bottom of the display you wish to resize util it chages to look like this or this. 2. Click ad drag with the left mouse butto i the directio of the arrows EPG Aalysis Values It is very useful to be able to observe how cotact patters chage with time by observig the whole palate but for objective aalysis it is useful to be able to extract a sigle value which represets the feature of chage that is of iterest. Commo values used to aalyse EPG dyamics are:. Palate Cotact Totals over The Whole Palate (All cotacts) The Alveolar regio (First two rows) The Palatal Regio (Rows 3-5) The Velar Regio (Rows 6-) 2. A Cetre of Gravity Measure (CoG) which idicates whether the cotact is at the frot of the palate or at the back. See the followig sectio for a explaatio of how these values are calculated. These values ca all be displayed i the EPG Aalysis Values display (Figure 25). Figure 25 The EPG Aalysis Values Display It is possible to select which values to display by clickig the right mouse butto i the EPG Aalysis Values display ad clickig the correspodig Copyright Articulate Istrumets Ltd 32

33 value i the popup meu. Tickmarks ca also be toggled o or off usig this meu. Click here to display the Alveolar Total Tick idicates the values that are curretly displayed Click here to hide the CoG Total Figure 26 EPG Aalysis Values Popup Meu Fidig Frames of Maximum ad Miimum Cotact It is possible to fid maxima or miima of ay EPG Aalysis Value usig the Threshold optio i the Popup meu i Figure 26. The Threshold Dialogue box show i Figure 27 allows the user to either:. Automatically aotate all regios fallig withi the chose threshold values for the chose EPG value i the across the whole file. 2. Automatically aotate all regios fallig withi the chose threshold values for the chose EPG value ad withi the selected regio. 3. Automatically aotate maximum or miimum poits fallig withi the chose threshold values for the chose EPG value 4. Automatically aotate maximum or miimum poits fallig withi the selected regio of the file. 5. Automatically aotate maximum or miimum poits fallig withi the whole utterace Or 6. Simply highlight the first istace of ay of the above rather tha aotatig. Copyright Articulate Istrumets Ltd 33

34 Figure 27 The Threshold Dialogue Box The Leged box provides a meas for labellig each aotatio. If there is more tha oe aotatio geerated by this dialogue the a umeric idex is automatically added to the ed of the leged to distiguish them. The regio(s) butto closes the dialogue box ad fids the first regio defied by the threshold value (or aotates all the regios defied by the threshold if this actio is selected. The max ad mi, Midpoit, /3 poit, 2/3 poit buttos fid the first frame of maximum value or miimum value respectively (or aotate a frame i each regio defied by threshold if this actio is selected). If the Regio is withi threshold optio is selected the oce the threshold dialogue is closed by selectig OK, the buttos o the Aalysis Values display will fid the ext or previous poit i the recordig where the threshold coditios are met. Closure detectio A ew aalysis value has bee developed which measures the coectivity betwee the right ad left sides of the palate. It is more sophisticated tha Copyright Articulate Istrumets Ltd 34

35 simply coutig the umber of cotacts i each row. It cosiders the amout of cotact ad also cosiders closures cosistig of cotacts o more tha oe row. To detect stop closures usig the closure value, set the threshold i the rage 0% -00% It will be ecessary to lower the threshold for velar stops that do t have complete closure If the Velar Closure aalysis value is used the oly closures i the last 3 rows will be cosidered. Likewise, if the Alveolar closure aalysis value is used the oly closures i the first three rows will be cosidered. To detect sibilats usig the closure value, set the threshold i the rage 40% -0% Figure 2 Alveolar ad Velar closure measures for the sequece /t/ /k/ /t/ /k/... RMS Eergy detectio A RMS Eergy measure evaluates the Root Mea Square (RMS) Eergy of the Waveform over a specified frequecy bad. It is possible to specify your ow RMS values for differet frequecy rages. See followig sectio for more details o how to do this. Copyright Articulate Istrumets Ltd 35

36 Figure 29 RMS eergy aalysis value Defiig your ow EPG aalysis values The EPG aalysis values such as Alveolar Total ad COG ca be created ad modified easily withi the program. To create a ew EPG aalysis value, first select Optios:Aalysis Values from the meu to brig up the Aalysis Values dialogue box (Figure 30). Figure 30 Aalysis Values Dialogue Defiig your ow Velar Total Let s create a ew aalysis value called My Velar Total based o the posterior 2 rows rather tha the 3 rows defied i the default Velar Total value. To do this:. Ope the aalysis values dialogue box, click ad type the chart ame e.g. My Velar Total The Copyright Articulate Istrumets Ltd 36

37 Tab at the top of the dialogue box will ow be labelled My Velar Total. 2. Ope the weights dialogue, click add ad type the weights patter ame e.g. Back 2 rows The Weights value should ow show Back 2 rows 3. Set the weights values so that the posterior 2 rows are ON (00%) ad the remaiig rows are OFF(0%) the close the Weights dialogue. 4. Igore axis settig 5. Set Graph to AreaW 6. Close aalysis values dialogue See followig sectios for a fuller explaatio of each of these stages. Now, if you Right Click o the Aalysis Values Display i the Aalysis Task Widow the value My Velar Total will appear as a optio. Click o it to make it appear i the Display. Selectig Palate Cotact Weights to form the Basis for a Aalysis Value Click o the butto i the Aalysis Values Dialogue box to get the Weights dialogue. Figure 3 The Weights dialogue For most aalyses, weights are set to be either ON or OFF ad are used to defie the area of the palate that you wish to aalyse. So for example, the default Alveolar Total display is based o the weights selectio show i Figure 3 where the cotact weights are ON (00%) for the aterior 2 rows ad OFF (0%) for the posterior 6 rows. There are four ways to chage the value of a sigle cotact weight.. Clickig o a cotact toggles the weight ON or OFF Copyright Articulate Istrumets Ltd 37

38 2. Right clickig o a cotact gives the optios of 0%, 25%, 50%, 75% or 00% 3. Clickig o a cotact ad typig a iteger value betwee 0 ad 00 i the text edit box, to the right of the palate, sets the weight to the correspodig % 4. Clickig ad draggig o a cotact slides the weight value up ad dow It is also possible to chage several cotact weights to the same value at the same time. To do this: Press the <shift> key while clickig ad draggig across a rage of cotacts the type i the value you wat these cotacts to be i the text edit box to the right of the palate. The mea Frot/Back (COG) measure The mea (aka. Cetre of Gravity, COG or cetroid) calculatio for frot/back axis is as follows m= ( m 0.5) R m= R m m where R m = cm, Wm, = = weighted sum of cotacts i Row m c, = cotact value i m th row ad th colum {0,} m W, = weight value i m th row ad th colum {0..} m Weight values are specified i % {0..00%} but are applied to the formula as fractio i the rage 0.. i steps of 0.0. Normally, weight values are specified as 0 or (i.e. 0 or 00%) Assumig the weights are set to 00% for all cotacts, this formulatio results i a maximum COG value of if oly st (aterior) row cotacts are o ad a miimum COG value of if oly the th (posterior) row. Defiig your ow COG measure You may wish to defie your ow COG based for example o oly the middle four colums of the palate. By doig this, the lateral cotacts which are o for high vowels ad cosoats are igored thus makig the COG measure more sesitive to the midsagittal cotact which is more importat i defiig cosoat articulatio. To do this: 7. Ope the aalysis values dialogue box, click add ad type the chart ame e.g. My COG. Ope the weights dialogue, click add ad type the weights patter ame e.g. Midcourse 9. Set the weights values so that the cetral four colums are ON (00%) ad the outer colums OFF(0%) the close the Weights dialogue. 0. Set axis to Frot/back. Set Graph to mea 2. Close aalysis values dialogue Copyright Articulate Istrumets Ltd 3

39 The mea Lateral measure The mea calculatio for the lateral axis is desiged to idicate whether there is more cotact close to the midlie of the palate or more cotact towards the sides ad is calculated as follows. = abs( 4.5) C 4 = C where abs is the absolute (usiged) value C = cm, Wm, m= = weighted sum of cotacts i colum c, = cotact value i m th row ad th colum {0,} m W, = weight value i m th row ad th colum {0..} m The mea Asymmetry measure This mea calculatio for the lateral axis is desiged to idicate whether there is more cotact towards oe side or the other ad is calculated as follows. = ( 0.5) C = C where C = cm, Wm, m= = weighted sum of cotacts i colum c, = cotact value i m th row ad th colum {0,} m W, = weight value i m th row ad th colum {0..} m The Stadard Deviatio (SD) measure. Stadard deviatio measuremet is applied to all mea measures ad ca be displayed as a bad aroud the mea by choosig the mea+sd graph tab i the aalysis values dialogue box. The Stadard deviatio idicates whether the EPG patter is spread across the whole palate (large SD) or cocetrated aroud the mea (small SD. It is calculated for the differet axes as follows: Frot/Back Stadard Deviatio Copyright Articulate Istrumets Ltd 39

40 Copyright Articulate Istrumets Ltd 40 = = = = 2 0.5) ( 0.5) ( m m m m m m m m R R R R m m where m m m W c R,, = = = weighted sum of cotacts i Row m = m c, cotact value i m th row ad th colum {0,} = m W, weight value i m th row ad th colum {0..} Lateral Stadard Deviatio = = = = 2 4.5) ( 4.5) ( 4 C C C C abs abs m m m W c C,, = = = weighted sum of cotacts i Colum = m c, cotact value i m th row ad th colum {0,} = m W, weight value i m th row ad th colum {0..} Asymmetric Stadard Deviatio = = = = 2 0.5) ( 0.5) ( C C C C where m m m W c C,, = = = weighted sum of cotacts i colum = m c, cotact value i m th row ad th colum {0,}

41 W, = weight value i m th row ad th colum {0..} m The Area Measure There are two measures that evaluate the cotact area. AreaW measures the total umber of cotacts as a fractio of the total weights AreaW c m, m= = = m= = W W m, m, AreaT measures the total umber of cotacts as a fractio of the whole palate (62 cotacts) AreaT c m W, m, = = = m 62 I geeral the weight values will either be ON or OFF ( or 0). Example The Area measure ca be used to calculate the total cotacts i the alveolar regio of the palate. To do this Set the weights to 00% for rows ad 2 ad to 0% for rows 3-. Select AreaW The resultig value will have a maximum of whe all the cotacts i the first two rows are ON ad a miimum of 0 whe they are all off. If AreaT had bee selected istead of AreaW the the values would have a maximum of 4/62 whe all 4 cotacts i the first two rows were ON rather tha. Notice: All of the above values are ormalised to the rage 0-. I the research literature, these values are sometimes uormalised. For comparable values use the followig multipliers. AreaT multiply by 62 Frot/back mea ad S.D. multiply by Lateral mea ad S.D. multiply by 4 Asymmetry mea ad S.D. multiply by The Ateriority Measure Ateriority,Posteriority ad Cetrality data reductio measures were prescribed by Fotdevila et al (Fotdevila,J.,Pallares, M.D. ad Recases, D., (994) The cotact idex method of electropalatographic data reductio,joural of Phoetics, 22, pp 4-54). This formulatio matches the published specificatio whe all weight values are set to oe. Ore local cotact idices ca be formulated by settig the weights for a subset of rows or colums to ad the remaider to 0. Copyright Articulate Istrumets Ltd 4

42 Ateriorit y log( m= = = log( A m= = where A = Row coefficiets = m c A m, m W W m, m, + ) + ) [357227/6,5344/,59049/,656/,729/,/,9/,/] c, = cotact value i m th row ad th colum {0,} m W, = weight value i m th row ad th colum {0..} m W 0,0 & 0, 7 W always = 0 The Posteriority Measure Posteriori ty log( log( P m m= = = m= = c m, P W m W m, m, + ) + ) P =Row coefficiets = [/6,9/,/,729/,656/,59049/,5344/, /] c, = cotact value i m th row ad th colum {0,} m W, = weight value i m th row ad th colum {0..} m W 0,0 & 0, 7 W always = 0 The Cetrality Measure Cetrality log( m= = = log( C m= = c m, C W W m, m, + ) + ) C=Colum coefficiets = [/4,7/6,29/6,493/6,493/6,29/,7/6,/4] c, = cotact value i m th row ad th colum {0,} m W, = weight value i m th row ad th colum {0..} m W 0,0 & 0, 7 W always = 0 Defiig your ow RMS eergy measure By selectig the RMS Eergy measure some differet optios appear i the Aalysis Values Dialogue (Figure 32). It provides the optio of selectig the lower ad upper limits of the audio spectrum over which the eergy will be measures. There are default presets for low pass ad high pass bads. The low pass might be used to detect voiced regios of speech ad the high pass might be used to detect uvoiced regios. There is also a optio to set the gai of the RMS value. This ca be used to scale the RMS eergy value withi the rage 0 to so that it ca be easily viewed i the aalysis chart. Copyright Articulate Istrumets Ltd 42

43 Figure 32 RMS aalysis value dialogue Future improvemets The extractio of aalysis values from EPG data will be expaded i future versios of this software. If you have ay suggestios, please get i touch. The EPG Feedback Task Widow The EPG Feedback Task Widow (Figure 33) is desiged for live feedback usig the EPG. It allows the cliet s productio i the cliic to be compared with typical productios or a previously saved best effort by the cliet. Figure 33 EPG Feedback Task Widow Copyright Articulate Istrumets Ltd 43

44 Comparig EPG Patters The Referece Palate Display (Figure 34) is used to show a palate patter (or sequece of patters) for the cliet to try to imitate. A. Palate Colour scale C. Palate Compariso gauge B. Left scroll butto D. Right scroll butto Figure 34 The Referece Palate Display Three buttos at the bottom of the display are used i the followig way: Will copy whatever patter is showig o the live EPG palate display at the istat that it is clicked. Click o this to select a patter or sequece from a library. Save the patter to the referece library. The Palate Compariso Gauge (Figure 34C) o the left of the Referece Palate Display shows how similar the live palate is to the referece palate. The left ad right scroll buttos (Figure 34B, Figure 34D) allow the user to scroll through a palate sequece if a EPG sequece rather tha a sigle EPG frame is loaded. Copyig EPG Patters to Referece Display The butto provides a easy way to trasfer a patter from the live palate display o the left of the EPG Feedback Task Widow. Durig a live feedback sessio with a cliet, click o the copy butto immediately after the cliet produces the palate patter you wat to copy. The followig copy dialogue box will pop up. Use the scrollbar to search through the last two secods of palate patters from the subject util you see the patter you wat to copy. The double-click o the desired patter to copy it to the referece palate display. Copyright Articulate Istrumets Ltd 44

45 Double-click o palate to copy Click ad drag scrollbar to search through 200 palates Loadig Referece EPG Patters The Referece Load Dialogue (Figure 35) provides three sources for referece palates Geeral Referece. A set of typical patters or sequeces of patters perhaps geerated by the user. Cliet Referece. A set of referece patters saved from previous EPG feedback sessios with the cliet. Aotatios. Ay aotatio may be loaded as a referece. See aotatio sectio for help o filterig Figure 35 The Load Referece Dialogue Savig Referece EPG Patters to Library The butto displays a dialogue which allows the curretly displayed referece patter to be saved to a library so that it ca be recalled i a future sessio. It also is possible to save the patter displayed o the Referece Palate Display by clickig the right mouse butto i the Referece Palate Display widow to reveal the popup meu the selectig the Save optio. The Save Referece Dialogue (Figure 36) allows the patter to be saved as: or a geeral Referece (available to ay cliet) the Cliet s Referece which is stored alog with all other otesad files relatig to the curret cliet ad which will oly be accessible i the future whe the curret cliet is loaded. Copyright Articulate Istrumets Ltd 45

46 The Keywords edit box allows the referece patter to be labelled. Figure 36 The Save Referece Dialogue Copyig the Referece Palate to Word It is useful to be able to prit off a referece patter for a cliet to take home ad use as a referece whe practicig with the Portable Traiig Uit. Right-click o the palate display ad select Copy to clipboard the select Curret size (or 200% if a bigger picture is eeded). The ope a word processig applicatio, presetatio software or similar ad select Paste to copy ito the documet. Figure 37 Use "Copy to clipboard..." to prit referece patter. Note that you ca either use a library referece, a copied referece patter or a had draw referece patter Comparig the Live Palate to the Referece Palate The Palate Compariso Gauge (Figure 34C) is a vertical gauge comprisig a blue bar which rises to the top of the gauge whe the live palate display ad the referece palate display match exactly. The match is based o the Copyright Articulate Istrumets Ltd 46

47 percetage of cotacts which are ON i the referece AND ON i the live palate out of the total umber of cotacts which are ON i the referece patter. Reward Display The Reward Display at the top of the Feedback Task Widow (Figure 33) shows cartoos. Just click o the butto o the left to play a cartoo. To hide this display ad make the palate displays bigger, click ad drag the divider at the bottom of the Reward Display as show i Figure 3. Figure 3 Hidig the reward display ad makig the Palates bigger The Compariso Feedback Task Widow This task widow is very similar to the EPG feedback task widow but with two extra features.. A extra referece palate (red) which ca be used to idicate to the cliet where NOT to make cotact with the palate 2. The referece palate is superimposed o the live display. I the default display (Figure 39) the referece is show as light pik which turs bright pik where the live iput cotact matches the referece ad grey where it does t. These colours ca easily be chaged to suit (see earlier sectio o chagig palate colours). Copyright Articulate Istrumets Ltd 47

48 Figure 39 Compariso Feedback Task Widow (Backig /t/ example) Exportig Data Specifyig the Export File Articulate Assistat provides the meas to export data to a tab-delimited text file, which is suitable for importig ito most spreadsheets (e.g. Excel), databases ad statistical packages. Figure 40 The Export Dialogue Box File Name The Export Dialogue Box (Figure 40) ca be ivoked usig the File:Export meu optio. The tabs at the top of the dialogue box ca be clicked o to reveal three pages of the dialogue: File. Choosig the ame of the exported text file ad its locatio. Rows. Choosig what each row of the export file cotais Copyright Articulate Istrumets Ltd 4

49 Colums Choosig what each colum of the Export file represets. The File page show i Figure 40 allows the ame ad path of the export file to be specified. The butto provides a easy way to search your computer for the folder you wish to save the exported file i. Specifyig which EPG Frames to Export Each row of the export file correspods to a EPG frame. The frames chose for export are defied usig the Rows page of the dialogue (Figure 4). The buttos at the top of the page defie the rows as follows: Cliet. All EPG frames of the curret cliet will be exported. Cliet + Prompt. All frames of all recordigs of the curret prompt will be exported. Curret. All frames of the curret prompt will be exported. Selected. All frames of the curretly selected regio of the curret file will be exported. Aotatio. This by far the most commo settig for row selectio ad it allows more detailed cotrol over the frames to be exported. Figure 4 Export Row Defiitio With the Aotatio settig, it is possible to specify which palates withi each aotated regio are exported. The Choices are: Start ad Ed Time + all EPG samples i betwee. All EPG frames i each aotated regio. Timig iformatio is accessible to the earest wav sample. Copyright Articulate Istrumets Ltd 49

50 Start Time. Oly data correspodig to the iitial istat of each aotated regio. Ed Time. Oly data correspodig to the fial istat of each aotated regio. Start ad Ed Times + N equally spaced samples i betwee. Oly the iitial ad fial istats of each aotated regio. If is set to more tha 0 the additioal poits i betwee the start ad ed poits will be exported. These poits will be evely spaced i time. I.e if set to the the midpoit will also be exported. Time determied by threshold dialogue settig. Use the butto to call up the threshold dialogue that allows you to specify a sigle time itstat withi each aotatio based o aalysis values or time. o Maximum The first istace of the maximum value of the selected Aalysis Value o Miimum The first istace of the miimum value of the selected Aalysis Value o Midpoit. The temporal midpoit of the aotated regio o Oe third The time istat oe third of the way through the aotated regio o Two thirds The toime istat two thirds of the way through the aotated regio It is possible to iclude or exclude frames aroud the aotatio boudaries. Example : You may have aotated the frame of maximum EPG cotact i every example of a /t/ segmet for a cliet. It is possible to export the 5 frames before ad 2 frames after this aotatio i order to provide cotext. Example 2: You may have aotated all /s/ segmets recorded by a cliet. Trasitios ito a out of a segmet are ofte co-articulated. It is possible to Copyright Articulate Istrumets Ltd 50

51 exclude the first 4 frames ad last 4 frames of each aotated segmet usig this settig. The Export Dialogue uses the curret Aotatio Filter settig but for coveiece the Filter butto is provided to allow the settig to be chaged withi the Export Dialogue. Note that the filter settig is ot stored i the setup file. See sectio o Aotatio for istructios o use of the Filter Dialogue. Specifyig which Data Values to Export The Colums page of the Export Dialogue (Figure 42) allows the user to specify which values are to be exported for each EPG frame. The Export Value List (Figure 42B) shows the values listed i the order that they will appear i the export file. Buttos below this widow have the followig fuctio:. Adds aother value to the list.. Deletes the curretly selected value from the list.. Moves the curretly selected value to the bottom of the list. A. Curretly selected value. B. Export Value List. C. Memo box with scroll bar Figure 42 Export Colum Defiitio The buttos Cliet, Time, Prompt, Aotatio, Palate, Aalysis ad Audio Data o the righthad side of the Colums page chage the curretly selected value whe clicked o. The buttos fuctio is explaied i the memo box (Figure 42C) i the bottom righthad side of the Colums page. Note that it may be ecessary to use the scroll bar to see the whole descriptio. The optios are: Cliet Surame Surame,Give ames Surame,Iitials Referece umber Time Copyright Articulate Istrumets Ltd 5

52 Prompt Offset ito file to earest EPG frame writes time i secods of the aotatio poit/frame to earest EPG frame. Offset ito file to earest wav sample writes time i secods of the aotatio poit/frame to earest wave sample. Date/Time of recordig writes date/time of whole recordig Duratio writes the duratio i secods of the aotated regio/selected regio to the earest wav sample. Writes the word or phrase spoke Aotatio All keywords writes all keywords for the aotatio if selected First Keyword writes oly the first keyword (Label) for the aotatio if selected Threshold Ifo writes the details of which aalysis value ad what criterio was used to select the time istat from the aotatio Palate Palate values writes a or 0 i 62 colums each represetig a palate cotact. The cotact order is left to right from frot to back of the palate. Fileame writes full path ad fileame of EPG file Palate frame umber i file writes the EPG palate umber idexed from the start of the file Palate frame offset... records the EPG frame idex relative to the first frame i a aotated or selected regio. I the case where the rows page specifies that the last frame should be exported the the offset is relative to the last frame Offset is from First/last records whether the offset is relative to the first or last frame Copyright Articulate Istrumets Ltd 52

53 Figure 43 Aalysis value export Aalysis Writes mea, SD, areaw or areat calculated usig the weights ad axis specified by the selected chart. NOTE: I the case where the chart specifies Mea+SD the stadard deviatio is exported ad where the chart specifies mea+area the mea is exported. (See Aalysis Values Sectio for more details o settig these values). Calculate value for each row writes the aalysis value for the selected time istat (row) Mea value (all frames i aot) writes the average (mea) calculated over all the EPG frames i the aotatio Mea value (selected frames) writes the average (mea) calculated over all the selected frames i the aotatio Variability EPG variability of all cotacts EPG variability of active cotacts Calculated over aotatio regio Calculates variability over the whole aotatio regio regardless of how may rows are exported Calculated over exported rows withi aotatio Calculates variability over the aotatio regio but oly usig the frames (rows) selected for export. Audio data Fileame writes full path ad fileame of wav file File Creatio Date/Time Chaels Copyright Articulate Istrumets Ltd 53

54 Bytes per sample Sample Rate File offset i samples Legth of EPG frame i samples Savig ad Retrievig Your Export Cofiguratio Setup Cofiguratio of the export file ca be quite elaborate but oce it has bee determied the cofiguratio ca be saved i a *.xsu file usig the Export Setup withi the Export Dialogue Box. Both Save ad Save As buttos will brig up a dialogue which allows the ame ad locatio of the cofiguratio setup file to be selected. Thereafter, the Save butto will save ay subsequet chages to this file. The Save As butto will always brig up the dialogue to choose a ame ad locatio. This makes it easy to make mior chages to a cofiguratio ad save as a alterative setup. The Ope butto allows previously saved cofiguratios to be loaded. Figure 44 Export view dialogue Viewig Exported Data O Clickig the butto there is a optio to view the exported data. The Export view widow has two parts. The left widow shows the exported data values i a grid. Movig the mouse over a cell i the grid shows the etire cotets of the cell. The righthad Copyright Articulate Istrumets Ltd 54

55 widow shows a variability display geerated from palates i all of the exported rows. NOTE: I the case where rows are exported based o iitial ad fial time poits of a aotatio (+ N time poits i betwee), the variability is calculated o the basis of EVERY EPG frame i the aotatio. This limitatio may be resolved i later versios of this software. The EPG variability graphic ca be copied to the clipboard ad pasted ito a documet. Exportig Movies It is possible to export avi movies of regios of EPG/audio data usig the File ExportMovie meu optio. This is useful for icludig i presetatios. Figure 45 Movie Export Dialogue The movie ca be exported at 4 speeds. Real time X2 half speed X4 quarter speed to see the patter chagig slowly X quarter speed to see the patter chagig very slowly Note that the audio is slowed dow also makig it difficult to iterpret. It is probably ot useful to play the audio at half or quarter speed. If the Show Waveform checkbox is ticked the a waveform is icluded i the movie with a movig cursor that idicates the positio i the waveform. A spectrogram will also be displayed BUT ONLY IF A SPECTROGRAM IS VISIBLE IN THE TASK WINDOW. I.e. If Export Movie is called whe the Record Task Widow is visible the o spectrogram will be displayed i the movie. If it is called whe the Aalyse Task Widow is visible the a Spectrogram will be displayed i the movie. Copyright Articulate Istrumets Ltd 55

56 Figure 46 Example Exported Movie "The Dolls" Backup It is always advisable to make a backup of valuable data. Articulate Assistat makes it easy to backup data to a etworked computer or rewritable medi such as a Zip drive (00, 200 or 750MB). The backup optio is available o the meu bar File:Backup ad is desiged to remember the date that you last completed a backup ad show all the files created by Articuate Assistat sice that date. Figure 47 shows the Backup dialogue box. Figure 47 Backup Dialogue The butto i the top righthad corer brigs up a dialogue box (Figure 4) which allows you to select ay drive or folder available from your computer icludig etworked drives. The subdirectory dialogue does ot create a folder. You must choose a existig folder ad click o the OK butto. Copyright Articulate Istrumets Ltd 56

57 Folder i which the cliet folders will be Figure 4 SubDirectory Dialogue The Backup dialogue allows you to backup files from ay date ad time till the preset. The default time is the time of the last backup. Tabs at the top of the dialogue allow the selectio of all cliet data or just the curret cliet. Tickboxes dow the lefthad side allow idividual files to be icluded ( ) or excluded ( ) from the backup. The butto sets all the files. The butto sets all files. Click the butto to copy all the selected data to cliet folders i the chose subdirectory. TIP: The Backup dialogue is good for icremetal backups. If you wat to save all the recordigs from the curret cliet or all cliets set the backup year to Alteratively you ca use Microsoft Widows Explorer to copy the cliet folder(s). Copyig Displays (Pritig) It is possible to prit ay display i Articulate Assistat by copyig the widow to a graphics program such as Pait or word processor such as Word for Widows. Copyig to Word for Widows To copy a display: Copyright Articulate Istrumets Ltd 57

58 . Click the right mouse butto o the captio bar at the top of the widow 2. Click o the Copy optio i the popup meu The ope Word for Widows ad click o the Edit:Paste Special meu optio ad click o the OK butto i the Paste Special dialogue box. A complete Task Widow set ca be copied usig the Edit:Copy meu optio Specifyig Copy Colour The Widow will be copied i Grey scale. It is also possible to copy the widow i Black ad White or Full Colour. To chage the colour, use the Optios:Color:Copy meu ad select your choice of colour optio. The Copy Task The Copy Task comprises two widows.. A mai widow with meu, task buttos ad prompt list 2. A secod widow with waveform/aotatio, spectrogram, palates ad EPG values which is ideal for copyig to Word for Widows. The result of copyig the tutorial data to Word is show i Figure 49. Figure 49 The Copy Task Widow pasted directly ito this maual Other cofiguratios of displays ca be desiged if eeded. See the sectio o Desigig ew Task Widows. Copyright Articulate Istrumets Ltd 5

59 Pritig Palates It is easy to prit a sequece of umbered palates (left to right o the page) alog with details about the palate sequece. This may typically be used i the cliic to keep a paper record of patiet progress. To prit palates, select the File:Prit Palates meu optio ad the dialogue box show i Figure 50. Note that this meu optio is disabled util a specific file has bee selected. The dialogue allows the user to adjust how may palates ca be fitted oto a page by varyig the umber of Palates across page. The user ca choose to add iformatio to the top of the prited page. Checkboxes are provided to select iformatio already held i the computer. Additioal free text ca be added. For example, the specific segmet, word or phrase beig spoke ca be oted alog with commet o the particular feature of iterest. See Figure 50 for a example. A prit preview scree (Figure 50A) shows a outlie of the st page layout before it is prited. The dialogue also states approximately the umber of pages required for the pritout. The Prit Palates optio should work with the default priter istalled o the users PC. Note: Some HP laser priters with limited memory ca be very slow (20 mis) at spoolig ad pritig a page of palates. Ikjet priters are much faster (about 30secs per page). The dialogue allows the palate umbers ad/or curretly selected aotatios to be prited above each row of palates. Checkboxes ca be clicked to select ad deselect these optios. It is also possible to show extra palates before ad after the selected regio. This is useful, for example, if a aotated speech segmet is to be prited but some surroudig cotext is desired o the pritout. Note, if the whole utterace is selected the before ad after optios are disabled. Copyright Articulate Istrumets Ltd 59

60 A. Prit Preview Scree Figure 50 Prit Palates Dialogue Copyig Palates It is easy to copy a sequece of umbered palates (left to right o the page).this may typically be used to produce cliical reports or research papers. To copy palates, select the Edit:Copy Palates meu optio ad the dialogue box show i Figure 5. Note that this meu optio is disabled util a specific file has bee selected. The dialogue allows the user to adjust how may palates ca be fitted oto a page by varyig the umber of Palates across page. A copy preview scree (Figure 5A) shows a outlie of the st page layout before it is copied. Oly the palates fittig o this page will be copied. The Copy Palates optio should work with ay Widows applicatio that ca paste a bitmap from the clipboard such as Word. The resolutio of the bitmap ca be set to low medium or high or specified usig custom ad settig the width edit boxes. The height edit box value will be automatically set to the optimum size to fit the palates displayed i the preview box but this ca be overridde. The greater the size i pixels, the better the resolutio but the more memory the bitmap will eed. Note that if the size is set too low to be able to represet the umber of palates o the page the copy palates may ot provide a sesible picture. Copyright Articulate Istrumets Ltd 60

61 A. Prit Preview Scree Figure 5 Copy Palates Dialogue As with the Prit palates display, it is possible to iclude palate umber or aotatios above the palate sequece. The aotatios are selected usig the filter optio i the aotatio widow. Desigig Task Widows Eterig ad Exitig Desig Mode I order to eter desig mode the user must click o the captio bar (Figure A) of Articulate Assistat with the right mouse butto. The select the Desig optio i the popup meu. Note: If there is more tha oe widow with a captio bar (e.g. The Copy Task Widow) the oly the Captio bar with Articulate Assistat writte i it has the Desig optio The Desig Dialogue list will the appear (Figure 52). Figure 52 Desig Dialogue To exit desig mode without savig ay chages simply close the Desig Dialogue by clickig o the. Copyright Articulate Istrumets Ltd 6

62 Savig Desig Chages Savig chages must be doe before exitig desig mode. To save chages made i desig mode, click the right mouse butto i the Task Bar (Figure B) to reveal the popup meu ad click o Save <Task ame> ( Save Copy i this example). Charts, Paels, Bars ad Displays Task widows are made up of modules that dock together ad ca be resized ad positioed to create a esemble suited to a particular task. Modules fall ito 4 categories as follows: Charts. Ay module which has a display with a time axis. Paels. Modules that do ot fall ito the other 3 categories Bars. Modules that caot be resized i ormal operatio Displays Ay module with a graphical display, which does t have a time axis Articulate Assistat V.0 supports the followig modules: Charts Aalysis Values. EPG aalysis values Palates. * Wave. * Spectrogram * Paels Bars Displays Prompts. * Prompt list box Aotatios. * Aotatio Editor Prompt. * Status. Meu. Meu, Task Bar ad buttos Palate Referece ad live palate display Aalysis Values Key to Aalysis Values Chart ad umerical readout Modules marked with a * are limited to oe istace per Task Widow. To create a ew module, simply select it from the meu i the Desig Dialogue. Copyright Articulate Istrumets Ltd 62

63 Figure 53 Meu/Task/Butto Bar popup meu The Meu Bar ca be cofigured further by right clickig i it to brig up the popup dialogue (Figure 53). The top three optios i this popup meu cotrol the visibility of Meu, Task Setup Buttos ad Buttos. There is a submeu allowig each of the buttos to be eabled or disabled. The Palate Display also has a popup dialogue to cotrol the visibility of elemets of the display. The elemets cosist of: Key. Colour scale Score. Variability Idex Cumulative. Cumulative cotact check box Compariso. Palate compariso gauge It is also possible to specify whether the Palate Display is a Referece Palate Display. Note: Oly oe Referece Palate Display permitted per Task Widow. Repositioig a module i a Task Widow To rearrage the modules i a Task Widow, click ad drag the i the top left corer of the widow (or the at the left edge i the case of Bar type modules). Figure 54 Rearragig Modules i Desig Mode Copyright Articulate Istrumets Ltd 63