How to.. What is the point of it?

Size: px

Start display at page:

Download "How to.. What is the point of it?"

Annabel Briggs
5 years ago
Views:

1 Program's name: Linguistic Toolbox 3.0 α-version Short name: LIT Authors: ViatcheslavYatsko, Mikhail Starikov Platform: Windows System requirements: 1 GB free disk space, 512 RAM,.Net Farmework Supported languages: English Supported formats:.txt Distribution: freeware, GPL Web site: E- mail: iatsko@gmail.com vetsky@yandex.ru What is the point of it? Linguistic Toolbox is a concordance that differs from existing analogues in the following respects. 1. It has an integrated part-of-speech tagger thus allowing the user to create his/her own annotated corpora. Profound linguistic research is often based on a specific text genre (e.g. fiction, scientific text) linguistic category (e.g. possession), or works of a particular author (e.g. Maugham). Publicly available annotated national corpora with evenly distributed genres often fail to meet the demands of such research and LIT has been designed to fill this gap. By means of LIT the user can conduct various searches on his/her own corpora and get statistical information on distribution of various words, patterns, and phrases. 2. LIT has an integrated WordNet module by means of which the user can search not only for a given word but also for words semantically related to it. How to.. How to open LIT LIT doesn't require any installation procedures. Open the folder with LIT you downloaded from the Internet, find and double click LToolboxGui.exe. The program will start. Note that you must have.net Framework installed on your computer. How to upload texts To upload a text just click Add text button and using the Windows Explorer choose a file in a directory on your computer. LIT supports only files with a.txt extension; it won't process other formats, for example.doc files. If you have texts in this format you will have first to save them as plain text. If you have texts in some other text format, e.g..pdf you will have to convert them using existing converters. While the file is being added you will see the progress bar indicating three basic preprocessing procedures tokenization, splitting, and POS-tagging. Since our tagger functions much faster that existing analogues the preprocessing won't take much time even if a large file is uploaded. As soon as the file has been added its name appears in directory of texts and you can obtain from it what you want.

Using the delete button you can safely remove files from the directory. How to run queries Before running a query you should either select a text or open it.

name itself this will manifest you intention to rename the text.

2 Using the delete button you can safely remove files from the directory. How to run queries Before running a query you should either select a text or open it. You may have several texts in the directory, so before running a query just click on one of the texts to select it, you should click a little bit to the left of text's name, don't click on the text's name itself this will manifest you intention to rename the text. A double click will open the text and statistical information about it that may be useful for its analysis, such as number of paragraphs, sentences, total tokens (i.e. total words), total words (i.e. unique words), average sentence length, average paragraph length. To get from LIT what you want you must press the Text query button to open the query box where you can type your queries. The query syntax is similar with that one in Mark Davies' BNC interface. The query, that opens by default, i s *\*, if you press Enter key on your computer's keyboard this query will yield a list of all tokens in the text with pos-tags assigned to each token. Uncheck the Show tags menu option and repeat the query pressing on the Enter key again, and the pos-tags disappear.

The *en query will result in finding all words that have such an ending (suffix search), lighten, heighten, brighten, etc.

3 Let us discuss the query syntax in detail. * - stands for any word or any symbol. E.g. the query syntax bill* stands for any word that opens with these symbols (prefix search); it will find bill, bills, billed, etc. The *en query will result in finding all words that have such an ending (suffix search), lighten, heighten, brighten, etc. if you separate the asterisk from word with a white space it will acquire the meaning any word. * * * Bill * * * will find all phrases in which Bill is preceded and followed by any three words. Be careful with the white spaces, the program will not work if you type an extra one. \ - stands for any pos-tag. You may find words with specific tags. For example \nnp query finds all proper nouns, \n* will find all words whose pos-tags open with n. Since many English nouns have homonymic verb forms using this syntax you can find the words that belongs to a specific part of speech, e.g. place\n* finds place used as a noun- form while place\v* finds verb-forms. Pos-tags search can be combined with word-search. The query * * * Bill \v* * * will find all phrases where Bill is preceded by any three words and followed by a verb- form and any other two words. # - highlights the keyword and positions it in the center of concordance. This symbol (we call it an anchor) may be useful in case of complex queries, try this one (*)* Bill (*)* and

This is a specific feature of the current version of LIT: it provides context only within sentences boundaries. We are not sure if a broader context is needed, tell us about it!

4 this one (*)* # Bill (*)* You will see that in the first case Bill is scattered all over the text while in the latter it is positioned in the center. By the way (*)* query stands for any word repeated any times and when run separately will yield a list of all sentences in the text. I.e. (*)* Bill (*)* will find all the sentences with the word Bill and Bill (*)* finds phrases with Bill followed by any number of words till the end of the sentences where it occurs. This is a specific feature of the current version of LIT: it provides context only within sentences boundaries. We are not sure if a broader context is needed, tell us about it! opt(c) makes the search case-sensitive. By default it's case- insensitive, i.e. in response to Bill the system will also find bill and vice versa. opt(c) Bill finds cases where Bill is in the upper register and opt(c) bill finds those ones with bill in the lower register. syns(word) - finds the word and its synonyms. E.g. syns(place) query will yield all cases with place and its synonyms. We haven't integrated the hypernyms or hyponyms opportunities yet but we can do it on your request; tell us about it! ^ - indicates the position of the keyword at he beginning of the sentence. ^ bill (*)* results in the list of all sentences that open with bill

You can try other search possibilities combining various tags and syntax symbols. The lists of syntax symbols and pos-tags are available in the Help directory that comes with LIT.

given word. If you run * * * Bill * * * query you will get three collocates to the left and right of Bill. We use as a sample text 'The Ransom of Red Chief' available in the 'Tutorial' folder.

5 You can try other search possibilities combining various tags and syntax symbols. The lists of syntax symbols and pos-tags are available in the Help directory that comes with LIT. How to get collocates To get collocates for a specific word you may use asterisks separated with white spaces, their number being equal to the number of collocates to the left or to the right of the given word. If you run * * * Bill * * * query you will get three collocates to the left and right of Bill. We use as a sample text 'The Ransom of Red Chief' available in the 'Tutorial' folder. By clicking Collocates button on the panel bar you can open a window with statistic information about collocates. For our sample text you can see that the most frequent collocate on the first position to the left of Bill is says while that one to the right is 's.

6 You can do sorting by clicking on the Count and Item fields. You can select collocates by clicking on the utmost right empty field of the table and copy the table with 'Control + C' so as to paste it into some external editor for further processing. Using the slider you can change the position of collocates. If you check 'Tags' box you can get pos tags rather than specific words as collocates.

8 It should be noted that you can upload and select several texts to run queries on all of them. For example you can first get information about some patterns and distributions in the texts of and then in academic texts to perform contrastive analysis. The screenshot below illustrates distribution of collocates for said in three texts.

Since we constantly work at improving our products these instructions can be outdated. Visit our Web-page http://vetsky.narod.

9 Since we constantly work at improving our products these instructions can be outdated. Visit our Web-page to get updated user instructions or updated versions of LIT. Feel free to contact us if you have questions or comments.

A Short Introduction to CATMA

A Short Introduction to CATMA Outline: I. Getting Started II. Analyzing Texts - Search Queries in CATMA III. Annotating Texts (collaboratively) with CATMA IV. Further Search Queries: Analyze Your Annotations