Information Retrieval and Extraction

Transcription

1 Information Retrieval and Extraction Berlin Chen (Picture from the TREC web site)

2 Textbooks Textbook and References R. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. Addison Wesley Longman, 1999 Christopher D. Manning, Prabhakar Raghavan and Hinrich Schütze, Introduction to Information Retrieval, Cambridge University Press, 2008 W. Bruce Croft, Donald Metzler, and Trevor Strohman, Search Engines: Information Retrieval in Practice, Addison Wesley, 2009 References D. A. Grossman, O. Frieder, Information Retrieval: Algorithms and Heuristics, Springer W. B. Croft and J. Lafferty (Editors). Language Modeling for Information Retrieval. Kluwer-Academic Publishers, July 2003 I. H. Witten, A. Moffat, and T. C. Bell. Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann Publishing, 1999 C. Manning and H. Schutze. Foundations of Statistical Natural Language Processing. MIT Press, 1999 C.X. Zhai, Statistical Language Models for Information Retrieval (Synthesis Lectures Series on Human Language g Technologies), Morgan g & Claypool Publishers, 2008 IR Berlin Chen 2

3 Information Hierarchy Motivation (1/2) Data The raw material of information Information Wisdom Data organized and presented by someone Knowledge Knowledge Information read, heard or seen and Information understood d Data Wisdom Distilled and integrated knowledge and understanding Search and communication (of information) are by far the most popular uses of the computer IR Berlin Chen 3

4 Motivation (2/2) User information need Find all docs containing information on college tennis teams which: (1) are maintained by a USA university and (2) participate in the NCAA tournament (3) National ranking in last three years and contact information Query Emphasis is on the retrieval of information (not data) Search engine/ir system IR Berlin Chen 4

5 Information Retrieval Information retrieval (IR) is the field concerned with the structure, analysis, or organization, searching and retrieval of information Defined by Gerard Salton, a pioneer and leading figure in IR Focus is on the user information need Information about a subject or topic Semantics is frequently loose Small errors are tolerated Handle natural language text (or free text) which is not always well structured and could be semantically ambiguous IR Berlin Chen 5

6 Data Retrieval Determine which document of a collection contain the keywords in the user query Such documents are regarded as database records, such as a bank account record or a flight reservation, consisting of structural elements such as fields or attributes (e.g., account number and current balance) Retrieve all objects (attributes) which satisfy clearly defined conditions in a regular expression or a relational algebra expression Which documents contain a set of keywords (attributes) in some specific fields? Well defined semantics & structures A single erroneous object implies failure! IR Berlin Chen 6

7 IR system Interpret contents of information items (documents) Most of the information in such documents is in the form of text which relatively unstructured Generate a ranking (i.e., a ranked list of documents) which reflects relevance Notion of relevance is most important Relevance judgment (using click-through data?) The other important issues The vocabulary mismatch problem Evaluation of retrieval performance IR Berlin Chen 7

8 IR at the Center of the Stage IR in the last 20 years: Modelng, classification, clustering, filtering User interfaces and visualization Systems and languages WWW environment (90~) Universal repository of knowledge and culture Without frontiers: free universal access Lack of well-defined data model IR Berlin Chen 8

9 IR Main Issues The effective retrieval of relevant information affected by The user task Logical view of the documents IR Berlin Chen 9

10 The User Task Translate the information need into a query in the language provided d by the system A set of words conveying the semantics of the information need Browse the retrieved documents Retrieval F1 racing 1. Doc i 2. Doc j 3. Doc Directions to k Le Mans Tourism in France Browsing Information Records IR Berlin Chen 10

11 Logical View of the Documents (1/2) A full text view (representation) Represent document by its whole set of words Complete but higher computational cost A set of index terms by a human subject Derived automatically or generated by a specialist Concise but may poor An intermediate representation with feasible text operations IR Berlin Chen 11

12 Logical View of the Documents (2/2) Text operations Elimination of stop-words (e.g. articles, connectives, ) The use of stemming (e.g. tense, ) The identification of noun groups Compression. Text structure (chapters, sections, ) Docs accents, spacing, etc. stopwords Noun groups stemming Manual indexing text + structure structure text structure Full text Index terms IR Berlin Chen 12

13 Different Views of the IR Problem Computer-centered (commercial perspective) p Efficient indexing approaches High-performance matching ranking algorithms Human-centered (academic perceptive) Studies of user behaviors Library science Understanding of user needs psychology. IR Berlin Chen 13

14 IR for Web and Digital Libraries Questions should be addressed Still difficult to retrieve information relevant to user needs Quick response is becoming more and more a pressing factor (Precision i i vs. Recall) The user interaction with the system (HCI, Human Computer Interaction) Other concerns Security and privacy Copyright and patent IR Berlin Chen 14

15 The Retrieval Process (1/2) user need User Interface 4, 10 Text Text user feedback query Query Operations logical view Text Operations logical view Indexing 5 8 inverted file 6, 7 DB Manager Module retrieved docs Searching Ranking ranked docs 2 8 Index Text Database IR Berlin Chen 15

16 The Retrieval Process (2/2) In current retrieval systems Users almost never declare his information need Only a short queries composed few words (typically fewer than 4 words) Users have no knowledge of the text or query operations Poor formulated queries lead to poor retrieval! IR Berlin Chen 16

17 Four Main Topics Major Topics (1/2) IR Berlin Chen 17

18 Major Topics (2/2) Text IR Retrieval models, evaluation methods, indexing Human-Computer Interaction ti (HCI) Improved user interfaces and better data visualization tools Multimedia IR Text, speech, audio and video contents Multidisciplinary approaches Can multimedia be treated in a unified manner? Applications Web, bibliographic systems, digital it libraries i IR Berlin Chen 18

19 Textbook Topics IR Berlin Chen 19

20 Some Directions of Information Retrieval Example of Content Example of Applications Examples of Tasks Text Web search Ad hoc search Images Vertical search Filtering Video Enterprise search Classification Scanned documents Desktop search Question answering Audio (Speech) Music Peer-to-peer search In the past, most technology for searching non-text document relies on the descriptions of their content rather than the contents themselves The need of content-based image/audio/music retrieval! Peer-to-peer search involves finding information in networks of nodes or computers without any centralized control IR Berlin Chen 20

21 IR and Search Engines Information Retrieval Relevance -Effective ranking Evaluation -Testing and measuring Information needs -User interaction Search hengines Performance -Efficient search and indexing Incorporating new data -Coverage and freshness Scalability -Growing with data and users Adaptability -Tuning for applications Specific problems -e.g. Spam IR Berlin Chen 21

22 Text Information Retrieval (1/4) Internet searching engine Web Spider Mirrored Web Page Indexer Repository Queries Ranked Docs Search Engine IR Berlin Chen 22

23 Text Information Retrieval (2/4) g IR Berlin Chen 23

24 Text Information Retrieval (3/4) (Service is No Longer Available) IR Berlin Chen 24

25 Text Information Retrieval (4/4) IR Berlin Chen 25

26 Speech Information Retrieval (1/4) speech information Text-to- Speech Synthesis Spoken Dialogue text information Information Retrieval Internet Public Services/ Information/ Knowledge Private Services/ Databases/ Applications text, image, video, speech, speech query (SQ) spoken documents (SD) SD 3 SD 2 SD 1 text query (TQ) 我想找有關 中美軍機擦撞 " 的新聞? text documents (TD) TD 3 TD 2 TD 1. 國務卿鮑威爾今天說明美國偵察機和中共戰鬥機擦撞所引發的外交危機. IR Berlin Chen 26

27 Speech Information Retrieval (2/4) HP Research Group Speechbot System (Service is No Longer Available) Broadcast news speech recognition, Information retrieval, and topic segmentation (SIGIR2001) Currently indexes 14,791 hours of content (2004/09/22, IR Berlin Chen 27

28 Speech Information Retrieval (3/4) Speech Summarization and Retrieval IR Berlin Chen 28

29 Speech Information Retrieval (4/4) Speech Organization L.-S. Lee and B. Chen, Spoken Document Understanding and Organization, IEEE Signal Processing Magazine 22(5), pp , Sept IR Berlin Chen 29

30 Visual Information Retrieval (1/4) Content-based approach IR Berlin Chen 30

31 Visual Information Retrieval (2/4) Images with Texts (Metadata) IR Berlin Chen 31

32 Visual Information Retrieval (3/4) Content-based Image Retrieval IR Berlin Chen 32

33 Visual Information Retrieval (4/4) Video Analysis and Content Extraction IR Berlin Chen 33

34 i i j T k j Scenario for Multimedia information access P ( d ) d 1 d 2.. d i.. d N T t 1 1 T 2 t 2.. P ( T k d ) P ( t ) T k t j.. T K t n documents latent topics query Q Q = t 1 t 2.. t j.. t n Information Extraction and Retrieval (IE & IR) Users Multimodal Dialogues Multimedia Document Understanding and Organization Networks Multimedia Network Content Multimodal Interaction Multimedia Content Processing IR Berlin Chen 34

35 Other IR-Related Tasks Information filtering and routing Term/Document categorization Term/Document clustering Document summarization Information extraction Question answering What is the height of Mt. Everest? Crosslingual information retrieval.. IR Berlin Chen 35

36 Audience Document Summarization Generic summarization User-focused summarization Query-focused summarization Topic-focused summarization Function Indicative summarization Informative summarization Extracts vs. abstracts Extract: consists wholly of portions from the source Abstract: contains material which is not present in the source Output modality Speech-to-text summarization Speech-to-speech summarization Single vs. multiple documents IR Berlin Chen 36

37 Information Extraction E.g., Named-Entity Extraction NE has it origin from the Message Understanding Conferences (MUC) sponsored by U.S. DARPA program Began in the 1990 s Aimed at extraction of information from text documents Extended to many other languages and spoken documents (mainly broadcast news) Common approaches to NE Rule-based approach Model-based approach Combined approach Sentence S = t1t 2.. t.. j t n Person Location Organization General Language IR Berlin Chen 37

38 Cross-lingual Information Retrieval E.g., Automatic Term Translation Discovering translations of unknown query terms in different languages E.g., The Live Query Term Translation System (LiveTrans) developed at Academia Sinica/by Dr. Chien Lee-Feng Machine- Extracted Translations IR Berlin Chen 38

39 Multidisciplinary Approaches Natural Language Processing Multimedia Processing Networking IR Machine Learning Artificial Intelligence IR Berlin Chen 39

40 Resources Corpora (Speech/Language resources) Refer speech waveforms, machine-readable text, dictionaries, thesauri as well as tools for processing them LDC - Linguistic Data Consortium IR Berlin Chen 40

41 Contests (1/2) Text REtrieval Conference (TREC) IR Berlin Chen 41

42 Contests (2/2) US National Institute of Standards and Technology IR Berlin Chen 42

43 Conferences/Journals Conferences ACM Annual International Conference on Research and Development in Information Retrieval (SIGIR ) ACM Conference on Information Knowledge Management (CIKM) Journals ACM Transactions on Information Systems (TOIS) ACM Transactions on Asian Language Information Processing (TALIP) Information Processing and Management (IP&M) Journal of the American Society for Information Science (JASIS) IR Berlin Chen 43

44 Tentative Topic List IR Berlin Chen 44

45 Grading (Tentative) Midterm (or Final): 20% Homework/Projects: 50% Presentation: 20% Attendance/Other: 10% TA: 張鈺玫同學 Tel: ext 208 ( 資工系 208 室 ) IR Berlin Chen 45