Modern Information Retrieval

Transcription

1 Modern Information Retrieval Ricardo Baeza-Yates Berthier Ribeiro-Neto ACM Press NewYork Harlow, England London New York Boston. San Francisco. Toronto. Sydney Singapore Hong Kong Tokyo Seoul Taipei. New Delhi Cape Town Madrid Mexico City. Amsterdam Munkh» Paris. Milan

2 Contents Preface Acknowledgements Biographies v vii xvii 1 Introduction Motivation Information versus Data Retrieval Information Retrieval at the Center of the Stage Foeus of the Book Basie Coneepts The User Task Logieal View of the Doeuments Past, Present, and Future Early Developments Information Retrieval in the Library The Web and Digital Libraries Praetieal Issues The Retrieval Proeess Organization of the Book Book Topies Book Chapters How to Use this Book Teaehing Suggestions The Book's Web Page Bibliographie Diseussion 17 2 Modeling Introduetion A Taxonomy of Information Retrieval Models Retrieval: Ad hoe and Filtering ix

3 x 2.4 A Formal Characterization of IR Models 2.5 Classic Information Retrieval Basic Concepts Boolean Model " Vector Model Probabilistic Model Brief Comparison of Classic Models 2.6 Alternative Set Theoretic Models Fuzzy Set Model Extended Boolean Model. 2.7 Alternative Algebraic Models Generalized Vector Space Model Latent Semantic Indexing Model Neural Network Model Alternative Probabilistic Models Bayesian Networks Inference Network Model Belief Network Model Comparison of Bayesian Network Models Computational Costs of Bayesian Networks The Impact of Bayesian Network Models 2.9 Structured Text Retrieval Models Model Based on Non-Overlapping Lists Model Based on Proximal Nodes 2.10 Models for Browsing Flat Browsing Structure Guided Browsing The Hypertext Model Trends and Research Issues Bibliographie Discussion Retrieval Evaluation 3.1 Introduction Retrieval Performance Evaluation Recall and Precision Alternative Measures. 3.3 Reference Collections The TREC Collection The CACM and ISI Collections The Cystic Fibrosis Collection. 3.4 Trends and Research Issues. 3.5 Bibliographie Discussion 4 Query Languages 4.1 Introduction Keyword-Based Querying

4 4.2.1 Single-Ward Queries Context Queries Boolean Queries Natural Language. 4.3 Pattern Matehing Struetural Queries Fixed Strueture Hypertext Hierarehieal Strueture 4.5 Query Protoeols Trends and Research Issues. 4.7 Bibliographie Diseussion xi Query Operations Introduetion User Relevanee Feedback Query Expansion and Term Reweighting for the Vector Model Term Reweighting for the Probabilistie Model A Variant of Probabilistie Term Reweighting Evaluation of Relevanee Feedback Strategies Automatie Loeal Analysis Query Expansion Through Loeal Clustering Query Expansion Through Loeal Context Analysis Automatie Global Analysis Query Expansion based on a Similarity Thesaurus Query Expansion based on a Statistieal Thesaurus Trends and Research Issues Bibliographie Diseussion Text and Multimedia Languages and Properties Introduetion Metadata Text Formats Information Theory Modeling Natural Language Similarity Models Markup Languages SGML HTML XML Multimedia Formats Textual Images Graphies and Virtual Reality 159

5 XII HyTime. 6.6 Trends and Research Issues. 6.7 Bibliographie Discussion 7 Text Operations 7.1 Introduction. 7.2 Document Preprocessing Lexical Analysis of the Text Elimination of Stopwords Stemming Index Terms Selection Thesauri Document Clustering 7.4 Text Compression Motivation Basic Concepts Statistical Methods Dictionary Methods Inverted File Compression 7.5 Comparing Text Compression Techniques. 7.6 Trends and Research Issues. 7.7 Bibliographie Discussion 8 Indexing and Searching 8.1 Introduction. 8.2 Inverted Files Searching Construction. 8.3 Other Indices for Text Suffix Trees and Suffix Arrays Signature Files 8.4 Boolean Queries Sequential Searching Brute Force Knuth-Morris-Pratt : Boyer-Moore Family Shift-Or Suffix Automaton Practical Comparison Phrases and Proximity 8.6 Pattern Matehing String Matehing Allowing Errors Regular Expressions and Extended Patterns Pattern Matehing Using Indices 8.7 Structural Queries. 8.8 Compression

6 XIIl Sequential Searching Compressed Indices. Trends and Research Issues. Bibliographie Discussion Parallel and Distributed IR Introduction Parallel Computing Performance Measures Parallel IR Introduction MIMD Architectures SIMD Architectures Distributed IR Introduction Collection Partitioning Source Selection Query Processing Web Issues Trends and Research Issues Bibliographie Discussion User Interfaces and Visualization Introduction Human-Computer Interaction Design Principles The Role of Visualization Evaluating Interactive Systems The Information Access Process Models of Interaction Non-Search Parts of the Information Access Process Earlier Interface Studies Starting Points Lists of Collections Overviews Examples, Dialogs, and Wizards Automated Source Selection Query Specification Boolean Queries From Command Lines to Forms and Menus Faceted Queries Graphieal Approaches to Query Specification Phrases and Proximity Natural Language and Free Text Queries Context Document Surrogates

7 xiv Query Term Hits Within Document Content Query Term Hits Between Documents SuperBook: Context via Table of Contents Categories for Results Set Context Using Hyperlinks to Organize Retrieval Results Tables Using Rclevance Judgements Interfaces for Standard Relevance Feedback Studies of User Interaction with Relevance Feedback Systems Fetching Relevant Information in the Background Group Relevance Judgements Pseudo-Relevance Feedback Interface Support für the Search Process Interfaces for String Matehing Window Management Example Systems Examples of Poor Use of Overlapping Windows Retaining Search History Integrating Scanning, Selection, and Querying Trends and Research Issues Bibliographie Discussion Multimedia IR: Models and Languages Introduction Data Modeling Multimedia Data Support in Commercial DBMSs The MULTOS Data Model Query Languages Request Specification Conditions on Multimedia Data Uncertainty, Proximity, and Weights in Query Expressions Some Proposals Trends and Research Issues Bibiographic Discussion Multimedia IR: Indexing and Searching Introduction Background - Spatial Access Methods A Generic Multimedia Indexing Approach One-dimensional Time Series Distance Function Feature Extraction and Lower-bounding Experiments Two-dimensional Color Images

8 Image Features and Distanee Functions Lower-bounding Experiments Automatie Feature Extraction 12.7 Trends and Research Issues Bibliographie Discussion 13 Searching the Web 13.1 Introduction Challenges Characterizing the Web Measuring the Web Modeling the Web 13.4 Search Engines Centralized Architecture Distributed Architecture User Interfaces., Ranking Crawling the Web Indices Browsing Web Directories Combining Searching with Browsing Helpful Tools Metasearchers Finding the Needle in the Haystaek User Problems Some Examples Teaching the User Searching using Hyperlinks Web Query Languages Dynamic Search and Software Agents Trends and Research Issues Bibliographie Discussion. 14 Libraries and Bibliographical Systems 14.1 Introduction Online IR Systems and Document Databases Databases Online Retrieval Systems IR in Online Retrieval Systems 'Natural Language' Searching Online Public Aecess Catalogs (OPACs) OPACs and Their Content OPACs and End Users OPACs: Vendors and Produets xv

9 xvi Alternatives to Vendor OPACs 14.4 Libraries and Digital Library Projects Trends and Research Issues Bibliographie Discussion 15 Digital Libraries 15.1 Introduction 15.2 Definitions Architectural Issues 15.4 Document Models, Representations, and Access Multilingual Documents Multimedia Documents Structured Documents Distributed Collections Federated Search Access Prototypes, Projects, and Interfaces International Range of Efforts Usability Standards Protocols and Federation Metadata Trends and Research Issues Bibliographical Discussion Appendix: Porter's Algorithm Glossary References Index