Table of Contents 1 Introduction A Declarative Approach to Entity Resolution... 17

Transcription

1 Table of Contents 1 Introduction Common Problem Data Integration and Data Management Information Quality Overview Customer Data Integration Data Management Practical Problems to Data Integration and Management Analytics Model Development Current Modeling and Optimization Techniques Specific Algorithms and Techniques for Improvement Incremental or Evolutionary Updates Visualization Conclusion References A Declarative Approach to Entity Resolution Introduction Background Entity Resolution Definition Entity Resolution Defense Entity Resolution Terminology Declarative Languages The Declarative Taxonomy: The Nouns Attributes References Paths and Match Functions Entities Super Groups Matching Graphs A Declarative Taxonomy: The Adjectives Attribute Adjectives Reference Adjectives The Declarative Taxonomy: The Verbs Attribute Verbs Reference Verbs Entity Verbs...32

2 x Table of Contents 2.6 A Declarative Representation The XML Schema A Representation for the Operations Conclusion Exercises References Transitive Closure of Data Records: Application and Computation Introduction Motivation Literature Review Problem Definition Sequential Algorithms A Breadth First Search Based Algorithm A Sorting and Disjoint Set Based Algorithm Experiment Parallel and Distributed Algorithms An Overview of a Parallel and Distributed Scheme Generate Matching Pairs Conversion Process Closure Process A MPI Based Parallel and Distributed Algorithm Experiment Conclusion Exercises Acknowledgments References Semantic Data Matching: Principles and Performance Introduction Problem Statement: Data Matching for Customer Data Integration Semantic Data Matching Background on Latent Semantic Analysis Analysis Effect of Shared Terms Fundamental Limitations on Data Matching Experiments Results Conclusion Exercises Acknowledgments References Application of the Near Miss Strategy and Edit Distance to Handle Dirty Data Introduction Background... 92

3 Table of Contents xi Techniques used for General Spelling Error Correction Domain-Specific Correction Individual Name Spelling Correction Algorithm: the Personal Name Recognition Strategy (PNRS) Experiment Results Conclusion Exercises References A Parallel General-Purpose Synthetic Data Generator Introduction SDDL Min/Max Constraints Distribution Constraints Formula Constraints Iterations Query Pools Pools Parallel Data Generation Generation Algorithm Generation Algorithm Performance and Applications Conclusion and Future Directions Exercises References A Grid Operating Environment for CDI Introduction Grid-Based Service Deployment Evolution of the Acxiom Grid (A Case Study) Services Grid Grid Management Grid-Based Batch Processing Workflow Grid I/O Constraints Data Grid Database Grid Data Management Conclusion Exercises Parallel File Systems Introduction Commercial Data and Access Patterns Large File Access Patterns File System Interfaces...146

4 xii Table of Contents 8.3 Basics of Parallel File Systems Common Storage System Hardware Design Challenges Performance Consistency Semantics Fault Tolerance Interoperability Management Tools Traditional Design Challenges Case Studies Multi-Path File System (MPFS) Parallel Virtual File System (PVFS) The Google File System (GFS) pnfs Conclusion Exercises References Performance Modeling of Enterprise Grids Introduction and Background Performance Modeling Capacity Planning Tools and Methodology Measurement Collection and Preliminary Analysis Workload Characterization K-means Clustering Hierarchical Workload Characterization Other Issues in Workload Characterization Baseline System Models and Tool Construction Analytic Models Simulation Tools for Enterprise Grid Systems Enterprise Grid Capacity Planning Case Study Data Collection and Preliminary Analysis Workload Characterization Development and Validation of the Baseline Model Model Predictions Summary Exercises References Delay Characteristics of Packet Switched Networks Introduction High-Speed Packet Switching Systems Packet Switched General Organization Switching Fabric Structures for Packet Switches Queuing Schemes for Packet Switches Technical Background Packet Scheduling in Packet Switches Introduction to Network Calculus

5 Table of Contents xiii 10.4 Delay Characteristics of Output Queuing Switches Output Queuing Switch System OQ Switch Modeling and Analysis Output Queuing Emulation for Delay Guarantee Delay Characteristics of Buffered Crossbar Switches Buffered Crossbar Switch System Modeling Traffic Control in Buffered Crossbar Switches Delay Analysis for Buffered Crossbar Switches Numerical Examples Delay Comparison of Output Queuing to Buffered Crossbar Maximum Packet Delay Comparison Bandwidth Allocation for Delay Performance Guarantees Numerical Examples Summary Exercises References Knowledge Discovery in Textual Databases: A Concept-Association Mining Approach Introduction Graph Representation Method Concept Based Association Rule Mining Approach Concept Extraction Mining Concept Associations Generating a Directed Graph of Concept Associations Experiments and Results Isolated words vs. multi-word concepts New Metrics vs. the Traditional Support & Confidence Conclusions Examples Exercises References Mining E-Documents to Uncover Structures Introduction Related Research Discovery of the Physical Structure Paragraph Heading Table Image Capturing the physical structure of an e-document Discovery of the Explicit Terms Using Ontology The Stemmer The Ontology Discovery Process...266

6 xiv Table of Contents 12.5 Discovery of the Logical Structure Segmentation Segments Relationships Empirical Results Conclusions Exercises Acknowledgments References Designing a Flexible Framework for a Table Abstraction Introduction Analysis of the Table ADT Formal Design Contracts Layered Architecture Client Layer Abstract Predicates for Keys and Records Keys and the Comparable Interface Records and the Keyed Interface Interactions among the Layers Access Layer Abstract Predicates for Tables Table Interface Interactions among the Layers Storage Layer Abstract Predicate for Storable Records Bridge Pattern Proxy Pattern RecordStore Interface RecordSlot Interface Interactions among the Layers Externalization Module Iterators Table Iterator Methods Input Iterators Filtering Iterators Query Iterator Methods Evolving Frameworks Three Examples Whitebox Frameworks Component Library Hot Spots Pluggable Objects Discussion Conclusion Exercises Acknowledgements References

7 Table of Contents xv 14 Information Quality Framework for Verifiable Intelligence Products Introduction Background Production Process of Intelligence Products Current IQ Practices in the IC Relevant Concepts and Methods of IQ Management IQ Challenges within the IC IQ Issues in Intelligence Collection and Analysis Other IQ Problems IQ Dimensions Related to the IC Towards a Proposed Solution IQ Metrics for Intelligence Products Verifiability of Intelligence Products Objectives and Plan Conclusion Exercises References Interactive Visualization of Large High-Dimensional Datasets Introduction Related work General requirements for a data visualization system Data Visualization Process Data Rendering Stage Backward Transformation Stage Knowledge Extraction Stage Interactive Visualization Model Utilizing Summary Icons A Case Study Conclusion Exercises Acknowledgements References Image Watermarking Based on Pyramid Decomposition with CH Transform Introduction Algorithm for multi-layer image watermarking Resistant watermarking Resistant watermark detection Fragile watermarking Data hiding Evaluation of the watermarking efficiency Experimental results Application areas Resistant watermarks Fragile watermarks Data hiding...380

8 xvi Table of Contents Conclusion Exercises Acknowledgment References Immersive Visualization of Cellular Structures Introduction Light Microscopic Cellular Images and Focus: Basics Flat-Field Correction Separation of Transparent Layers using Focus D Visualization of Cellular Structures Volume Rendering Immersive Visualization: CAVE Environment Conclusions Exercises References Visualization and Ontology of Geospatial Intelligence Introduction Premises Research Agenda Semantic Information Representation and Extraction Markov Random Field Spatial or Contextual Pattern Recognition Image Classification using k-medoid Method Random Field and Spatial Time Series First Persian-Gulf-War Example Context-driven Visualization Relevant Methodologies Visual Perception and Tracking Visualization Intelligent Information Fusion Semantic Information Extraction Intelligent Contextual Inference Context-driven Ontology Metrics for Knowledge Extraction and Discovery Conclusions and Recommendations Contributions Looking Ahead Exercises Acknowledgements References Looking Ahead Introduction Data Integration and Information Quality Grid Computing

9 Table of Contents xvii 19.4 Data Mining Visualization References Index...441

10