Multimedia Databases. 0. Organizational Issues. 0. Organizational Issues. 0. Organizational Issues. 0. Organizational Issues. 1.
|
|
- Carol Ramsey
- 6 years ago
- Views:
Transcription
1 0. Organizational Issues Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig Lecture :00-17:15 (3 lecture hours with a break) Exercises, detours, and home work discussion integrated into lecture 4 Credits Exams Oral exam 50% of exercise points needed to be eligible for the exam Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 2 0. Organizational Issues Recommended literature Schmitt: Ähnlichkeitssuche in Multimedia-Datenbanken, Oldenbourg, 2005 Steinmetz: Multimedia-Technologie: Grundlagen, Komponenten und Systeme, Springer, Organizational Issues Castelli/Bergman: Image Databases, Wiley, 2002 Khoshafian/Baker: Multimedia and Imaging Databases, Morgan Kaufmann, 1996 Sometimes: original papers (on our Web page) Relational Database Systems 1 Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 3 Relational Database Systems 1 Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 4 0. Organizational Issues Course Web page Contains slides, excercises, related papers and a video of the lecture Any questions? Just drop us an 1. Introduction 1. Introduction 1.1 What are multimedia databases? 1.2 Multimedia database applications 1.3 Evaluation of retrieval techniques Relational Database Systems 1 Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 5 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 6 1
2 1.1 Multimedia Databases What are multimedia databases (MMDB)? Databases + multimedia = MMDB Key words: databases and multimedia We already know databases, so what is multimedia? 1.1 Basic Definitions Multimedia The concept of multimedia expresses the integration of different digital media types The integration is usually performed in a document Basic media types are text, image, vector graphics, audio and video Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 7 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Data Types Text Text data, Spreadsheets, , Image Photos (Bitmaps), Vector graphics, CAD, Audio Speech- and music records, annotations, wave files, MIDI, MP3, Video Dynamical image record, frame-sequences, MPEG, AVI, 1.1 Documents Earliest definition of information retrieval: Documents are logically interdependent digitally encoded texts Extension to multimedia documents allows the additional integration of other media types as images, audio or video Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 9 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Documents Document types Media objects are documents which are of only one type (not necessarily text) Multimedia objects are general documents which allow an arbitrary combination of different types Multimedia data is transferred through the use of a medium 1.1 Basic Definitions Medium A medium is a carrier of information in a communication connection It is independent of the transported information The used medium can also be changed during information transfer Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 11 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 12 2
3 1.1 Medium Example 1.1 Medium Classification Book Communication between author and reader Independent from content Hierarchically built on text and images Reading out loud represents medium change to sound/audio Based on receiver type Visual/optical medium Acoustic mediums Haptical medium through tactile senses Olfactory medium through smell Gustatory medium through taste Based on time Dynamic Static Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 13 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Multimedia Databases We now have seen What multimedia is And how it is transported (through some medium) But why do we need databases? Most important operations of databases are data storage and data retrieval 1.1 Multimedia Databases Persistent storage of multimedia data, e.g.: Text documents Vector graphics, CAD Images, audio, video Content-based retrieval Efficient content based search Standardization of meta-data (e. g., MPEG-7, MPEG-21) Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 15 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Multimedia Databases 1.1 Historical Overview Stand-alone vs. database storage model? Special retrieval functionality as well as corresponding optimization can be provided in both cases But in the second case we also get the general advantages of databases Declarative query language Orthogonal combination of the query functionality Query optimization, Index structures Transaction management, recovery Retrieval procedures for text documents (Information Retrieval) Relational Databases and SQL Presence of multimedia objects intensifies SQL-92 introduces BLOBs First Multimedia-Databases Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 17 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 18 3
4 1.1 Commercial Systems Relational Databases use the data type BLOB (binary large object) Uninterpreted data Retrieval through metadata like e.g., file name, size, author, Object-relational extensions feature enhanced retrieval functionality Semantic search IBM DB2 Extenders, Oracle Cartridges, Integration in DB through UDFs, UDTs, Stored Procedures, 1.1 Requirements Requirements for multimedia databases (Christodoulakis, 1985) Classical database functionality Maintenance of unformatted data Consideration of special storage and presentation devices Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 19 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Requirements 1.1 Requirements To comply with these requirements the following aspects need to be considered Software architecture new or extension of existing databases? Content addressing identification of the objects through content-based features Performance improvements using indexes, optimization, etc. User interface how should the user interact with the system? Separate structure from content! Information extraction (automatic) generation of content-based features Storage devices very large storage capacity, redundancy control and compression Information retrieval integration of some extended search functionality Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 21 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Retrieval 1.1 Retrieval Retrieval means the choice between data objects which can be based on a SELECT condition (exact match) or a defined similarity connection (best match) Retrieval may cover the delivery of the results to the user, too Closer look at the search functionality Semantic search functionality Orthogonal integration of classical and extended functionality Search does not directly access the media objects Extraction, normalization and indexing of contentbased features Meaningful similarity/distance measures Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 23 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 24 4
5 1.1 Content-based Retrieval Retrieve all images showing a sunset! 1.1 Schematic View Usually 2 main steps Example: image databases Image collection Digitization Image analysis and feature extraction Creating the database Image database What exactly do these images have in common? Image query Digitization Querying the database Image analysis and feature extraction Similarity search Search result Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 25 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Detailed View 1.1 More Detailed View Query Result Query Result 3. Query preparation Query plan & feature values 5. Result preparation Result data Query preparation Normalization Segmentation Optimization Feature extraction Feature values Query plan Relevance feedback Result preparation Medium transformation Format transformation Result data 4. Similarity computation & query processing Similarity computation Query processing Feature values 2. Extraction of features Raw data Raw & relational data MM-Database 1. Insert into the database MM-Objects + relational data Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 27 Feature values MM-Database Relational DB Metadata Feature index BLOBs/CLOBs Profile Structure data Feature extraction Pre-processing Feature recognition Decomposition Feature preparation Normalization Segmentation MM-Objects Relational data Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 28 Lots of multimedia content on the Web Social networking e.g., Facebook, MySpace, Hi5, Orkut, etc. Photo sharing e.g., Flickr, Photobucket, Imeem, Picasa, etc. Video sharing e.g., YouTube, Megavideo, Metacafe, blip.tv, Liveleak, etc. Cameras are everywhere In London there are at least 500,000 cameras in the city, and one study showed that in a single day a person could expect to be filmed 300 times Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 29 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 30 5
6 10/27/2009 Picasa face recognition Picasa, face recognition example 31 Picasa example Sample Scenario Sample Scenario Consider a police investigation of a large-scale drug operation Possible generated data: Possible queries Image query by example: police officer has a photograph and wants to find the identity of the person in the picture Video data captured by surveillance cameras Audio data captured Image data consisting of still photographs taken by investigators Structured relational data containing background information Geographic information system data 32 Picasa, learning phase Query: retrieve all images from the image library in which the person appearing in the (currently displayed) photograph appears Image query by keywords: police officer wants to examine pictures of Tony Soprano Query: retrieve all images from the image library in which Tony Soprano appears"
7 1.2 Sample Scenario Video Query: Query: Find all video segments in which Jerry appears By examining the answer of the above query, the police officer hopes to find other people who have previously interacted with the victim 1.2 Sample Scenario Heterogeneous Multimedia Query: Find all individuals who have been photographed with Tony Soprano and who have been convicted of attempted murder in New Jersey and who have recently had electronic fund transfers made into their bank accounts from ABC Corp. Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 37 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Characteristics 1.2 Example Basic difference Static High number of search queries (read access), few modifications of the data state Dynamic Often modifications of the data state Active Database functionality lead to application operations Passive Database reacts only at requests from outside Standard search Queries are answered through the use of metadata e.g., Google-image search Retrieval functionality Content based search on the multimedia repository e.g., Picasa face recognition Passive static retrieval Art historical use case Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 39 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Example Possible hit in a multimedia database 1.2 Example Active dynamic retrieval Wetter warning through evaluation of satellite photos Extraction Typhoon-Warning for the Philippines Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 41 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 42 7
8 1.2 Example 1.2 Example Standard search Queries are answered through the use of metadata e.g., Google-image search Retrieval functionality Content based e.g., Picasa face recognition Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 43 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Towards Evaluation 1.3 Evaluating Efficiency Basic evaluation of retrieval techniques Efficiency of the system Efficient utilization of system resources Scalable also over big collections Effectivity of the retrieval process High quality of the result Meaningful usage of the system Weighting is application specific Characteristic values to measure efficiency are e.g.: Memory usage CPU-time Number of I/O-Operations Response time Depends on the (Hardware-) environment Goal: the system should be efficient enough! Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 45 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Evaluating Effectivity 1.3 Evaluating Effectivity Measuring effectivity is more difficult and always depending on the query Goal: define some query-dependent evaluation measures! Objective quality metrics Result evaluation based on the query Independent from used querying interface and retrieval procedure Leads to comparability of different systems/algorithms Effectivity can be measured regarding some explicit query Main focus on evaluating the behavior of the system with respect to a query Relevance of the result set But effectivity also needs to consider implicit information needs Main focus on evaluating the usefulness, usability and user friendliness of the system Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 47 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 48 8
9 1.3 Relevance 1.3 Usefulness (Pertinence) To evaluate a retrieval system over some query, each document will be classified binary as relevant or irrelevant with respect to the query This classification is performed by experts The response of the system to the query will be compared to this manual classification Compare the obtained response with the ideal result Subjective measure estimating to what degree the information need of the user is satisfied Difficult to measure (empirical studies) Questionable instrument for comparing procedures/systems Attention: useful documents can be irrelevant when considering the query (serendipity) In this lecture: explicit query evaluation measures only! Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 49 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Involved Sets 1.3 False Positives collection Irrelevant documents, classified as relevant by the system False alarms, false drops, searched for (= relevant) found (= query result) Needlessly increase the result set Usually inevitable (ambiguity) Can be easily eliminated by the user Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 51 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig False Negatives 1.3 Remaining Sets Relevant documents classified by the system as irrelevant False dismissals Dangerous, since they can not be detected easily by the user Does the collection contain better documents? False positives are usually not as bad as false negatives Correct positives (correct alarms) All documents correctly classified by the system as relevant Correct negatives (correct dismissals) All documents correctly classified by the system as irrelevant All sets are disjunctive and their reunion is the entire document collection Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 53 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 54 9
10 1.3 Overview 1.3 Interpretation Systemevaluation Userevaluation relevant irrelevant {Relevant results} = fd + ca {Retrieved results} = ca + fa collection relevant irrelevant ca fa fd cd fd searched for ca fa found cd Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 55 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Precision Precision measures the ratio of correctly returned documents relative to all returned documents P = ca / (ca + fa) Value between [0, 1] (1 representing the best value) High number of false alarms mean worse results 1.3 Recall Recall measures the ratio of correctly returned documents relative to all relevant documents R = ca / (ca + fd) Value between [0, 1] (1 representing the best value) High number of false drops mean worse results Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 57 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Precision-Recall Analysis Both measures only make sense, if considered at the same time E.g., get perfect recall by simply returning all documents, but then the precision is extremely low Can be balanced by tuning the system E.g., smaller result sets lead to better precision rates at the cost of recall Usually the average precision-recall of more queries is considered (macro evaluation) 1.3 Actual Evaluation Alarms (returned elements) can be easily divided in ca and fa Precision is easy to calculate Dismissals (not returned elements) are not so trivial to divide in cd und fd, because the entire collection has to be classified Recall is difficult to calculate Standardized Benchmarks Provided connections and queries Annotated result sets Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 59 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 60 10
11 1.3 TREC 1.3 Example Text REtrieval Conference De-Facto-Standard since 1992 Establish average precision for 11 fixed recall points (0; 0,1; 0,2; ; 1) according to defined procedures (trec_eval) Different tracks, extended also for video data, Web retrieval and Question Answering Other initiatives: e.g., CLEF (cross-language retrieval) or INEX (XML-Documents) Query Q 1 Q 2 fa 8 2 ca fd cd 4 8 Average P 0,2 0,8 0,5 R 0,25 0,8 0,525 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 61 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Representation Next lecture Precision-Recall-Graphs System 1 System 2 System 3 Average precision of the system 3 at a recall-level of 0,2 Which system is the best? What is more important: recall or precision? Retrieval of images by color Introduction to color spaces Color histograms Matching Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 63 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 64 11
Multimedia Databases
Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 0 Organizational Issues Lecture 07.04.2011 14.07.2011
More informationMultimedia Databases. 9 Video Retrieval. 9.1 Hidden Markov Model. 9.1 Hidden Markov Model. 9.1 Evaluation. 9.1 HMM Example 12/18/2009
9 Video Retrieval Multimedia Databases 9 Video Retrieval 9.1 Hidden Markov Models (continued from last lecture) 9.2 Introduction into Video Retrieval Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme
More informationMultimedia Databases. Wolf-Tilo Balke Younès Ghammad Institut für Informationssysteme Technische Universität Braunschweig
Multimedia Databases Wolf-Tilo Balke Younès Ghammad Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Previous Lecture Audio Retrieval - Query by Humming
More informationSummary. 4. Indexes. 4.0 Indexes. 4.1 Tree Based Indexes. 4.0 Indexes. 19-Nov-10. Last week: This week:
Summary Data Warehousing & Data Mining Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Last week: Logical Model: Cubes,
More informationRelational Database Systems 2 1. System Architecture
Relational Database Systems 2 1. System Architecture Silke Eckstein Andreas Kupfer Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Organizational Information
More informationRelational Database Systems 2 1. System Architecture
Relational Database Systems 2 1. System Architecture Wolf-Tilo Balke Jan-Christoph Kalo Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 1 Organizational
More informationWolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig
Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 6 Audio Retrieval 6 Audio Retrieval 6.1 Basics of
More informationMultimedia Databases. 8 Audio Retrieval. 8.1 Music Retrieval. 8.1 Statistical Features. 8.1 Music Retrieval. 8.1 Music Retrieval 12/11/2009
8 Audio Retrieval Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 8 Audio Retrieval 8.1 Query by Humming
More informationInformation Retrieval
Multimedia Computing: Algorithms, Systems, and Applications: Information Retrieval and Search Engine By Dr. Yu Cao Department of Computer Science The University of Massachusetts Lowell Lowell, MA 01854,
More informationInformation Retrieval and Web Search Engines
Information Retrieval and Web Search Engines Lecture 7: Document Clustering May 25, 2011 Wolf-Tilo Balke and Joachim Selke Institut für Informationssysteme Technische Universität Braunschweig Homework
More informationMultimedia Databases. 2. Summary. 2 Color-based Retrieval. 2.1 Multimedia Data Retrieval. 2.1 Multimedia Data Retrieval 4/14/2016.
2. Summary Multimedia Databases Wolf-Tilo Balke Younes Ghammad Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Last week: What are multimedia databases?
More informationVK Multimedia Information Systems
VK Multimedia Information Systems Mathias Lux, mlux@itec.aau.at This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Agenda Topics & goals Modalities & examination
More informationCCRMA MIR Workshop 2014 Evaluating Information Retrieval Systems. Leigh M. Smith Humtap Inc.
CCRMA MIR Workshop 2014 Evaluating Information Retrieval Systems Leigh M. Smith Humtap Inc. leigh@humtap.com Basic system overview Segmentation (Frames, Onsets, Beats, Bars, Chord Changes, etc) Feature
More informationData Warehousing & Data Mining
Data Warehousing & Data Mining Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Summary Last week: Logical Model: Cubes,
More information9/8/2016. Characteristics of multimedia Various media types
Chapter 1 Introduction to Multimedia Networking CLO1: Define fundamentals of multimedia networking Upon completion of this chapter students should be able to define: 1- Multimedia 2- Multimedia types and
More informationData Warehousing & Mining Techniques
2. Summary Data Warehousing & Mining Techniques Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Last week: What is a Data
More informationChapter 2 - Concepts and Definitions
Prof. Dr.-Ing. Stefan Deßloch AG Heterogene Informationssysteme Geb. 36, Raum 329 Tel. 0631/205 3275 dessloch@informatik.uni-kl.de Chapter 2 - Concepts and Definitions Introduction and Requirements Database
More informationMultimedia Databases
Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Previous Lecture Audio Retrieval - Low Level Audio
More informationOverview of Web Mining Techniques and its Application towards Web
Overview of Web Mining Techniques and its Application towards Web *Prof.Pooja Mehta Abstract The World Wide Web (WWW) acts as an interactive and popular way to transfer information. Due to the enormous
More informationCSCI 5417 Information Retrieval Systems. Jim Martin!
CSCI 5417 Information Retrieval Systems Jim Martin! Lecture 7 9/13/2011 Today Review Efficient scoring schemes Approximate scoring Evaluating IR systems 1 Normal Cosine Scoring Speedups... Compute the
More informationData Warehousing & Mining Techniques
Data Warehousing & Mining Techniques Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 2. Summary Last week: What is a Data
More information2. Summary. 2.1 Basic Architecture. 2. Architecture. 2.1 Staging Area. 2.1 Operational Data Store. Last week: Architecture and Data model
2. Summary Data Warehousing & Mining Techniques Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Last week: What is a Data
More information1. Inroduction to Data Mininig
1. Inroduction to Data Mininig 1.1 Introduction Universe of Data Information Technology has grown in various directions in the recent years. One natural evolutionary path has been the development of the
More informationMPEG-7. Multimedia Content Description Standard
MPEG-7 Multimedia Content Description Standard Abstract The purpose of this presentation is to provide a better understanding of the objectives & components of the MPEG-7, "Multimedia Content Description
More informationWorkshop W14 - Audio Gets Smart: Semantic Audio Analysis & Metadata Standards
Workshop W14 - Audio Gets Smart: Semantic Audio Analysis & Metadata Standards Jürgen Herre for Integrated Circuits (FhG-IIS) Erlangen, Germany Jürgen Herre, hrr@iis.fhg.de Page 1 Overview Extracting meaning
More informationAn Introduction to Content Based Image Retrieval
CHAPTER -1 An Introduction to Content Based Image Retrieval 1.1 Introduction With the advancement in internet and multimedia technologies, a huge amount of multimedia data in the form of audio, video and
More information5.3 Parser and Translator. 5.3 Parser and Translator. 5.3 Parser and Translator. 5.3 Parser and Translator. 5.3 Parser and Translator
5 Query Processing Relational Database Systems 2 5. Query Processing Silke Eckstein Andreas Kupfer Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 5.1 Introduction:
More informationData Warehouse and Data Mining
Data Warehouse and Data Mining Lecture No. 02 Lifecycle of Data warehouse Naeem Ahmed Email: naeemmahoto@gmail.com Department of Software Engineering Mehran Univeristy of Engineering and Technology Jamshoro
More informationMultimedia Database Systems. Retrieval by Content
Multimedia Database Systems Retrieval by Content MIR Motivation Large volumes of data world-wide are not only based on text: Satellite images (oil spill), deep space images (NASA) Medical images (X-rays,
More informationSummary. Summary. 5. Optimization. 5.1 Partitioning. 5.1 Partitioning. 26-Nov-10. B-Trees are not fit for multidimensional data R-Trees
Summary Data Warehousing & Data Mining Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de B-Trees are not fit for multidimensional
More informationRelational Database Systems 2 5. Query Processing
Relational Database Systems 2 5. Query Processing Silke Eckstein Andreas Kupfer Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 5 Query Processing 5.1 Introduction:
More informationInformation Retrieval and Web Search Engines
Information Retrieval and Web Search Engines Lecture 7: Document Clustering December 4th, 2014 Wolf-Tilo Balke and José Pinto Institut für Informationssysteme Technische Universität Braunschweig The Cluster
More informationMultimedia Information Retrieval
Multimedia Information Retrieval Prof Stefan Rüger Multimedia and Information Systems Knowledge Media Institute The Open University http://kmi.open.ac.uk/mmis Multimedia Information Retrieval 1. What are
More informationRelational Database Systems 2 5. Query Processing
Relational Database Systems 2 5. Query Processing Silke Eckstein Benjamin Köhncke Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 4 Trees & Advanced Indexes
More informationCOMP6237 Data Mining Searching and Ranking
COMP6237 Data Mining Searching and Ranking Jonathon Hare jsh2@ecs.soton.ac.uk Note: portions of these slides are from those by ChengXiang Cheng Zhai at UIUC https://class.coursera.org/textretrieval-001
More informationMultimedia Systems. Lehrstuhl für Informatik IV RWTH Aachen. Prof. Dr. Otto Spaniol Dr. rer. nat. Dirk Thißen
Multimedia Systems Lehrstuhl für Informatik IV RWTH Aachen Prof. Dr. Otto Spaniol Dr. rer. nat. Dirk Thißen Page 1 Organization Lehrstuhl für Informatik 4 Lecture Lecture takes place on Thursday, 10:00
More informationMulti-modal Information Retrieval experiences from Context-Aware Image Management, CAIM
Multi-modal Information Retrieval experiences from Context-Aware Image Management, CAIM Joan Nordbotten Dept. Of Information and Media Science University of Bergen, Norway 1 Outline Multi-modal Information
More informationKnowledge Retrieval. Franz J. Kurfess. Computer Science Department California Polytechnic State University San Luis Obispo, CA, U.S.A.
Knowledge Retrieval Franz J. Kurfess Computer Science Department California Polytechnic State University San Luis Obispo, CA, U.S.A. 1 Acknowledgements This lecture series has been sponsored by the European
More informationdoc. RNDr. Tomáš Skopal, Ph.D. Department of Software Engineering, Faculty of Information Technology, Czech Technical University in Prague
Praha & EU: Investujeme do vaší budoucnosti Evropský sociální fond course: Searching the Web and Multimedia Databases (BI-VWM) Tomáš Skopal, 2011 SS2010/11 doc. RNDr. Tomáš Skopal, Ph.D. Department of
More informationInformatica Enterprise Information Catalog
Data Sheet Informatica Enterprise Information Catalog Benefits Automatically catalog and classify all types of data across the enterprise using an AI-powered catalog Identify domains and entities with
More informationDistributed Data Management
Distributed Data Management Profr. Dr. Wolf-Tilo Balke Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 3.0 Introduction 3.0 Query Processing 3.1 Basic Distributed
More informationSo, what is data compression, and why do we need it?
In the last decade we have been witnessing a revolution in the way we communicate 2 The major contributors in this revolution are: Internet; The explosive development of mobile communications; and The
More informationDistributed Data Management
Distributed Data Management Wolf-Tilo Balke Christoph Lofi Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 2.0 Introduction 3.0 Query Processing 3.1 Basic
More informationDatabase System Concepts and Architecture
CHAPTER 2 Database System Concepts and Architecture Copyright 2017 Ramez Elmasri and Shamkant B. Navathe Slide 2-2 Outline Data Models and Their Categories History of Data Models Schemas, Instances, and
More informationHello, I am from the State University of Library Studies and Information Technologies, Bulgaria
Hello, My name is Svetla Boytcheva, I am from the State University of Library Studies and Information Technologies, Bulgaria I am goingto present you work in progress for a research project aiming development
More information0. Organizational Issues. 0. Why should you be here? 0. Why should you be here? 0. Why should you be here? Relational Database Systems
0. Organizational Issues Relational Database Systems 1 Wolf-Tilo Balke Christoph Lofi Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Lecture 07. November
More informationIntroduction to Similarity Search in Multimedia Databases
Introduction to Similarity Search in Multimedia Databases Tomáš Skopal Charles University in Prague Faculty of Mathematics and Phycics SIRET research group http://siret.ms.mff.cuni.cz March 23 rd 2011,
More informationNew Media Production week 3
New Media Production week 3 Multimedia ponpong@gmail.com What is Multimedia? Multimedia = Multi + Media Multi = Many, Multiple Media = Distribution tool & information presentation text, graphic, voice,
More informationB.H.GARDI COLLEGE OF MASTER OF COMPUTER APPLICATION. Ch. 1 :- Introduction Database Management System - 1
Basic Concepts :- 1. What is Data? Data is a collection of facts from which conclusion may be drawn. In computer science, data is anything in a form suitable for use with a computer. Data is often distinguished
More informationIntroduction: Databases and. Database Users
Types of Databases and Database Applications Basic Definitions Typical DBMS Functionality Example of a Database (UNIVERSITY) Main Characteristics of the Database Approach Database Users Advantages of Using
More informationDr. Angelika Reiser Chair for Database Systems (I3)
Introduction Dr. Angelika Reiser Chair for Database Systems (I3) www-db.in.tum.de de TU München / Garching reiser@in.tum.de Lecture Web page of the lecture: see TUMonline www-db.in.tum.de/teaching/ws1617/dbsandere
More informationCopyright 2007 Ramez Elmasri and Shamkant B. Navathe. Slide 1-1
Slide 1-1 Chapter 1 Introduction: Databases and Database Users Outline Types of Databases and Database Applications Basic Definitions Typical DBMS Functionality Example of a Database (UNIVERSITY) Main
More informationDatabase System Concepts and Architecture
1 / 14 Data Models and Their Categories History of Data Models Schemas, Instances, and States Three-Schema Architecture Data Independence DBMS Languages and Interfaces Database System Utilities and Tools
More informationInformation Systems (Informationssysteme)
Information Systems (Informationssysteme) Jens Teubner, TU Dortmund jens.teubner@cs.tu-dortmund.de Summer 2017 c Jens Teubner Information Systems Summer 2017 1 A Few Words About Me Jens Teubner DBIS Group
More information- Content-based Recommendation -
- Content-based Recommendation - Institute for Software Technology Inffeldgasse 16b/2 A-8010 Graz Austria 1 Content-based recommendation While CF methods do not require any information about the items,
More informationCopyright 2016 Ramez Elmasri and Shamkant B. Navathe
Copyright 2016 Ramez Elmasri and Shamkant B. Navathe CHAPTER 1 Databases and Database Users Copyright 2016 Ramez Elmasri and Shamkant B. Navathe Slide 1-2 OUTLINE Types of Databases and Database Applications
More informationMultimedia on the Web
Multimedia on the Web Graphics in web pages Downloading software & media Digital photography JPEG & GIF Streaming media Macromedia Flash Graphics in web pages Graphics are very popular in web pages Graphics
More informationFeature Selection in Learning Using Privileged Information
November 18, 2017 ICDM 2017 New Orleans Feature Selection in Learning Using Privileged Information Rauf Izmailov, Blerta Lindqvist, Peter Lin rizmailov@vencorelabs.com Phone: 908-748-2891 Agenda Learning
More informationRelational Database Systems 1
Relational Database Systems 1 Wolf-Tilo Balke Benjamin Köhncke Institut für Informationssysteme Technische Universität Braunschweig www.ifis.cs.tu-bs.de 0. Organizational Issues Who is who? Wolf Tilo Balke
More informationDescription and search of multimedia data
Description and search of multimedia data Digital Content Retrieval Prof.ssa Maria Grazia Albanesi Topics The problem: searching in multimedia data Why is it different from text search? How to make a search
More informationLecture 19 Media Formats
Revision IMS2603 Information Management in Organisations Lecture 19 Media Formats Last week s lectures looked at MARC as a specific instance of complex metadata representation and at Content Management
More information0. Organizational Issues. 0. Why should you be here? 0. Why should you be here? 0. Recommended Literature. 0. Why should you be here?
0. Organizational Issues Data Warehousing & Mining Techniques Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Lecture 28.
More informationIntroductory Visualizing Technology
Introductory Visualizing Technology Seventh Edition Chapter 6 Digital Devices and Multimedia Learning Objectives 6.1 Explain the Features of Digital Cameras 6.2 Compare Methods for Transferring Images
More informationMULTIMEDIA DATABASES OVERVIEW
MULTIMEDIA DATABASES OVERVIEW Recent developments in information systems technologies have resulted in computerizing many applications in various business areas. Data has become a critical resource in
More informationOutline. Database Theory. Prerequisites and Admission. Classes VU , SS 2018
Database Theory Database Theory Outline Database Theory VU 181.140, SS 2018 0. General Information Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 6 March,
More informationMultimedia Systems. Part 1. Mahdi Vasighi
Multimedia Systems Part 1 Mahdi Vasighi www.iasbs.ac.ir/~vasighi Department of Computer Science and Information Technology, Institute for Advanced Studies in Basic Sciences, Zanjan, Iran Teaching Plan
More informationPart 11: Collaborative Filtering. Francesco Ricci
Part : Collaborative Filtering Francesco Ricci Content An example of a Collaborative Filtering system: MovieLens The collaborative filtering method n Similarity of users n Methods for building the rating
More informationIntroduction. Example Databases
Introduction Example databases Overview of concepts Why use database systems Example Databases University Data: departments, students, exams, rooms,... Usage: creating exam plans, enter exam results, create
More informationPlan for today. CS276B Text Retrieval and Mining Winter Vector spaces and XML. Text-centric XML retrieval. Vector spaces and XML
CS276B Text Retrieval and Mining Winter 2005 Plan for today Vector space approaches to XML retrieval Evaluating text-centric retrieval Lecture 15 Text-centric XML retrieval Documents marked up as XML E.g.,
More informationCopyright 2007 Ramez Elmasri and Shamkant B. Navathe Slide 2-1
Copyright 2007 Ramez Elmasri and Shamkant B. Navathe Slide 2-1 Chapter 2 Database System Concepts and Architecture Copyright 2007 Ramez Elmasri and Shamkant B. Navathe Outline Data Models and Their Categories
More informationIntroduction: Databases and Database Users. Copyright 2007 Ramez Elmasri and Shamkant B. Navathe Slide 1
Copyright 2007 Ramez Elmasri and Shamkant B. Navathe Slide 1 Introduction: Databases and Database Users Copyright 2007 Ramez Elmasri and Shamkant B. Navathe Types of Databases and Database Applications
More informationRelational Database Systems 1
Relational Database Systems 1 Wolf-Tilo Balke Simon Barthel Institut für Informationssysteme Technische Universität Braunschweig www.ifis.cs.tu-bs.de 10.0 Introduction Up to now, we have learned......
More informationIntroduction to Database Systems. Motivation. Werner Nutt
Introduction to Database Systems Motivation Werner Nutt 1 Databases Are Everywhere Database = a large (?) collection of related data Classically, a DB models a real-world organisation (e.g., enterprise,
More informationThomas Luel Florent Mazzone Readings Zheng-Hua Tan October the 17 th
Thomas Luel Florent Mazzone Readings Zheng-Hua Tan October the 17 th 2008 1 Image Search Engines Audio Search Engines Video Search Engines Summary 2 The web : ~ 60 billions of different WebPages (2006)
More informationCSE 132A. Database Systems Principles
CSE 132A Database Systems Principles Prof. Victor Vianu 1 Data Management An evolving, expanding field: Classical stand-alone databases (Oracle, DB2, SQL Server) Computer science is becoming data-centric:
More informationMultimedia Search Engine
사례조사 Multimedia Search Engine YeRim Choi iangoozh@gmail.com Information Management Lab Dept. of Industrial Engineering November 6 th, 2011 Seoul National University Information Universe 2nd Semester, 2011
More informationLecture Information Multimedia Video Coding & Architectures
Multimedia Video Coding & Architectures (5LSE0), Module 01 Introduction to coding aspects 1 Lecture Information Lecturer Prof.dr.ir. Peter H.N. de With Faculty Electrical Engineering, University Technology
More information3 Data, Data Mining. Chengkai Li
CSE4334/5334 Data Mining 3 Data, Data Mining Chengkai Li Department of Computer Science and Engineering University of Texas at Arlington Fall 2018 (Slides partly courtesy of Pang-Ning Tan, Michael Steinbach
More information0. Organizational Issues. 0. Why should you be here? 0. Why should you be here? 0. Why should you be here? 0. Recommended Literature
0. Organizational Issues Data Warehousing & Mining Techniques Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Lecture 02.
More informationDatabases and Database Management Systems
Databases and Database Management Systems 1 DBMS concepts and architecture ER model Relational Databases Relational Algebra Query Languages (SQL) Storage and Indexing (optional) Database Design : Normalization
More informationMINI MOCK (MIMO) Computer Science 2210
MINI MOCK (MIMO) Computer Science 2210 For Class 9th Abstract The Mini Mock examination paper for Final Term 2016-17 INSTRUCTIONS This Mini Mock paper is designed to test your preparation for Final-Term
More informationXML RETRIEVAL. Introduction to Information Retrieval CS 150 Donald J. Patterson
Introduction to Information Retrieval CS 150 Donald J. Patterson Content adapted from Manning, Raghavan, and Schütze http://www.informationretrieval.org OVERVIEW Introduction Basic XML Concepts Challenges
More informationDatabase System Concepts and Architecture. Copyright 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley
Database System Concepts and Architecture Copyright 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Outline Data Models and Their Categories History of Data Models Schemas, Instances,
More informationDifferent File Types and their Use
Different File Types and their Use.DOC (Microsoft Word Document) Text Files A DOC file is a Word processing document created by Microsoft Word, a word processor included with all versions of Microsoft
More informationData Warehousing & Data Mining
Data Warehousing & Data Mining Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Summary Last Week: Optimization - Indexes
More informationINFSCI 2140 Information Storage and Retrieval Lecture 1: Introduction. INFSCI 2140 and your program
INFSCI 2140 Information Storage and Retrieval Lecture 1: Introduction Peter Brusilovsky http://www2.sis.pitt.edu/~peterb/2140-051/ INFSCI 2140 and your program Foundation course One of the key courses
More informationInformation Management (IM)
1 2 3 4 5 6 7 8 9 Information Management (IM) Information Management (IM) is primarily concerned with the capture, digitization, representation, organization, transformation, and presentation of information;
More informationGraphics in IT82. Representing Graphical Data. Graphics in IT82. Lectures Overview. Representing Graphical Data. Logical / Physical Representation
Graphics in IT82 What does computer graphics cover? Representing Graphical Data Chapman & Chapman, chapters 3,4,5 Richardson IT82 Input, output, and representation of graphical data Creation of graphics
More informationCSI 4107 Image Information Retrieval
CSI 4107 Image Information Retrieval This slides are inspired by a tutorial on Medical Image Retrieval by Henning Müller and Thomas Deselaers, 2005-2006 1 Outline Introduction Content-based image retrieval
More informationCS-490WIR Web Information Retrieval and Management. Luo Si
CS490W: Web Information Retrieval & Management CS-490WIR Web Information Retrieval and Management Luo Si Department of Computer Science Purdue University Overview Web: Growth of the Web The world produces
More informationContend Based Multimedia Retrieval
Contend Based Multimedia Retrieval CBIR Query Types Semantic Gap Features Segmentation High dimension IBMS QBIC GIFT, MRML Blobworld CLUE SIMPLIcity CBMR Multimedia Automatic Video Analysis 1 CBIR Contend
More informationIntroduction. Who wants to study databases?
Introduction Example databases Overview of concepts Why use database systems Who wants to study databases? What is the use of all the courses I have taken so far? This course shows very concrete how CS
More informationMultimedia Applications I ARKANSAS CAREER AND TECHNICAL EDUCATION, BUSINESS/MARKETING TECHNOLOGY, MULTIMEDIA APPLICATIONS I & II
Essentials for Design: Adobe InDesign CS Level 1, 4 th Edition 2004 (McAllister) Arkansas Career and Technology Education, Business/Marketing Technology, Multimedia Applications I & II (Grades 10-12) Multimedia
More informationPerformance Evaluation
Chapter 4 Performance Evaluation For testing and comparing the effectiveness of retrieval and classification methods, ways of evaluating the performance are required. This chapter discusses several of
More informationMultimedia Information Extraction and Retrieval Term Frequency Inverse Document Frequency
Multimedia Information Extraction and Retrieval Term Frequency Inverse Document Frequency Ralf Moeller Hamburg Univ. of Technology Acknowledgement Slides taken from presentation material for the following
More informationLesson 11. Media Retrieval. Information Retrieval. Image Retrieval. Video Retrieval. Audio Retrieval
Lesson 11 Media Retrieval Information Retrieval Image Retrieval Video Retrieval Audio Retrieval Information Retrieval Retrieval = Query + Search Informational Retrieval: Get required information from database/web
More informationExadata X3 in action: Measuring Smart Scan efficiency with AWR. Franck Pachot Senior Consultant
Exadata X3 in action: Measuring Smart Scan efficiency with AWR Franck Pachot Senior Consultant 16 March 2013 1 Exadata X3 in action: Measuring Smart Scan efficiency with AWR Exadata comes with new statistics
More informationSearching Video Collections:Part I
Searching Video Collections:Part I Introduction to Multimedia Information Retrieval Multimedia Representation Visual Features (Still Images and Image Sequences) Color Texture Shape Edges Objects, Motion
More informationSearch Engines. Information Retrieval in Practice
Search Engines Information Retrieval in Practice All slides Addison Wesley, 2008 Beyond Bag of Words Bag of Words a document is considered to be an unordered collection of words with no relationships Extending
More informationCS4670: Computer Vision
CS4670: Computer Vision Noah Snavely Lecture 6: Feature matching and alignment Szeliski: Chapter 6.1 Reading Last time: Corners and blobs Scale-space blob detector: Example Feature descriptors We know
More information