Multimedia Databases
|
|
- Janice Skinner
- 6 years ago
- Views:
Transcription
1 Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig
2 0 Organizational Issues Lecture :45-12:15 (3 lecture hours with a break) Exercises, detours, and homeworks 4 or 5 Credits depending on the examination rules Exams Oral exam Achieving more than 50% in homework points is advised Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 2
3 0 Organizational Issues Recommended literature Schmitt: Ähnlichkeitssuche in Multimedia-Datenbanken, Oldenbourg, 2005 Steinmetz: Multimedia-Technologie: Grundlagen, Komponenten und Systeme, Springer, 1999 Relational Database Systems 1 Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 3
4 0 Organizational Issues Castelli/Bergman: Image Databases, Wiley, 2002 Khoshafian/Baker: Multimedia and Imaging Databases, Morgan Kaufmann, 1996 Sometimes: original papers (on our Web page) Relational Database Systems 1 Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 4
5 0 Organizational Issues Course Web page Contains slides, exercises, related papers and a video of the lecture Any questions? Just drop us an Relational Database Systems 1 Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 5
6 1 Introduction 1 Introduction 1.1 What are multimedia databases? 1.2 Multimedia database applications 1.3 Evaluation of retrieval techniques Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 6
7 1.1 Multimedia Databases What are multimedia databases (MMDB)? Databases + multimedia = MMDB Key words: databases and multimedia We already know databases, so what is multimedia? Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 7
8 1.1 Basic Definitions Multimedia The concept of multimedia expresses the integration of different digital media types The integration is usually performed in a document Basic media types are text, image, vector graphics, audio and video Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 8
9 1.1 Data Types Text Text data, Spreadsheets, , Image Photos (Bitmaps), Vector graphics, CAD, Audio Speech- and music records, annotations, wave files, MIDI, MP3, Video Dynamical image record, frame-sequences, MPEG, AVI, Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 9
10 1.1 Documents Earliest definition of information retrieval: Documents are logically interdependent digitally encoded texts Extension to multimedia documents allows the additional integration of other media types as images, audio or video Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 10
11 1.1 Documents Document types Media objects are documents which are of only one type (not necessarily text) Multimedia objects are general documents which allow an arbitrary combination of different types Multimedia data is transferred through the use of a medium Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 11
12 1.1 Basic Definitions Medium A medium is a carrier of information in a communication connection It is independent of the transported information The used medium can also be changed during information transfer Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 12
13 1.1 Medium Example Book Communication between author and reader Independent from content Hierarchically built on text and images Reading out loud represents medium change to sound/audio Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 13
14 1.1 Medium Classification Based on receiver type Visual/optical medium Acoustic mediums Haptical medium through tactile senses Olfactory medium through smell Gustatory medium through taste Based on time Dynamic Static Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 14
15 1.1 Multimedia Databases We now have seen What multimedia is And how it is transported (through some medium) But why do we need databases? Most important operations of databases are data storage and data retrieval Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 15
16 1.1 Multimedia Databases Persistent storage of multimedia data, e.g.: Text documents Vector graphics, CAD Images, audio, video Content-based retrieval Efficient content based search Standardization of meta-data (e. g., MPEG-7, MPEG-21) Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 16
17 1.1 Multimedia Databases Stand-alone vs. database storage model? Special retrieval functionality as well as corresponding optimization can be provided in both cases But in the second case we also get the general advantages of databases Declarative query language Orthogonal combination of the query functionality Query optimization, Index structures Transaction management, recovery... Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 17
18 1.1 Historical Overview Retrieval procedures for text documents (Information Retrieval) Relational Databases and SQL 1980 Presence of multimedia objects intensifies 1990 SQL-92 introduces BLOBs First Multimedia-Databases 2000 Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 18
19 1.1 Commercial Systems Relational Databases use the data type BLOB (binary large object) Un-interpreted data Retrieval through metadata like e.g., file name, size, author, Object-relational extensions feature enhanced retrieval functionality Semantic search IBM DB2 Extenders, Oracle Cartridges, Integration in DB through UDFs, UDTs, Stored Procedures, Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 19
20 1.1 Requirements Requirements for multimedia databases (Christodoulakis, 1985) Classical database functionality Maintenance of unformatted data Consideration of special storage and presentation devices Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 20
21 1.1 Requirements To comply with these requirements the following aspects need to be considered Software architecture new or extension of existing databases? Content addressing identification of the objects through content-based features Performance improvements using indexes, optimization, etc. Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 21
22 1.1 Requirements User interface how should the user interact with the system? Separate structure from content! Information extraction (automatic) generation of content-based features Storage devices very large storage capacity, redundancy control and compression Information retrieval integration of some extended search functionality Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 22
23 1.1 Retrieval Retrieval: choosing between data objects. Based on a SELECT condition (exact match) or a defined similarity connection (best match) Retrieval may also cover the delivery of the results to the user Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 23
24 1.1 Retrieval Closer look at the search functionality Semantic search functionality Orthogonal integration of classical and extended functionality Search does not directly access the media objects Extraction, normalization and indexing of contentbased features Meaningful similarity/distance measures Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 24
25 1.1 Content-based Retrieval Retrieve all images showing a sunset! What exactly do these images have in common? Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 25
26 1.1 Schematic View Usually 2 main steps Example: image databases Image collection Digitization Image analysis and feature extraction Image database Creating the database Image query Digitization Querying the database Image analysis and feature extraction Similarity search Search result Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 26
27 1.1 Detailed View Query Result 3. Query preparation 5. Result preparation Query plan & feature values Result data 4. Similarity computation & query processing Feature values Raw & relational data 2. Extraction of features Raw data MM-Database 1. Insert into the database MM-Objects + relational data Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 27
28 Relevance feedback 1.1 More Detailed View Query Result Query preparation Result preparation Normalization Segmentation Feature extraction Optimization Medium transformation Format transformation Feature values Query plan Result data Similarity computation Query processing Feature values Feature index Feature extraction Feature recognition Feature preparation MM-Database BLOBs/CLOBs Pre-processing Decomposition Normalization Segmentation Relational DB Metadata Profile Structure data MM-Objects Relational data Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 28
29 1.2 Applications Lots of multimedia content on the Web Social networking e.g., Facebook, MySpace, Hi5, Orkut, etc. Photo sharing e.g., Flickr, Photobucket, Imeem, Picasa, etc. Video sharing e.g., YouTube, Megavideo, Metacafe, blip.tv, Liveleak, etc. Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 29
30 1.2 Applications Cameras are everywhere In London there are at least 500,000 cameras in the city, and one study showed that in a single day a person could expect to be filmed 300 times Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 30
31 1.2 Applications Picasa face recognition Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 31
32 1.2 Applications Picasa, face recognition example Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 32
33 1.2 Applications Picasa, learning phase Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 33
34 1.2 Applications Picasa example Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 34
35 1.2 Sample Scenario Consider a police investigation of a large-scale drug operation Possible generated data: Video data captured by surveillance cameras Audio data captured Image data consisting of still photographs taken by investigators Structured relational data containing background information Geographic information system data Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 35
36 1.2 Sample Scenario Possible queries Image query by keywords: police officer wants to examine pictures of Tony Soprano Query: retrieve all images from the image library in which Tony Soprano appears" Image query by example: the police officer has a photograph and wants to find the identity of the person in the picture He hopes that someone else has already tagged another photo of this person Query: retrieve all images from the database in which the person appearing in the (currently displayed) photograph appears Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 36
37 1.2 Sample Scenario Video Query: (Murder case) The police assumes that the killer must have interacted with the victim in the near past Query: Find all video segments from last week in which Jerry appears Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 37
38 1.2 Sample Scenario Heterogeneous Multimedia Query: Find all individuals who have been photographed with Tony Soprano and who have been convicted of attempted murder in New Jersey and who have recently had electronic fund transfers made into their bank accounts from ABC Corp. Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 38
39 1.2 Characteristics so there are different types of queries what about the MMDB characteristics? Static: high number of search queries (read access), few modifications of the data Dynamic: often modifications of the data Active: the functionality of the database leads to operations at application level Passive: database reacts only at requests from outside Standard search: queries are answered through the use of metadata e.g., Google-image search Retrieval functionality: content based search on the multimedia repository e.g., Picasa face recognition Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 39
40 1.2 Example Passive static retrieval Art historical use case Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 40
41 1.2 Example Possible hit in a multimedia database Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 41
42 1.2 Example Active dynamic retrieval Wetter warning through evaluation of satellite photos Extraction Typhoon-Warning for the Philippines Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 42
43 1.2 Example Standard search Queries are answered through the use of metadata e.g., Google-image search Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 43
44 1.2 Example Retrieval functionality Content based e.g., Picasa face recognition Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 44
45 1.3 Retrieval Evaluation Basic evaluation of retrieval techniques Efficiency of the system Efficient utilization of system resources Scalable also over big collections Effectivity of the retrieval process High quality of the result Meaningful usage of the system What is more important? An effective retrieval process or an efficient one? Depends on the application! Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 45
46 1.3 Evaluating Efficiency Characteristic values to measure efficiency are e.g.: Memory usage CPU-time Number of I/O-Operations Response time Depends on the (Hardware-) environment Goal: the system should be efficient enough! Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 46
47 1.3 Evaluating Effectivity Measuring effectivity is more difficult and always depending on the query We need to define some query-dependent evaluation measures! Objective quality metrics Independent from the querying interface and the retrieval procedure Allows for comparing different systems/algorithms Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 47
48 1.3 Evaluating Effectivity Effectivity can be measured regarding an explicit query Main focus on evaluating the behavior of the system with respect to a query Relevance of the result set But effectivity also needs to consider implicit information needs Main focus on evaluating the usefulness, usability and user friendliness of the system Not relevant for this lecure! Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 48
49 1.3 Relevance Relevance as a measure for retrieval: each document will be binary classified as relevant or irrelevant with respect to the query This classification is manually performed by experts The response of the system to the query will be compared to this classification Compare the obtained response with the ideal result Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 49
50 1.3 Involved Sets Then apply the automatic retrieval system: collection searched for (= relevant) found (= query result) Experts say: this is relevant The automatic retrieval says: this is relevant Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 50
51 1.3 False Positives False positives: irrelevant documents, classified as collection relevant by the system False alarms fd ca fa searched for found Needlessly increase the result set Usually inevitable (ambiguity) Can be easily eliminated by the user cd Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 51
52 1.3 False Negatives False negatives: relevant documents classified by collection the system as irrelevant False dismissals searched for Dangerous, since they cd can t be detected easily by the user Are there better documents in the collection which the system didn t return? False alarms are usually not as bad as false dismissals fd ca fa found Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 52
53 1.3 Remaining Sets Correct positives (correct alarms) All documents correctly classified by the system as relevant Correct negatives (correct dismissals) All documents correctly classified by the system as irrelevant All sets are disjunctive and their reunion is the collection entire document collection fd searched for ca cd fa found Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 53
54 1.3 Overview Confusion matrix: Userevaluation Systemevaluation relevant relevant ca irrelevant fd irrelevant fa cd Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 54
55 1.3 Interpretation Relevant results = fd + ca Handpicked by experts! Retrieved results = ca + fa Retrieved by the system collection fd searched for ca fa found cd Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 55
56 1.3 Precision Precision measures the ratio of correctly returned documents relative to all returned documents P = ca / (ca + fa) Value between [0, 1] (1 representing the best value) High number of false alarms mean worse results fd searched for collection ca cd fa found Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 56
57 1.3 Recall Recall measures the ratio of correctly returned documents relative to all relevant documents R = ca / (ca + fd) collection Value between [0, 1] (1 representing the best value) High number of false drops mean worse results fd searched for ca cd fa found Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 57
58 1.3 Precision-Recall Analysis Both measures only make sense, if considered at the same time E.g., get perfect recall by simply returning all documents, but then the precision is extremely low Can be balanced by tuning the system E.g., smaller result sets lead to better precision rates at the cost of recall Usually the average precision-recall of more queries is considered (macro evaluation) Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 58
59 1.3 Actual Evaluation collection Alarms (returned elements) fd ca fa divided in ca and fa searched for found Precision is easy to calculate cd Dismissals (not returned elements) are not so trivial to divide in cd und fd, because the entire collection has to be classified Recall is difficult to calculate Standardized Benchmarks Provided connections and queries Annotated result sets Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 59
60 1.3 TREC Text REtrieval Conference De-Facto-Standard since 1992 Establish average precision for 11 fixed recall points (0; 0,1; 0,2; ; 1) according to defined procedures (trec_eval) Different tracks, extended also for video data, Web retrieval and Question Answering Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 60
61 1.3 Example Query fa ca fd cd P R Q ,2 0,25 Q ,8 0,8 Average 0,5 0,525 Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 61
62 1.3 Representation Precision-Recall-Curves Average precision of the system 3 at a recall-level of 0,2 System 1 System 2 System 3 Which system is the best? What is more important: recall or precision? Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 62
63 Next lecture Retrieval of images by color Introduction to color spaces Color histograms Matching Multimedia Databases Wolf-Tilo Balke Institut für Informationssysteme TU Braunschweig 63
Multimedia Databases. 0. Organizational Issues. 0. Organizational Issues. 0. Organizational Issues. 0. Organizational Issues. 1.
0. Organizational Issues Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Lecture 22.10.2009 04.02.2010
More informationMultimedia Databases. 9 Video Retrieval. 9.1 Hidden Markov Model. 9.1 Hidden Markov Model. 9.1 Evaluation. 9.1 HMM Example 12/18/2009
9 Video Retrieval Multimedia Databases 9 Video Retrieval 9.1 Hidden Markov Models (continued from last lecture) 9.2 Introduction into Video Retrieval Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme
More informationMultimedia Databases. Wolf-Tilo Balke Younès Ghammad Institut für Informationssysteme Technische Universität Braunschweig
Multimedia Databases Wolf-Tilo Balke Younès Ghammad Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Previous Lecture Audio Retrieval - Query by Humming
More informationRelational Database Systems 2 1. System Architecture
Relational Database Systems 2 1. System Architecture Wolf-Tilo Balke Jan-Christoph Kalo Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 1 Organizational
More informationRelational Database Systems 2 1. System Architecture
Relational Database Systems 2 1. System Architecture Silke Eckstein Andreas Kupfer Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Organizational Information
More informationWolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig
Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 6 Audio Retrieval 6 Audio Retrieval 6.1 Basics of
More informationSummary. 4. Indexes. 4.0 Indexes. 4.1 Tree Based Indexes. 4.0 Indexes. 19-Nov-10. Last week: This week:
Summary Data Warehousing & Data Mining Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Last week: Logical Model: Cubes,
More informationInformation Retrieval and Web Search Engines
Information Retrieval and Web Search Engines Lecture 7: Document Clustering May 25, 2011 Wolf-Tilo Balke and Joachim Selke Institut für Informationssysteme Technische Universität Braunschweig Homework
More informationData Warehousing & Data Mining
Data Warehousing & Data Mining Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Summary Last week: Logical Model: Cubes,
More informationMultimedia Databases. 2. Summary. 2 Color-based Retrieval. 2.1 Multimedia Data Retrieval. 2.1 Multimedia Data Retrieval 4/14/2016.
2. Summary Multimedia Databases Wolf-Tilo Balke Younes Ghammad Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Last week: What are multimedia databases?
More informationCCRMA MIR Workshop 2014 Evaluating Information Retrieval Systems. Leigh M. Smith Humtap Inc.
CCRMA MIR Workshop 2014 Evaluating Information Retrieval Systems Leigh M. Smith Humtap Inc. leigh@humtap.com Basic system overview Segmentation (Frames, Onsets, Beats, Bars, Chord Changes, etc) Feature
More informationInformation Retrieval
Multimedia Computing: Algorithms, Systems, and Applications: Information Retrieval and Search Engine By Dr. Yu Cao Department of Computer Science The University of Massachusetts Lowell Lowell, MA 01854,
More information9/8/2016. Characteristics of multimedia Various media types
Chapter 1 Introduction to Multimedia Networking CLO1: Define fundamentals of multimedia networking Upon completion of this chapter students should be able to define: 1- Multimedia 2- Multimedia types and
More informationData Warehousing & Mining Techniques
2. Summary Data Warehousing & Mining Techniques Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Last week: What is a Data
More informationChapter 2 - Concepts and Definitions
Prof. Dr.-Ing. Stefan Deßloch AG Heterogene Informationssysteme Geb. 36, Raum 329 Tel. 0631/205 3275 dessloch@informatik.uni-kl.de Chapter 2 - Concepts and Definitions Introduction and Requirements Database
More informationVK Multimedia Information Systems
VK Multimedia Information Systems Mathias Lux, mlux@itec.aau.at This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Agenda Topics & goals Modalities & examination
More informationData Warehousing & Mining Techniques
Data Warehousing & Mining Techniques Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 2. Summary Last week: What is a Data
More information2. Summary. 2.1 Basic Architecture. 2. Architecture. 2.1 Staging Area. 2.1 Operational Data Store. Last week: Architecture and Data model
2. Summary Data Warehousing & Mining Techniques Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Last week: What is a Data
More informationMultimedia Databases
Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Previous Lecture Audio Retrieval - Low Level Audio
More informationInformation Retrieval and Web Search Engines
Information Retrieval and Web Search Engines Lecture 7: Document Clustering December 4th, 2014 Wolf-Tilo Balke and José Pinto Institut für Informationssysteme Technische Universität Braunschweig The Cluster
More informationData Warehouse and Data Mining
Data Warehouse and Data Mining Lecture No. 02 Lifecycle of Data warehouse Naeem Ahmed Email: naeemmahoto@gmail.com Department of Software Engineering Mehran Univeristy of Engineering and Technology Jamshoro
More information1. Inroduction to Data Mininig
1. Inroduction to Data Mininig 1.1 Introduction Universe of Data Information Technology has grown in various directions in the recent years. One natural evolutionary path has been the development of the
More informationOverview of Web Mining Techniques and its Application towards Web
Overview of Web Mining Techniques and its Application towards Web *Prof.Pooja Mehta Abstract The World Wide Web (WWW) acts as an interactive and popular way to transfer information. Due to the enormous
More informationCSCI 5417 Information Retrieval Systems. Jim Martin!
CSCI 5417 Information Retrieval Systems Jim Martin! Lecture 7 9/13/2011 Today Review Efficient scoring schemes Approximate scoring Evaluating IR systems 1 Normal Cosine Scoring Speedups... Compute the
More informationHello, I am from the State University of Library Studies and Information Technologies, Bulgaria
Hello, My name is Svetla Boytcheva, I am from the State University of Library Studies and Information Technologies, Bulgaria I am goingto present you work in progress for a research project aiming development
More informationMultimedia Systems. Lehrstuhl für Informatik IV RWTH Aachen. Prof. Dr. Otto Spaniol Dr. rer. nat. Dirk Thißen
Multimedia Systems Lehrstuhl für Informatik IV RWTH Aachen Prof. Dr. Otto Spaniol Dr. rer. nat. Dirk Thißen Page 1 Organization Lehrstuhl für Informatik 4 Lecture Lecture takes place on Thursday, 10:00
More informationNew Media Production week 3
New Media Production week 3 Multimedia ponpong@gmail.com What is Multimedia? Multimedia = Multi + Media Multi = Many, Multiple Media = Distribution tool & information presentation text, graphic, voice,
More informationMultimedia Databases. 8 Audio Retrieval. 8.1 Music Retrieval. 8.1 Statistical Features. 8.1 Music Retrieval. 8.1 Music Retrieval 12/11/2009
8 Audio Retrieval Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 8 Audio Retrieval 8.1 Query by Humming
More informationMultimedia Information Retrieval
Multimedia Information Retrieval Prof Stefan Rüger Multimedia and Information Systems Knowledge Media Institute The Open University http://kmi.open.ac.uk/mmis Multimedia Information Retrieval 1. What are
More informationAn Introduction to Content Based Image Retrieval
CHAPTER -1 An Introduction to Content Based Image Retrieval 1.1 Introduction With the advancement in internet and multimedia technologies, a huge amount of multimedia data in the form of audio, video and
More informationRelational Database Systems 1
Relational Database Systems 1 Wolf-Tilo Balke Benjamin Köhncke Institut für Informationssysteme Technische Universität Braunschweig www.ifis.cs.tu-bs.de 0. Organizational Issues Who is who? Wolf Tilo Balke
More informationKnowledge Retrieval. Franz J. Kurfess. Computer Science Department California Polytechnic State University San Luis Obispo, CA, U.S.A.
Knowledge Retrieval Franz J. Kurfess Computer Science Department California Polytechnic State University San Luis Obispo, CA, U.S.A. 1 Acknowledgements This lecture series has been sponsored by the European
More informationInformatica Enterprise Information Catalog
Data Sheet Informatica Enterprise Information Catalog Benefits Automatically catalog and classify all types of data across the enterprise using an AI-powered catalog Identify domains and entities with
More information5.3 Parser and Translator. 5.3 Parser and Translator. 5.3 Parser and Translator. 5.3 Parser and Translator. 5.3 Parser and Translator
5 Query Processing Relational Database Systems 2 5. Query Processing Silke Eckstein Andreas Kupfer Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 5.1 Introduction:
More informationLecture 19 Media Formats
Revision IMS2603 Information Management in Organisations Lecture 19 Media Formats Last week s lectures looked at MARC as a specific instance of complex metadata representation and at Content Management
More informationRelational Database Systems 2 5. Query Processing
Relational Database Systems 2 5. Query Processing Silke Eckstein Andreas Kupfer Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 5 Query Processing 5.1 Introduction:
More informationPart 11: Collaborative Filtering. Francesco Ricci
Part : Collaborative Filtering Francesco Ricci Content An example of a Collaborative Filtering system: MovieLens The collaborative filtering method n Similarity of users n Methods for building the rating
More informationDescription and search of multimedia data
Description and search of multimedia data Digital Content Retrieval Prof.ssa Maria Grazia Albanesi Topics The problem: searching in multimedia data Why is it different from text search? How to make a search
More informationDistributed Data Management
Distributed Data Management Profr. Dr. Wolf-Tilo Balke Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 3.0 Introduction 3.0 Query Processing 3.1 Basic Distributed
More informationINFSCI 2140 Information Storage and Retrieval Lecture 1: Introduction. INFSCI 2140 and your program
INFSCI 2140 Information Storage and Retrieval Lecture 1: Introduction Peter Brusilovsky http://www2.sis.pitt.edu/~peterb/2140-051/ INFSCI 2140 and your program Foundation course One of the key courses
More informationData Mining: Classifier Evaluation. CSCI-B490 Seminar in Computer Science (Data Mining)
Data Mining: Classifier Evaluation CSCI-B490 Seminar in Computer Science (Data Mining) Predictor Evaluation 1. Question: how good is our algorithm? how will we estimate its performance? 2. Question: what
More informationPattern recognition (4)
Pattern recognition (4) 1 Things we have discussed until now Statistical pattern recognition Building simple classifiers Supervised classification Minimum distance classifier Bayesian classifier (1D and
More informationDistributed Data Management
Distributed Data Management Wolf-Tilo Balke Christoph Lofi Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 2.0 Introduction 3.0 Query Processing 3.1 Basic
More informationMPEG-7. Multimedia Content Description Standard
MPEG-7 Multimedia Content Description Standard Abstract The purpose of this presentation is to provide a better understanding of the objectives & components of the MPEG-7, "Multimedia Content Description
More informationMulti-modal Information Retrieval experiences from Context-Aware Image Management, CAIM
Multi-modal Information Retrieval experiences from Context-Aware Image Management, CAIM Joan Nordbotten Dept. Of Information and Media Science University of Bergen, Norway 1 Outline Multi-modal Information
More informationRelational Database Systems 2 5. Query Processing
Relational Database Systems 2 5. Query Processing Silke Eckstein Benjamin Köhncke Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 4 Trees & Advanced Indexes
More informationMULTIMEDIA DATABASES OVERVIEW
MULTIMEDIA DATABASES OVERVIEW Recent developments in information systems technologies have resulted in computerizing many applications in various business areas. Data has become a critical resource in
More informationMultimedia Database Systems. Retrieval by Content
Multimedia Database Systems Retrieval by Content MIR Motivation Large volumes of data world-wide are not only based on text: Satellite images (oil spill), deep space images (NASA) Medical images (X-rays,
More informationMultimedia on the Web
Multimedia on the Web Graphics in web pages Downloading software & media Digital photography JPEG & GIF Streaming media Macromedia Flash Graphics in web pages Graphics are very popular in web pages Graphics
More informationIntroductory Visualizing Technology
Introductory Visualizing Technology Seventh Edition Chapter 6 Digital Devices and Multimedia Learning Objectives 6.1 Explain the Features of Digital Cameras 6.2 Compare Methods for Transferring Images
More informationSo, what is data compression, and why do we need it?
In the last decade we have been witnessing a revolution in the way we communicate 2 The major contributors in this revolution are: Internet; The explosive development of mobile communications; and The
More information- Content-based Recommendation -
- Content-based Recommendation - Institute for Software Technology Inffeldgasse 16b/2 A-8010 Graz Austria 1 Content-based recommendation While CF methods do not require any information about the items,
More informationFeature Selection in Learning Using Privileged Information
November 18, 2017 ICDM 2017 New Orleans Feature Selection in Learning Using Privileged Information Rauf Izmailov, Blerta Lindqvist, Peter Lin rizmailov@vencorelabs.com Phone: 908-748-2891 Agenda Learning
More informationMultimedia Systems. Part 1. Mahdi Vasighi
Multimedia Systems Part 1 Mahdi Vasighi www.iasbs.ac.ir/~vasighi Department of Computer Science and Information Technology, Institute for Advanced Studies in Basic Sciences, Zanjan, Iran Teaching Plan
More informationCSI 4107 Image Information Retrieval
CSI 4107 Image Information Retrieval This slides are inspired by a tutorial on Medical Image Retrieval by Henning Müller and Thomas Deselaers, 2005-2006 1 Outline Introduction Content-based image retrieval
More informationRelational Database Systems 1
Relational Database Systems 1 Wolf-Tilo Balke Simon Barthel Institut für Informationssysteme Technische Universität Braunschweig www.ifis.cs.tu-bs.de 10.0 Introduction Up to now, we have learned......
More informationIntroduction to Similarity Search in Multimedia Databases
Introduction to Similarity Search in Multimedia Databases Tomáš Skopal Charles University in Prague Faculty of Mathematics and Phycics SIRET research group http://siret.ms.mff.cuni.cz March 23 rd 2011,
More informationData Warehousing & Data Mining
Data Warehousing & Data Mining Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Summary Last Week: Optimization - Indexes
More informationCOMP6237 Data Mining Searching and Ranking
COMP6237 Data Mining Searching and Ranking Jonathon Hare jsh2@ecs.soton.ac.uk Note: portions of these slides are from those by ChengXiang Cheng Zhai at UIUC https://class.coursera.org/textretrieval-001
More informationWorkshop W14 - Audio Gets Smart: Semantic Audio Analysis & Metadata Standards
Workshop W14 - Audio Gets Smart: Semantic Audio Analysis & Metadata Standards Jürgen Herre for Integrated Circuits (FhG-IIS) Erlangen, Germany Jürgen Herre, hrr@iis.fhg.de Page 1 Overview Extracting meaning
More informationdoc. RNDr. Tomáš Skopal, Ph.D. Department of Software Engineering, Faculty of Information Technology, Czech Technical University in Prague
Praha & EU: Investujeme do vaší budoucnosti Evropský sociální fond course: Searching the Web and Multimedia Databases (BI-VWM) Tomáš Skopal, 2011 SS2010/11 doc. RNDr. Tomáš Skopal, Ph.D. Department of
More informationMultimedia Information Systems
Multimedia Information Systems Samson Cheung EE 639, Fall 2004 Lecture 6: Text Information Retrieval 1 Digital Video Library Meta-Data Meta-Data Similarity Similarity Search Search Analog Video Archive
More informationInformation Systems (Informationssysteme)
Information Systems (Informationssysteme) Jens Teubner, TU Dortmund jens.teubner@cs.tu-dortmund.de Summer 2017 c Jens Teubner Information Systems Summer 2017 1 A Few Words About Me Jens Teubner DBIS Group
More informationOutline. Database Theory. Prerequisites and Admission. Classes VU , SS 2018
Database Theory Database Theory Outline Database Theory VU 181.140, SS 2018 0. General Information Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 6 March,
More informationRelational Database Systems 1
Relational Database Systems 1 Wolf-Tilo Balke Benjamin Köhncke Institut für Informationssysteme Technische Universität Braunschweig www.ifis.cs.tu-bs.de Overview Motivation Relational Algebra Query Optimization
More informationPresentational aids should be used for the right reasons in the right ways
MPS Chap. 14 Using Presentational Aids Presentational aids should be used for the right reasons in the right ways In a way, they are an extension of delivery extending your media of presentation beyond
More informationLecture #3: Digital Music and Sound
Lecture #3: Digital Music and Sound CS106E Spring 2018, Young In this lecture we take a look at how computers represent music and sound. One very important concept we ll come across when studying digital
More informationGraphics in IT82. Representing Graphical Data. Graphics in IT82. Lectures Overview. Representing Graphical Data. Logical / Physical Representation
Graphics in IT82 What does computer graphics cover? Representing Graphical Data Chapman & Chapman, chapters 3,4,5 Richardson IT82 Input, output, and representation of graphical data Creation of graphics
More informationCompSci 125 Lecture 02
Assignments CompSci 125 Lecture 02 Java and Java Programming with Eclipse! Homework:! http://coen.boisestate.edu/jconrad/compsci-125-homework! hw1 due Jan 28 (MW), 29 (TuTh)! Programming:! http://coen.boisestate.edu/jconrad/cs125-programming-assignments!
More informationCISC 7610 Lecture 4 Approaches to multimedia databases
CISC 7610 Lecture 4 Approaches to multimedia databases Topics: Metadata Loose vs tight coupling of data and metadata Object (oriented) databases Graph databases Object-relational mapping Homework 1 Entity-relationship
More informationCSE 132A. Database Systems Principles
CSE 132A Database Systems Principles Prof. Victor Vianu 1 Data Management An evolving, expanding field: Classical stand-alone databases (Oracle, DB2, SQL Server) Computer science is becoming data-centric:
More informationIn this lesson we are going to review some of the most used scanning devices.
As you may know, when we use the term scanner we refer to image scanners, but if we check the definition of the term scan, we can see that more devices fit in the description: Scan is to examine some object
More information0. Organizational Issues. 0. Why should you be here? 0. Why should you be here? 0. Why should you be here? Relational Database Systems
0. Organizational Issues Relational Database Systems 1 Wolf-Tilo Balke Christoph Lofi Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Lecture 07. November
More informationDatabase System Concepts and Architecture
CHAPTER 2 Database System Concepts and Architecture Copyright 2017 Ramez Elmasri and Shamkant B. Navathe Slide 2-2 Outline Data Models and Their Categories History of Data Models Schemas, Instances, and
More informationCS4670: Computer Vision
CS4670: Computer Vision Noah Snavely Lecture 6: Feature matching and alignment Szeliski: Chapter 6.1 Reading Last time: Corners and blobs Scale-space blob detector: Example Feature descriptors We know
More informationInformation Retrieval Spring Web retrieval
Information Retrieval Spring 2016 Web retrieval The Web Large Changing fast Public - No control over editing or contents Spam and Advertisement How big is the Web? Practically infinite due to the dynamic
More informationRepresenting Graphical Data
Representing Graphical Data Chapman & Chapman, chapters 3,4,5 Richardson 1 Graphics in IT82 What does computer graphics cover? IT82 Input, output, and representation of graphical data Creation of graphics
More informationIntroduction to Database Systems. Motivation. Werner Nutt
Introduction to Database Systems Motivation Werner Nutt 1 Databases Are Everywhere Database = a large (?) collection of related data Classically, a DB models a real-world organisation (e.g., enterprise,
More informationB.H.GARDI COLLEGE OF MASTER OF COMPUTER APPLICATION. Ch. 1 :- Introduction Database Management System - 1
Basic Concepts :- 1. What is Data? Data is a collection of facts from which conclusion may be drawn. In computer science, data is anything in a form suitable for use with a computer. Data is often distinguished
More informationMultimedia Search Engine
사례조사 Multimedia Search Engine YeRim Choi iangoozh@gmail.com Information Management Lab Dept. of Industrial Engineering November 6 th, 2011 Seoul National University Information Universe 2nd Semester, 2011
More informationLATIHAN Identify the use of multimedia in various fields.
LATIHAN 4.1 1. Define multimedia. Multimedia is the presentation of information by using a combination of text, audio, graphic, video and animation. Multimedia has played an important role in other fields,
More informationTopic 2 Data and Information. Data Data can be defined as a set of recorded facts, numbers or events that have no meaning.
Topic 2 Data and Information Key The Key concepts for this topic are: Data Date is processed to produce information Information 2.1 What is Data? Data Data can be defined as a set of recorded facts, numbers
More informationLecture Information Multimedia Video Coding & Architectures
Multimedia Video Coding & Architectures (5LSE0), Module 01 Introduction to coding aspects 1 Lecture Information Lecturer Prof.dr.ir. Peter H.N. de With Faculty Electrical Engineering, University Technology
More informationInformation Retrieval and Knowledge Organisation
Information Retrieval and Knowledge Organisation Knut Hinkelmann Content Information Retrieval Indexing (string search and computer-linguistic aproach) Classical Information Retrieval: Boolean, vector
More informationMultimedia Information Extraction and Retrieval Term Frequency Inverse Document Frequency
Multimedia Information Extraction and Retrieval Term Frequency Inverse Document Frequency Ralf Moeller Hamburg Univ. of Technology Acknowledgement Slides taken from presentation material for the following
More informationDatabase System Concepts and Architecture
1 / 14 Data Models and Their Categories History of Data Models Schemas, Instances, and States Three-Schema Architecture Data Independence DBMS Languages and Interfaces Database System Utilities and Tools
More informationCopyright 2016 Ramez Elmasri and Shamkant B. Navathe
Copyright 2016 Ramez Elmasri and Shamkant B. Navathe CHAPTER 1 Databases and Database Users Copyright 2016 Ramez Elmasri and Shamkant B. Navathe Slide 1-2 OUTLINE Types of Databases and Database Applications
More informationIntroduction: Databases and. Database Users
Types of Databases and Database Applications Basic Definitions Typical DBMS Functionality Example of a Database (UNIVERSITY) Main Characteristics of the Database Approach Database Users Advantages of Using
More informationDr. Angelika Reiser Chair for Database Systems (I3)
Introduction Dr. Angelika Reiser Chair for Database Systems (I3) www-db.in.tum.de de TU München / Garching reiser@in.tum.de Lecture Web page of the lecture: see TUMonline www-db.in.tum.de/teaching/ws1617/dbsandere
More informationMINI MOCK (MIMO) Computer Science 2210
MINI MOCK (MIMO) Computer Science 2210 For Class 9th Abstract The Mini Mock examination paper for Final Term 2016-17 INSTRUCTIONS This Mini Mock paper is designed to test your preparation for Final-Term
More informationHomework: Exercise 19. Homework: Exercise 21. Homework: Exercise 20. Homework: Exercise 22. Detour: Apache Lucene
Homework: Exercise 19 Are the following statements true or false? Information Retrieval and Web Search Engines In a Boolean retrieval system, stemming never lowers precision Lecture 10: Introduction to
More informationCopyright 2007 Ramez Elmasri and Shamkant B. Navathe. Slide 1-1
Slide 1-1 Chapter 1 Introduction: Databases and Database Users Outline Types of Databases and Database Applications Basic Definitions Typical DBMS Functionality Example of a Database (UNIVERSITY) Main
More informationDifferent File Types and their Use
Different File Types and their Use.DOC (Microsoft Word Document) Text Files A DOC file is a Word processing document created by Microsoft Word, a word processor included with all versions of Microsoft
More informationRelational Database Systems 1
Relational Database Systems 1 Wolf-Tilo Balke Simon Barthel Institut für Informationssysteme Technische Universität Braunschweig www.ifis.cs.tu-bs.de Overview Advanced database concepts for application
More informationCC PROCESAMIENTO MASIVO DE DATOS OTOÑO 2018
CC5212-1 PROCESAMIENTO MASIVO DE DATOS OTOÑO 2018 Lecture 1: Introduction Aidan Hogan aidhog@gmail.com THE VALUE OF DATA Soho, London, 1854 Cholera: What we know now Cholera: What we knew in 1854 1854:
More informationYour very own movie studio. menu bar
Movie Maker This presentation will get you started with using Windows Movie Maker - Your very own movie studio. It provides step by step instructions for adding photos, videos, audio files etc. Quickly
More informationIdentifying Important Communications
Identifying Important Communications Aaron Jaffey ajaffey@stanford.edu Akifumi Kobashi akobashi@stanford.edu Abstract As we move towards a society increasingly dependent on electronic communication, our
More information3.01C Multimedia Elements and Guidelines Explore multimedia systems, elements and presentations.
3.01C Multimedia Elements and Guidelines 3.01 Explore multimedia systems, elements and presentations. Multimedia Fair Use Guidelines Guidelines for using copyrighted multimedia elements include: Text Motion
More informationRelational Database Systems 1 Wolf-Tilo Balke Hermann Kroll
Relational Database Systems 1 Wolf-Tilo Balke Hermann Kroll Institut für Informationssysteme Technische Universität Braunschweig www.ifis.cs.tu-bs.de 0. Organizational Issues Who is who? Wolf-Tilo Balke
More informationRelational Database Systems 1 Wolf-Tilo Balke Hermann Kroll, Janus Wawrzinek, Stephan Mennicke
Relational Database Systems 1 Wolf-Tilo Balke Hermann Kroll, Janus Wawrzinek, Stephan Mennicke Institut für Informationssysteme Technische Universität Braunschweig www.ifis.cs.tu-bs.de 10.0 Introduction
More information