Multimedia Databases. 9 Video Retrieval. 9.1 Hidden Markov Model. 9.1 Hidden Markov Model. 9.1 Evaluation. 9.1 HMM Example 12/18/2009
|
|
- Brandon Hodges
- 5 years ago
- Views:
Transcription
1 9 Video Retrieval Multimedia Databases 9 Video Retrieval 9.1 Hidden Markov Models (continued from last lecture) 9.2 Introduction into Video Retrieval Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Hidden Markov Model A HMM has at any time additional timeinvariant observation probabilities A HMM consists of A homogeneous Markov process with state set Transition probabilities 9.1 Hidden Markov Model Start distribution Stochastic process of observations with basic sets And observation probabilities of observation o k in state q j Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 3 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig HMM Example Observations: Observation probability Given the observation sequence and a fixed HMM λ How high is the probability that λ has generated the observation sequence? =? Important for selecting between different models Type 1 Type 2 Type 3 Type 4 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 5 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 6 1
2 Let Then: be a state sequence Furthermore is also valid And is valid for Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 7 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 8 Thus the total probability for observation O is: Substituting in our previous results we obtain: Most probable state sequence Given the observation sequence and a fixed HMM λ What is the state sequence which generates the observation sequence o, with the highest probability? Maximum likelihood estimator: maximize Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 9 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 10 Because we know that and that is constant for fixed sequences of observations, instead of maximizing we can also maximize Definition: Maximal for the most probable path leading to the state q i (at time t) is valid Therefore corresponds to a state sequence assuming that the occurrence of the observation sequence O, is the most likely Such a path can be constructed in steps by means of dynamic programming, via Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 11 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 12 2
3 The corresponding algorithm is the Viterbi algorithm (Viterbi, 1967) Initial step: for set For inductively set Termination: Recursive path identification for probability p: for t [1 : T -1] set Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 13 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 14 Given a fixed HMM, for each sequence of observations, the Viterbi algorithm provides a sequence of states which has most probably caused the observations (Maximum likelihood estimator) Problem: Transition-, observationand start probabilities are often unknown Idea: training the parameters of the HMM λ Given an observation sequence training sequence Task: determine the model parameters λ = (A, B, π) to maximize Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 15 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 16 The training sequence should not be too short The maximization of the probability leads to a high-dimensional optimization problem Solved e.g., through the Baum-Welch algorithm, which calculates a local optimum (Baum and others, 1970) Baum-Welch algorithm: Begin with an initial estimate of parameters: either arbitrary or based on additional knowledge Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 17 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 18 3
4 These statistics can be used for an iterative reestimation of the parameters Define forward variables: Then: and And backward variables: for and for is valid, for Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 19 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 20 Then, the probability to be in q i at timet if o has been observed, is: And the probability to be at time t in state q i and at time t+1 in state q j is: (conditional probability) (conditional probability) Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 21 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 22 Then, the expected value of the number of times, state q i was left from, is: The Baum-Welch algorithm then sets in the r-th iteration (r 0): And the expected value of the number of transitions from q i to q j is given by: with defined by,, Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 23 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 24 4
5 ,, are the initial values The new estimated values are defined by: = (#expected transitions from q i to q j )/ (#expected transitions from q i ) Where has the value 1 if state o k was observed at time t in the training sequence, and otherwise the value 0 If there are several training sequences, indicates the corresponding relative frequencies Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 25 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 26 Now if we build for each parameter re-estimation HMM then we can shown that: Thus, models with newer estimates get better until a (at least local) maximum is reached 9.1 Applications of HMMs Back to music recognition Feature extraction tries to convert a signal into a string Encoding acoustic events Music signals are sequences of acoustic events Segment the audio file, and determine the acoustic events for each segment The implementation of any acoustic event can be described by a state sequence of a HMM Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 27 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Back to Music Recognition If there are several models for acoustic events, we can use a maximum likelihood estimator, to identify the model which generates the observation sequence with the highest overall probability 9.1 Idea Train H HMMs Training by manual (small H) or automatic (large H) mapping between acoustic events and segments (observation sequences) of a signal Each HMM represents a specific acoustic event Then determine the most probable producer and attribute to each segment, the corresponding event Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 29 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 30 5
6 9.1 Training example 9.1 Training example Extracted segments are used as training examples for the HMMs of the corresponding events If the following feature sequence belongs to A, after appropriate quantization then this observation sequence will be used: Assignment of two segments to events A and B Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 31 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Often used HMMs Complete HMM (ergodic model); e.g., with 3 states: 9.1 Often used HMMs Left-right model (Bakis model); e.g., with 3 states Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 33 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Feature Extraction with HMMs Given: a sequence of observations from feature sequence of length T: Goal: find sequence so that feature subsequence is associated to HMM Example: given o 1, o 2, o 3, o 4, o 5 and 3 HMM models λ 1, λ 2, λ 3 (2, 1), (1, 3), (3, 4) which associates: λ 2 with(o 1, o 2 ) λ 1 with(o 3 ) and λ 3 with(o 4, o 5 ) 9.1 Realization Combine all H HMM graphs completely (with equal probability) Embedded in a macro-hmm We can start with any model and migrate to any other model Any sequence of acoustic events can be represented in the macro-hmm Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 35 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 36 6
7 9.1 Realization The macro-hmm behaves like a normal HMM All possible events are equally represented in the macro-hmm With the Viterbi algorithm we can establish the most probable state sequence 9.1 Illustration Macro-HMM with as the graph corresponding to HMM H = 4 Example for H = 4 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 37 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Illustration For each single HMM graph we need of course only to completely connect the states in the macro graphs, which may occur as a start and end states 9.1 Problems in Real Applications The data stream can be an infinite sequence feature, and it is not clear exactly when an event begins Build a sequence of sub-sequences and apply the Viterbi algorithm to each subsequence Unfortunately, with complexity of Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 39 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Problems in Real Applications How do we choose the best window size w for the sub-sequences? Choose w sufficiently large so that a higher number of HMM graphs can be traversed If while passing through the various paths of the macro-hmm with the Viterbi algorithm, a sufficiently large probability value occurs, then break the computation and return the HMMs we have traversed until then and the corresponding time points Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig HMM by example HMM with Matlab HMM generation Most probable state sequence Viterbi algorithm Training Baum-Welch algorithm Observations: O1 O2 O3 O4 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig
8 9.1 HMM by example Classify pig coughs into morbid or healthy by using HMM 9.1 HMM by example Extract features e.g., spectrogram of a pig cough Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 43 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig HMM by example Find a HMM which represents a pig cough as good as possible 9.1 HMM by example Train (Baum-Welch algorithm) the HMM for different cough types (vary diseases), e.g., Pasteurella disease Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 45 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig HMM by example When a pig coughs use the Viterbi algorithm, to establish if the pig is ill or not! 9.2 Video Retrieval Video data Increasingly important for exchanging information Illustrative clips (simulations, animations, etc.) Presentations, lectures Video conferencing... Particularly more frequently on the internet e.g., YouTube, video on demand,... Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 47 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 48 8
9 9.2 Video Data Cautious estimates 6-7 million hours approximately (800 years) video are already available on the Internet (2006) In 2008 a YouTube search returned more than 80 million videos and 3 million user channels So, it's safe to say that the total number is currently well into 100 million videos Until 2010, video data will represent approximately 50% of the stored digital data volume Management of video data is among others a problem of scalability 9.2 Video Data Regarding video data, it is necessary to efficiently: Store it Make it accessible And be able to recover it Today's databases Blobs, smart blobs Retrieval on metadata Splitting into key-frames Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 49 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 50 Example: IBM AIV Extenders for IBM DB2 UDB (Development now discontinued) Incorporating the QBIC prototype into a commercial database Description on the IBM Web site: DB2 Video Extender adds the power of video retrieval to SQL queries. You can integrate video data and traditional business data in a single query. For example, you can query a news database for video news clips about a specific subject, and list the playing time of each video clip. Then use the Video Extender to play the video clips. IBM ( Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 51 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 52 Example usage: For example, an advertising agency stores information about its campaigns in a DB2 database and uses DB2 AIV Extenders to store its print ads, broadcast and video ads. One SQL query can retrieve multimedia data, such as print or broadcast ads for a particular year or client, as well as related business data in the database. Using DB2 Video Extender, you can define new data types and functions for video data using DB2 Universal Database s built-in support for user-defined types and user-defined functions. Secure and recover video data. Video clips and their attributes that you store in a DB2 database are afforded the same security and recovery protection as traditional business data. IBM ( IBM ( Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 53 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 54 9
10 Goal: allows you to store and query video data as easily as you can traditional data Import and export video clips and their attributes into and out of a database. When you import a video clip, the DB2 Video Extender stores and maintains video attributes such as frame rate, compression format, and number of video tracks. Query video clips based on related business data or by video attributes. You can search for video clips based on data that you maintain, such as a name, number, or description; or by data that the DB2 Video Extender maintains, such as the format of the video or the date and time that it was last updated. IBM ( IBM ( Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 55 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Video Retrieval Topics Play video clips. You can use the DB2 Video Extender to retrieve a video clip. You can then use the DB2 Video Extender to invoke your favorite video browser to play the video clip. The DB2 Video Extender supports a variety of video file formats, and can work with different file-based video servers. Main problems: continuous medium Composed of several streams Image stream with visual information (often different views / camera angle of a scene) Audio stream (usually more than 1, e.g., synchronous tracks on DVDs) Stream of text (subtitles, news flash...) IBM ( Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 57 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Video Retrieval Topics 9.2 Video Retrieval Topics Main problems: organization Video is a structured medium in time and space Videos can not be seen as a set of individual frames, but as a document Video abstraction decomposes video clips into structured parts (visual table of contents) How do queries work in video retrieval? Specification of certain features in SQL (as in the IBM extender) Specification of semantic content? E.g., via keywords: news about politics Query by example? One possibility are sample images: Find all the movies with this actor Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 59 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 60 10
11 9.2 Video Retrieval Topics 9.2 Retrieval Technology Retrieval technology: comprises all the other problem groups Image Retrieval for the description of independent images, key frames, etc. Audio Retrieval for the evaluation of the sound track, voice recognition, etc. Text retrieval for the search in any subtitles, summaries, transcriptions of the audio track, etc. However, these techniques can also be combined in the case of video data Person recognition using segmentation and detection of subtitles Assignment based on the actor's voice Classify objects by shape and speech information Detect exciting sports scenes by the audience's applause, etc. Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 61 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Other Features 9.2 Other Features Other features which don t occur in image, audio and text retrieval, affect the detection of the temporal behavior of objects in space Movement of objects (direction, speed), instead of simple recognition as in the image retrieval E.g., Car moves slowly from left to right or two people walk together Recognition of movement is normally done through the comparison of shapes in a sequence of images In one frame e.g., by edge detection Transforming shapes in successive images using translation, rotation and scaling If successful, the type of transformation provides information about the parameters of motion Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 63 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Other Features 9.2 Other Features The extraction of moving objects is supported in MPEG-4 encoded streams Separate compression of background and the (moving) foreground objects Since fore-/background elements change only little, we only need to detect shifts and possibly changes in the camera angle Detection of camera movement Changes in camera angle (zooming, fade in/out,...) Movement of the camera itself (e.g., through background analysis Recognition through various models for the individual effects Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 65 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 66 11
12 9.2 Other Features Time/place relationships Object motion results in trajectories in time and space Intersection of trajectories (e.g., car accidents on the observed crossings) Comparisons between different media E.g., all the videos with a movement from the upper right corner to lower left corner 9.2 Result Presentation Retrieval of the best videos is very expensive, the quality is difficult to evaluate Retrieval result as a set of video abstractions Summary sequences provide an overview of the content, usually with annotated key frames Highlights are scene cuts of certain video passages (trailer) Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 67 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig Application of Video Retrieval Personal news (all clips on interesting topics) Entertainment Automatic recognition of film genres (love story, action movie, comedy,...) Detection of advertising in TV Automatic recording of material from the television Next lecture Video Abstraction Shot Detection Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 69 Multimedia Databases Wolf-TiloBalke InstitutfürInformationssysteme TU Braunschweig 70 12
Multimedia Databases. Wolf-Tilo Balke Younès Ghammad Institut für Informationssysteme Technische Universität Braunschweig
Multimedia Databases Wolf-Tilo Balke Younès Ghammad Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Previous Lecture Audio Retrieval - Query by Humming
More informationMultimedia Databases. 0. Organizational Issues. 0. Organizational Issues. 0. Organizational Issues. 0. Organizational Issues. 1.
0. Organizational Issues Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Lecture 22.10.2009 04.02.2010
More informationSummary. 4. Indexes. 4.0 Indexes. 4.1 Tree Based Indexes. 4.0 Indexes. 19-Nov-10. Last week: This week:
Summary Data Warehousing & Data Mining Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Last week: Logical Model: Cubes,
More informationMultimedia Databases
Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 0 Organizational Issues Lecture 07.04.2011 14.07.2011
More informationWolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig
Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 6 Audio Retrieval 6 Audio Retrieval 6.1 Basics of
More informationSearching Video Collections:Part I
Searching Video Collections:Part I Introduction to Multimedia Information Retrieval Multimedia Representation Visual Features (Still Images and Image Sequences) Color Texture Shape Edges Objects, Motion
More informationMultimedia Databases. 8 Audio Retrieval. 8.1 Music Retrieval. 8.1 Statistical Features. 8.1 Music Retrieval. 8.1 Music Retrieval 12/11/2009
8 Audio Retrieval Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 8 Audio Retrieval 8.1 Query by Humming
More informationLesson 11. Media Retrieval. Information Retrieval. Image Retrieval. Video Retrieval. Audio Retrieval
Lesson 11 Media Retrieval Information Retrieval Image Retrieval Video Retrieval Audio Retrieval Information Retrieval Retrieval = Query + Search Informational Retrieval: Get required information from database/web
More informationAUTOMATIC VIDEO INDEXING
AUTOMATIC VIDEO INDEXING Itxaso Bustos Maite Frutos TABLE OF CONTENTS Introduction Methods Key-frame extraction Automatic visual indexing Shot boundary detection Video OCR Index in motion Image processing
More informationMultimedia Databases
Multimedia Databases Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Previous Lecture Audio Retrieval - Low Level Audio
More informationCHAPTER 8 Multimedia Information Retrieval
CHAPTER 8 Multimedia Information Retrieval Introduction Text has been the predominant medium for the communication of information. With the availability of better computing capabilities such as availability
More informationBluray (
Bluray (http://www.blu-ray.com/faq) MPEG-2 - enhanced for HD, also used for playback of DVDs and HDTV recordings MPEG-4 AVC - part of the MPEG-4 standard also known as H.264 (High Profile and Main Profile)
More informationTips on DVD Authoring and DVD Duplication M A X E L L P R O F E S S I O N A L M E D I A
Tips on DVD Authoring and DVD Duplication DVD Authoring - Introduction The postproduction business has certainly come a long way in the past decade or so. This includes the duplication/authoring aspect
More informationSection 2 - Part A - Setup Start Time End Time Duration Recording Section Overview 0:00 0:33 0:33 Recording Setup Overview 0:33 0:54 0:21 Recording Au
Section 1 - Part A - Course Introduction Start Time End Time Duration Preparation Overview 0:00 0:49 0:49 Welcome and Congratulations! 0:49 1:26 0:37 Course Overview 1:26 2:52 1:26 Course Resources 2:52
More informationOptimal Video Adaptation and Skimming Using a Utility-Based Framework
Optimal Video Adaptation and Skimming Using a Utility-Based Framework Shih-Fu Chang Digital Video and Multimedia Lab ADVENT University-Industry Consortium Columbia University Sept. 9th 2002 http://www.ee.columbia.edu/dvmm
More informationSummary. Summary. 5. Optimization. 5.1 Partitioning. 5.1 Partitioning. 26-Nov-10. B-Trees are not fit for multidimensional data R-Trees
Summary Data Warehousing & Data Mining Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de B-Trees are not fit for multidimensional
More informationIntroduzione alle Biblioteche Digitali Audio/Video
Introduzione alle Biblioteche Digitali Audio/Video Biblioteche Digitali 1 Gestione del video Perchè è importante poter gestire biblioteche digitali di audiovisivi Caratteristiche specifiche dell audio/video
More information!!!!!! Portfolio Summary!! for more information July, C o n c e r t T e c h n o l o g y
Portfolio Summary July, 2014 for more information www.concerttechnology.com bizdev@concerttechnology.com C o n c e r t T e c h n o l o g y Overview The screenplay project covers emerging trends in social
More informationInformation Retrieval and Web Search Engines
Information Retrieval and Web Search Engines Lecture 7: Document Clustering December 4th, 2014 Wolf-Tilo Balke and José Pinto Institut für Informationssysteme Technische Universität Braunschweig The Cluster
More informationHIDDEN MARKOV MODELS AND SEQUENCE ALIGNMENT
HIDDEN MARKOV MODELS AND SEQUENCE ALIGNMENT - Swarbhanu Chatterjee. Hidden Markov models are a sophisticated and flexible statistical tool for the study of protein models. Using HMMs to analyze proteins
More informationUsing Hidden Markov Models to analyse time series data
Using Hidden Markov Models to analyse time series data September 9, 2011 Background Want to analyse time series data coming from accelerometer measurements. 19 different datasets corresponding to different
More informationThe Muvipix.com Guide to CyberLink PowerDirector 15 Ultimate
The Muvipix.com Guide to CyberLink PowerDirector 15 Ultimate The Muvipix.com Guide to CyberLink PowerDirector 15 Ultimate Section 1: PowerDirector Basics Chapter 1 Get to Know PowerDirector 15... 3 What
More informationModeling time series with hidden Markov models
Modeling time series with hidden Markov models Advanced Machine learning 2017 Nadia Figueroa, Jose Medina and Aude Billard Time series data Barometric pressure Temperature Data Humidity Time What s going
More informationVideo search requires efficient annotation of video content To some extent this can be done automatically
VIDEO ANNOTATION Market Trends Broadband doubling over next 3-5 years Video enabled devices are emerging rapidly Emergence of mass internet audience Mainstream media moving to the Web What do we search
More informationECE521: Week 11, Lecture March 2017: HMM learning/inference. With thanks to Russ Salakhutdinov
ECE521: Week 11, Lecture 20 27 March 2017: HMM learning/inference With thanks to Russ Salakhutdinov Examples of other perspectives Murphy 17.4 End of Russell & Norvig 15.2 (Artificial Intelligence: A Modern
More informationChapter 11.3 MPEG-2. MPEG-2: For higher quality video at a bit-rate of more than 4 Mbps Defined seven profiles aimed at different applications:
Chapter 11.3 MPEG-2 MPEG-2: For higher quality video at a bit-rate of more than 4 Mbps Defined seven profiles aimed at different applications: Simple, Main, SNR scalable, Spatially scalable, High, 4:2:2,
More informationReal-Time Content-Based Adaptive Streaming of Sports Videos
Real-Time Content-Based Adaptive Streaming of Sports Videos Shih-Fu Chang, Di Zhong, and Raj Kumar Digital Video and Multimedia Group ADVENT University/Industry Consortium Columbia University December
More informationPowerDirector Basics. Section 1. The Muvipix.com Guide to CyberLink PowerDirector 12 Ultimate. Chapter 1 Get to Know PowerDirector 12...
The Muvipix.com Guide to CyberLink PowerDirector 12 Ultimate Section 1 PowerDirector Basics Chapter 1 Get to Know PowerDirector 12... 3 What s what and what it does Welcome to easy yet powerful moviemaking!
More information4-H VIDEO SCORECARD 4-H VIDEO SCORECARD. Points Scored
REPORTER REPORTER Preparation Attached list of questions for interview 20 ~ Poise/coordination with camera operator 20 ~ Clear speech 20 ~ Expression/body language 10 ~ Appropriate attire 10 ~ Smooth introduction
More information8.5 Application Examples
8.5 Application Examples 8.5.1 Genre Recognition Goal Assign a genre to a given video, e.g., movie, newscast, commercial, music clip, etc.) Technology Combine many parameters of the physical level to compute
More informationHidden Markov Models. Slides adapted from Joyce Ho, David Sontag, Geoffrey Hinton, Eric Xing, and Nicholas Ruozzi
Hidden Markov Models Slides adapted from Joyce Ho, David Sontag, Geoffrey Hinton, Eric Xing, and Nicholas Ruozzi Sequential Data Time-series: Stock market, weather, speech, video Ordered: Text, genes Sequential
More informationDetection of goal event in soccer videos
Detection of goal event in soccer videos Hyoung-Gook Kim, Steffen Roeber, Amjad Samour, Thomas Sikora Department of Communication Systems, Technical University of Berlin, Einsteinufer 17, D-10587 Berlin,
More informationName: Date: Hour: PowToon Short Movie
Name: Date: Hour: PowToon Short Movie PowToon ( www.powtoon.com ) is an online web-based animation software tool that allows you to create short movies by manipulating pre-created objects, imported images,
More informationParallel HMMs. Parallel Implementation of Hidden Markov Models for Wireless Applications
Parallel HMMs Parallel Implementation of Hidden Markov Models for Wireless Applications Authors Shawn Hymel (Wireless@VT, Virginia Tech) Ihsan Akbar (Harris Corporation) Jeffrey Reed (Wireless@VT, Virginia
More informationCreating an im ovie project Adjust Project Settings
Creating an imovie project Launch the app, choose projects at the top and tap on the + icon at the top right of the screen to begin a new project. You can choose either to make a movie or a trailer. First
More informationWorkshop W14 - Audio Gets Smart: Semantic Audio Analysis & Metadata Standards
Workshop W14 - Audio Gets Smart: Semantic Audio Analysis & Metadata Standards Jürgen Herre for Integrated Circuits (FhG-IIS) Erlangen, Germany Jürgen Herre, hrr@iis.fhg.de Page 1 Overview Extracting meaning
More informationHello, I am from the State University of Library Studies and Information Technologies, Bulgaria
Hello, My name is Svetla Boytcheva, I am from the State University of Library Studies and Information Technologies, Bulgaria I am goingto present you work in progress for a research project aiming development
More informationApproach to Metadata Production and Application Technology Research
Approach to Metadata Production and Application Technology Research In the areas of broadcasting based on home servers and content retrieval, the importance of segment metadata, which is attached in segment
More information2018 imovie High Sierra
2018 imovie High Sierra 1 Create a Movie Open imovie. Select the Projects button from the top menu. Click Create New. Next, Click Movie. You will see a sidebar of libraries and events, browser window with
More informationLecture 3 Image and Video (MPEG) Coding
CS 598KN Advanced Multimedia Systems Design Lecture 3 Image and Video (MPEG) Coding Klara Nahrstedt Fall 2017 Overview JPEG Compression MPEG Basics MPEG-4 MPEG-7 JPEG COMPRESSION JPEG Compression 8x8 blocks
More informationHow to add video effects
How to add video effects You can use effects to add a creative flair to your movie or to fix exposure or color problems, edit sound, or manipulate images. Adobe Premiere Elements comes with preset effects
More informationSemantic Video Indexing
Semantic Video Indexing T-61.6030 Multimedia Retrieval Stevan Keraudy stevan.keraudy@tkk.fi Helsinki University of Technology March 14, 2008 What is it? Query by keyword or tag is common Semantic Video
More informationUSING METADATA TO PROVIDE SCALABLE BROADCAST AND INTERNET CONTENT AND SERVICES
USING METADATA TO PROVIDE SCALABLE BROADCAST AND INTERNET CONTENT AND SERVICES GABRIELLA KAZAI 1,2, MOUNIA LALMAS 1, MARIE-LUCE BOURGUET 1 AND ALAN PEARMAIN 2 Department of Computer Science 1 and Department
More informationModule 10 MULTIMEDIA SYNCHRONIZATION
Module 10 MULTIMEDIA SYNCHRONIZATION Lesson 33 Basic definitions and requirements Instructional objectives At the end of this lesson, the students should be able to: 1. Define synchronization between media
More informationAdding Titles, and Voice-Overs to an Animation Using imovie HD Duncan Whitehurst - ICT Advisory Teacher Pembrokeshire County Council
1. Your animation opens in imovie. 2. To add a title select the Editing view then click Titles. Choose a text colour here. Choose a font here. Move these sliders to change the speed of the animation and
More informationData Warehousing & Data Mining
Data Warehousing & Data Mining Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Summary Last week: Sequence Patterns: Generalized
More informationCS 543: Final Project Report Texture Classification using 2-D Noncausal HMMs
CS 543: Final Project Report Texture Classification using 2-D Noncausal HMMs Felix Wang fywang2 John Wieting wieting2 Introduction We implement a texture classification algorithm using 2-D Noncausal Hidden
More informationInformation Retrieval and Web Search Engines
Information Retrieval and Web Search Engines Lecture 7: Document Clustering May 25, 2011 Wolf-Tilo Balke and Joachim Selke Institut für Informationssysteme Technische Universität Braunschweig Homework
More informationMultimedia Systems. Lehrstuhl für Informatik IV RWTH Aachen. Prof. Dr. Otto Spaniol Dr. rer. nat. Dirk Thißen
Multimedia Systems Lehrstuhl für Informatik IV RWTH Aachen Prof. Dr. Otto Spaniol Dr. rer. nat. Dirk Thißen Page 1 Organization Lehrstuhl für Informatik 4 Lecture Lecture takes place on Thursday, 10:00
More informationGETTING STARTED TABLE OF CONTENTS
imovie 11 Tutorial GETTING STARTED imovie 11 is consumer-level digital video editing software for Macintosh. You can use imovie 11 to edit the footage you film with digital video cameras and HD video cameras.
More informationWindows MovieMaker 2
Windows MovieMaker 2 http://www.microsoft.com/windowsxp/using/moviemak er/default.mspx Build a Storyboard Movie Maker automatically divides your video into segments to make it easier to drag and drop the
More informationWorking with Windows Movie Maker
Working with Windows Movie Maker These are the work spaces in Movie Maker. Where can I get content? You can use still images, OR video clips in Movie Maker. If these are not images you created yourself,
More informationMultimedia Database Systems. Retrieval by Content
Multimedia Database Systems Retrieval by Content MIR Motivation Large volumes of data world-wide are not only based on text: Satellite images (oil spill), deep space images (NASA) Medical images (X-rays,
More informationEE 6882 Statistical Methods for Video Indexing and Analysis
EE 6882 Statistical Methods for Video Indexing and Analysis Fall 2004 Prof. ShihFu Chang http://www.ee.columbia.edu/~sfchang Lecture 1 part A (9/8/04) 1 EE E6882 SVIA Lecture #1 Part I Introduction Course
More informationMPEG-7. Multimedia Content Description Standard
MPEG-7 Multimedia Content Description Standard Abstract The purpose of this presentation is to provide a better understanding of the objectives & components of the MPEG-7, "Multimedia Content Description
More information[Not for Circulation]
Advanced PowerPoint This document provides instructions for using some of the more advanced features in PowerPoint, including slide masters, techniques for running presentations, animation, and incorporating
More informationSearch Engines. Information Retrieval in Practice
Search Engines Information Retrieval in Practice All slides Addison Wesley, 2008 Beyond Bag of Words Bag of Words a document is considered to be an unordered collection of words with no relationships Extending
More informationHidden Markov Model for Sequential Data
Hidden Markov Model for Sequential Data Dr.-Ing. Michelle Karg mekarg@uwaterloo.ca Electrical and Computer Engineering Cheriton School of Computer Science Sequential Data Measurement of time series: Example:
More informationDigital Video Projects (Creating)
Tim Stack (801) 585-3054 tim@uen.org www.uen.org Digital Video Projects (Creating) OVERVIEW: Explore educational uses for digital video and gain skills necessary to teach students to film, capture, edit
More informationWindows Movie Maker / Microsoft Photo Story Digital Video
Windows Movie Maker / Microsoft Photo Story Digital Video http://intranet/technology/index.html TRC HELP DESK X5092 April 2006 Photo Story and Movie Maker Microsoft Photo Story 3 allows you to create fantastic
More informationAn Introduction to Pattern Recognition
An Introduction to Pattern Recognition Speaker : Wei lun Chao Advisor : Prof. Jian-jiun Ding DISP Lab Graduate Institute of Communication Engineering 1 Abstract Not a new research field Wide range included
More informationMPEG-7 Audio: Tools for Semantic Audio Description and Processing
MPEG-7 Audio: Tools for Semantic Audio Description and Processing Jürgen Herre for Integrated Circuits (FhG-IIS) Erlangen, Germany Jürgen Herre, hrr@iis.fhg.de Page 1 Overview Why semantic description
More informationAn Introduction to Video Editing Using Windows Movie Maker 2 Duncan Whitehurst - ICT Advisory Teacher Pembrokeshire County Council
1. Connect the DV out socket on your video camera to your computer using an IEEE1394 4pin to 4pin or 4 to 6 pin ( firewire ) cable. 2. Switch your camera on to Play and start up your computer. Movie Tasks
More informationSAM Animation: Importing. Importing Photos 40 Importing Video 41 Recording Audio 43 Importing Audio 45
SAM Animation: Importing Importing Photos 40 Importing Video 41 Recording Audio 43 Importing Audio 45 Importing Photos Select Frame Begin by selecting the frame immediately before the position where you
More informationA Robust Wipe Detection Algorithm
A Robust Wipe Detection Algorithm C. W. Ngo, T. C. Pong & R. T. Chin Department of Computer Science The Hong Kong University of Science & Technology Clear Water Bay, Kowloon, Hong Kong Email: fcwngo, tcpong,
More informationHIERARCHICAL VISUAL DESCRIPTION SCHEMES FOR STILL IMAGES AND VIDEO SEQUENCES
HIERARCHICAL VISUAL DESCRIPTION SCHEMES FOR STILL IMAGES AND VIDEO SEQUENCES Universitat Politècnica de Catalunya Barcelona, SPAIN philippe@gps.tsc.upc.es P. Salembier, N. O Connor 2, P. Correia 3 and
More informationAdobe Premiere Pro CC 2015 Certification Review
Adobe Premiere Pro CC 2015 Certification Review 40 questions; 50 Minutes Need to know for matching and/or multiple choice: Razor tool Slide tool Rate Stretch tool Ripple Edit tool Mark In Mark Out Insert
More informationCreating Machinima using Camtasia
Creating Machinima using Camtasia Camtasia Studio is a screen video capture software developed by TechSmith. Camtasia is mostly used to create video tutorials demonstrating how to perform tasks on your
More informationChapter 19: Multimedia
Ref. Page Slide 1/16 Learning Objectives In this chapter you will learn about: Multimedia Multimedia computer system Main components of multimedia and their associated technologies Common multimedia applications
More informationimovie for ipad CREATING A PROJECT
imovie for ipad CREATING A PROJECT After opening the imovie app select the plus sign located in the dark grey box under the projects tab. A window will pop up asking for whether you want to create a movie
More informationOptimizing A/V Content For Mobile Delivery
Optimizing A/V Content For Mobile Delivery Media Encoding using Helix Mobile Producer 11.0 November 3, 2005 Optimizing A/V Content For Mobile Delivery 1 Contents 1. Introduction... 3 2. Source Media...
More informationInvariant Recognition of Hand-Drawn Pictograms Using HMMs with a Rotating Feature Extraction
Invariant Recognition of Hand-Drawn Pictograms Using HMMs with a Rotating Feature Extraction Stefan Müller, Gerhard Rigoll, Andreas Kosmala and Denis Mazurenok Department of Computer Science, Faculty of
More informationVideo Summarization Using MPEG-7 Motion Activity and Audio Descriptors
Video Summarization Using MPEG-7 Motion Activity and Audio Descriptors Ajay Divakaran, Kadir A. Peker, Regunathan Radhakrishnan, Ziyou Xiong and Romain Cabasson Presented by Giulia Fanti 1 Overview Motivation
More informationThe Learner can: 1.1 Identify the purpose, audience and audience needs for preparing video
Unit Title: Adobe video communication using Adobe Premiere Pro OCR unit number A221 Sector unit number 9.3 Level: 2 Credit value: 3 Guided learning hours: 25 Unit purpose and aim This unit will give the
More informationMaking Videos with FilmoraGo mobile application
Making Videos with FilmoraGo mobile application FilmoraGo is a video making app for both ios and Android. We will use FilmoraGo mobile application to create and edit videos. Download and install the application*
More informationRecording Your Audio and Creating Your MP3 File using Audacity
http://www.larkin.net.au/ Page 1 Recording Your Audio and Creating Your MP3 File using Audacity Many people who are working with digital audio are choosing a program called Audacity for many reasons: 1.
More informationThe ToCAI Description Scheme for Indexing and Retrieval of Multimedia Documents 1
The ToCAI Description Scheme for Indexing and Retrieval of Multimedia Documents 1 N. Adami, A. Bugatti, A. Corghi, R. Leonardi, P. Migliorati, Lorenzo A. Rossi, C. Saraceno 2 Department of Electronics
More informationMultimedia Systems Video II (Video Coding) Mahdi Amiri April 2012 Sharif University of Technology
Course Presentation Multimedia Systems Video II (Video Coding) Mahdi Amiri April 2012 Sharif University of Technology Video Coding Correlation in Video Sequence Spatial correlation Similar pixels seem
More informationLecture 7: Introduction to Multimedia Content Description. Reji Mathew & Jian Zhang NICTA & CSE UNSW COMP9519 Multimedia Systems S2 2009
Lecture 7: Introduction to Multimedia Content Description Reji Mathew & Jian Zhang NICTA & CSE UNSW COMP9519 Multimedia Systems S2 2009 Outline Why do we need to describe multimedia content? Low level
More informationimovie 6HD Basic Editing and Functions Instructions
-Shut down all other applications -Open imovie -Either Create a new project (See Transfer Instructions) or Open an Existing Project Viewer, where movie or clip is displayed Clips Pane, will change display
More informationAudacity tutorial. 1. Look for the Audacity icon on your computer desktop. 2. Open the program. You get the basic screen.
Audacity tutorial What does Audacity do? It helps you record and edit audio files. You can record a speech through a microphone into your computer, into the Audacity program, then fix up the bits that
More informationINTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO
INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC29/WG11 N15071 February 2015, Geneva,
More informationA Digital Talking Storybook
Using ICT Levels 2, 3 & 4 A Digital Talking Storybook Desirable Features: Presenting Music and Sound Assessment Focus Film and Animation Express Evaluate Exhibit Level 2 Level 3 Level 4 Part 1 Part 2 Part
More informationNew Media Production week 3
New Media Production week 3 Multimedia ponpong@gmail.com What is Multimedia? Multimedia = Multi + Media Multi = Many, Multiple Media = Distribution tool & information presentation text, graphic, voice,
More informationMULTIMEDIA DATABASES OVERVIEW
MULTIMEDIA DATABASES OVERVIEW Recent developments in information systems technologies have resulted in computerizing many applications in various business areas. Data has become a critical resource in
More informationGeorgios Tziritas Computer Science Department
New Video Coding standards MPEG-4, HEVC Georgios Tziritas Computer Science Department http://www.csd.uoc.gr/~tziritas 1 MPEG-4 : introduction Motion Picture Expert Group Publication 1998 (Intern. Standardization
More informationDigital Creator Award - Level 1 Detailed Syllabus
Digital Creator Award - Level 1 Detailed Syllabus Unit 1 - Digital Audio - This module requires the candidate to capture, edit, enhance and share digital audio for a specified audience. Candidates will
More informationData Warehousing & Data Mining
Data Warehousing & Data Mining Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Summary Last week: Logical Model: Cubes,
More information9/8/2016. Characteristics of multimedia Various media types
Chapter 1 Introduction to Multimedia Networking CLO1: Define fundamentals of multimedia networking Upon completion of this chapter students should be able to define: 1- Multimedia 2- Multimedia types and
More informationData Warehousing & Data Mining
Data Warehousing & Data Mining Wolf-Tilo Balke Kinda El Maarry Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Summary Last Week: Optimization - Indexes
More information1. Introduction to Multimedia
Standard:11 1. Introduction to Multimedia Communication is an integral part of our life. We use various means of communication like radio, newspaper, television, theatre, movies, internet and others. These
More informationBIOC351: Proteins. PyMOL Laboratory #4. Movie Making
BIOC351: Proteins PyMOL Laboratory #4 Movie Making Version 2 Some information and figures for this handout were obtained from the following sources: http://www.pymolwiki.org/index.php/movieschool http://www.chem.ucsb.edu/~kalju/csuperb/public/pymol_movies.html
More informationIdeal for: VHS Video 8 S-VHS Hi8 Betamax and all other tape formats. Additional advantages:
Are your video tapes safe? Not really, there are lots of threats to your valuable memories: low life expectancy (even if stored in optimum conditions), magnetic fields, loss of quality due to abrasion,
More informationOutline Introduction MPEG-2 MPEG-4. Video Compression. Introduction to MPEG. Prof. Pratikgiri Goswami
to MPEG Prof. Pratikgiri Goswami Electronics & Communication Department, Shree Swami Atmanand Saraswati Institute of Technology, Surat. Outline of Topics 1 2 Coding 3 Video Object Representation Outline
More informationInformation Retrieval
Multimedia Computing: Algorithms, Systems, and Applications: Information Retrieval and Search Engine By Dr. Yu Cao Department of Computer Science The University of Massachusetts Lowell Lowell, MA 01854,
More informationWelcome to Sinclair Wilson Movie Making!
Welcome to Sinclair Wilson Movie Making! Today you are going to create a Movie Trailer using imovie on an ipad A trailer or preview is an advertisement or a commercial for a feature film that will be exhibited
More informationUpdate & : The Easy Guide to Final Cut Pro X
Update 10.0.6 & 10.0.7: The Easy Guide to Final Cut Pro X This short update has been written to outline specific changes between the latest releases of Final Cut Pro X, versions 10.0.6 and 10.0.7, and
More informationCompression and File Formats
Compression and File Formats 1 Compressing Moving Images Methods: Motion JPEG, Cinepak, Indeo, MPEG Known as CODECs compression / decompression algorithms hardware and software implementations symmetrical
More informationModule 7 VIDEO CODING AND MOTION ESTIMATION
Module 7 VIDEO CODING AND MOTION ESTIMATION Lesson 20 Basic Building Blocks & Temporal Redundancy Instructional Objectives At the end of this lesson, the students should be able to: 1. Name at least five
More information11 EDITING VIDEO. Lesson overview
11 EDITING VIDEO Lesson overview In this lesson, you ll learn how to do the following: Create a video timeline in Photoshop. Add media to a video group in the Timeline panel. Add motion to still images.
More information