Hands On: Multimedia Methods for Large Scale Video Analysis (Project Meeting) Dr. Gerald Friedland,
|
|
- Phillip Murphy
- 5 years ago
- Views:
Transcription
1 Hands On: Multimedia Methods for Large Scale Video Analysis (Project Meeting) Dr. Gerald Friedland, 1
2 Today
3 Today Project Requirements
4 Today Project Requirements Data available
5 Today Project Requirements Data available Compute Architecture at ICSI
6 Today Project Requirements Data available Compute Architecture at ICSI Some Project Ideas
7 Project Requirements 3
8 Project Requirements Form a team of 2 to 3 people. 3
9 Project Requirements Form a team of 2 to 3 people. Each team work on one project idea 3
10 Project Requirements Form a team of 2 to 3 people. Each team work on one project idea Project must be on big multimedia data, e.g. at least ten-thousands of videos, hundred-thousands of sounds pieces/images. 3
11 Project Requirements Form a team of 2 to 3 people. Each team work on one project idea Project must be on big multimedia data, e.g. at least ten-thousands of videos, hundred-thousands of sounds pieces/images. Team delivers written project report at the end of semester, reports on progress during the semester 3
12 Each Project Report... 4
13 Each Project Report......needs to explain the idea of the project and show evidence that the project has been performed. 4
14 Each Project Report......needs to explain the idea of the project and show evidence that the project has been performed....needs to report on 4
15 Each Project Report......needs to explain the idea of the project and show evidence that the project has been performed....needs to report on accuracy 4
16 Each Project Report......needs to explain the idea of the project and show evidence that the project has been performed....needs to report on accuracy efficiency 4
17 Each Project Report......needs to explain the idea of the project and show evidence that the project has been performed....needs to report on accuracy efficiency scalability 4
18 Each Project Report......needs to explain the idea of the project and show evidence that the project has been performed....needs to report on accuracy efficiency scalability limits of the approach 4
19 Each Project Report......needs to explain the idea of the project and show evidence that the project has been performed....needs to report on accuracy efficiency scalability limits of the approach... and reports on problems occured. 4
20 Project Resources 5
21 Data: Project Resources 5
22 Data: Project Resources Use the data provided in the class (TrecVID, 1M Songs, MediaEval) 5
23 Data: Project Resources Use the data provided in the class (TrecVID, 1M Songs, MediaEval) Use your own (after discussion with instructor) 5
24 Data: Project Resources Use the data provided in the class (TrecVID, 1M Songs, MediaEval) Use your own (after discussion with instructor) Compute: 5
25 Data: Project Resources Use the data provided in the class (TrecVID, 1M Songs, MediaEval) Use your own (after discussion with instructor) Compute: Use your own laptop initially then 5
26 Data: Project Resources Use the data provided in the class (TrecVID, 1M Songs, MediaEval) Use your own (after discussion with instructor) Compute: Use your own laptop initially then Use ICSI s compute pool then 5
27 Data: Project Resources Use the data provided in the class (TrecVID, 1M Songs, MediaEval) Use your own (after discussion with instructor) Compute: Use your own laptop initially then Use ICSI s compute pool then if needed, use Amazon EC2 5
28 Data: Project Resources Use the data provided in the class (TrecVID, 1M Songs, MediaEval) Use your own (after discussion with instructor) Compute: Use your own laptop initially then Use ICSI s compute pool then if needed, use Amazon EC2 Use any other compute resource that you have access to. 5
29 Project Resources II 6
30 Project Resources II Hard disk: 6
31 Project Resources II Hard disk: Once in the ICSI phase use ICSI s ttmp structure 6
32 Project Resources II Hard disk: Once in the ICSI phase use ICSI s ttmp structure At Amazon: Need to buy space if needed. 6
33 Project Resources II Hard disk: Once in the ICSI phase use ICSI s ttmp structure At Amazon: Need to buy space if needed. Time: 6
34 Project Resources II Hard disk: Once in the ICSI phase use ICSI s ttmp structure At Amazon: Need to buy space if needed. Time: Start work on your project as early as possible! 6
35 Project Resources II Hard disk: Once in the ICSI phase use ICSI s ttmp structure At Amazon: Need to buy space if needed. Time: Start work on your project as early as possible! 6
36 Project Resources II Hard disk: Once in the ICSI phase use ICSI s ttmp structure At Amazon: Need to buy space if needed. Time: Start work on your project as early as possible! 6
37 Project Resources II Hard disk: Once in the ICSI phase use ICSI s ttmp structure At Amazon: Need to buy space if needed. Time: Start work on your project as early as possible! 6
38 Project Resources II Hard disk: Once in the ICSI phase use ICSI s ttmp structure At Amazon: Need to buy space if needed. Time: Start work on your project as early as possible! 6
39 Project Idea 7
40 Project Idea Come up with your own project idea as a team, inspired by the class content, co-students, the data, and/or other input. 7
41 Project Idea Come up with your own project idea as a team, inspired by the class content, co-students, the data, and/or other input. Discuss the project idea with the class and the instructor 7
42 Available BIGDATA 8
43 Available BIGDATA MediaEval
44 Available BIGDATA MediaEval 2012 TrecVid MED
45 Available BIGDATA MediaEval 2012 TrecVid MED M Songs 8
46 Placing Task Automatically guess the location of a Flickr video: i.e., assign geo-coordinates (latitude and longitude) Using one or more of: Visual/Audio content Metadata (title, tags, description, etc) Social information 9
47 Data Description (2010) Training Data 15k videos/metadata/visual keyframes (+features)/geo-tags 6M photos/metadata/visual features Test Data 5k video/metadata/visual keyframes (+features) no geotags Test/Training split: by UserID 10
48 Example 11
49 A Good video Title: CIMG0254 Keywords: southamerica, june, 2008, video, pearce, vacation, iguazufalls, iguassufalls, iguaçufalls, waterfall, argentina Description: (None) 14
50 How about this one? Title: MVI_6423_rau Keywords: usa08, puertorico Description: (None) 15
51 Another bad video Title: Stillness #1 Keywords: henrywcoestatepark, henrycoe, california, 2009, hiking, landscape, nature, chinaholetrail, video Description: When I hike, I like to stop at random spots and just stand still for a few minutes and listen and look at my surroundings. On this hike, I decided to record a few seconds during those moments. 16
52 Metadata 98.8% of videos were annotated with at least one title, tags, or description 17
53 TrecVID MED 2011 detailed 16
54 TrecVID MED 2011 detailed Videos all consumer produced, typically 1-5 minutes long 16
55 TrecVID MED 2011 detailed Videos all consumer produced, typically 1-5 minutes long Given 15 concepts, 5 for training, 10 for eval 16
56 TrecVID MED 2011 detailed Videos all consumer produced, typically 1-5 minutes long Given 15 concepts, 5 for training, 10 for eval About 100 sample videos per concept 16
57 TrecVID MED 2011 detailed Videos all consumer produced, typically 1-5 minutes long Given 15 concepts, 5 for training, 10 for eval About 100 sample videos per concept Testset 2011: 50k videos, open set 16
58 TrecVID Dataset Consumer-Produced, Unfiltered Videos... 17
59 What is Video Concept Detection? 18
60 What is Video Concept Detection? A concept (as of TrecVID MED 11): 18
61 What is Video Concept Detection? A concept (as of TrecVID MED 11): is a complex activity occurring at a specific place and time; 18
62 What is Video Concept Detection? A concept (as of TrecVID MED 11): is a complex activity occurring at a specific place and time; involves people interacting with other people and/or objects; 18
63 What is Video Concept Detection? A concept (as of TrecVID MED 11): is a complex activity occurring at a specific place and time; involves people interacting with other people and/or objects; consists of a number of human actions, processes, and activities that are loosely or tightly organized and that have significant temporal and semantic relationships to the overarching activity; 18
64 What is Video Concept Detection? A concept (as of TrecVID MED 11): is a complex activity occurring at a specific place and time; involves people interacting with other people and/or objects; consists of a number of human actions, processes, and activities that are loosely or tightly organized and that have significant temporal and semantic relationships to the overarching activity; is directly observable. 18
65 Event Kit? 19
66 Event Kit? An Event Kit consists of: 19
67 Event Kit? An Event Kit consists of: A textual (natural language) event definition 19
68 Event Kit? An Event Kit consists of: A textual (natural language) event definition A textual (NL) event explication, which is a glossart for the definition 19
69 Event Kit? An Event Kit consists of: A textual (natural language) event definition A textual (NL) event explication, which is a glossart for the definition Evidential description: A textual listing of attributes that are indicative of an event instance. 19
70 Event Kit? An Event Kit consists of: A textual (natural language) event definition A textual (NL) event explication, which is a glossart for the definition Evidential description: A textual listing of attributes that are indicative of an event instance. A set of illustrative video examples each containing an instance of the event. 19
71 Event Kit: Example Event name: Attempting a board trick Definition: One or more people attempt to do a trick on a skateboard, snowboard, surfboard, or other boardsport board. Explication: Boardsports are sports where a person stands, sits, or lays on a board and moves and controls the board. Tricks consist of intentional motions made with the board that are not simply slowing down/stopping the board or steering the board as it moves. Steering around obstacles or steering a board off of a jump and landing on the ground are not considered tricks in and of themselves. Common tricks involve actions like sliding the board along the top of an object (e.g. a swimming pool rim or railing), jumping from the ground or the surface of water into the air, and spinning or flipping in the air. Evidential description: scene: outside, often in a skatepark objects/people: skateboard, snowboard, surfboard, ramps, rails, safety gear, crowds activities: standing, sitting or laying on the board; jumping with the board; flipping the board and landing on it; spinning the board; sliding the board across various objects. audio: sounds of board hitting surface during trick; crowd cheering 20
72 2011 Concepts Event Category Train DevTest E001 Board Tricks E002 Feeding Animal E003 Landing a Fish E004 Wedding E005 Woodworking E006 Birthday Party E007 Changing Tire E008 Flash Mob E009 Vehicle Unstuck E010 Grooming animal E011 Make a Sandwich E012 Parade E013 Parkour E014 Repairing Appliance E015 Sewing Other Random other N/A
73 Sample Video 1: Board Tricks 22
74 Sample Video 2: Board Tricks 23
75 Test Video: Board Tricks 24
76 Test Video: Board Tricks NOT A POSITIVE! 24
77 25
78 The Million Song Dataset is a freely-available collection of audio features and metadata for a million contemporary popular music tracks. 25
79 The Million Song Dataset is a freely-available collection of audio features and metadata for a million contemporary popular music tracks. Its purposes are: 25
80 The Million Song Dataset is a freely-available collection of audio features and metadata for a million contemporary popular music tracks. Its purposes are: To encourage research on algorithms that scale to commercial sizes 25
81 The Million Song Dataset is a freely-available collection of audio features and metadata for a million contemporary popular music tracks. Its purposes are: To encourage research on algorithms that scale to commercial sizes To provide a reference dataset for evaluating research 25
82 The Million Song Dataset is a freely-available collection of audio features and metadata for a million contemporary popular music tracks. Its purposes are: To encourage research on algorithms that scale to commercial sizes To provide a reference dataset for evaluating research As a shortcut alternative to creating a large dataset with APIs (e.g. The Echo Nest's) 25
83 The Million Song Dataset is a freely-available collection of audio features and metadata for a million contemporary popular music tracks. Its purposes are: To encourage research on algorithms that scale to commercial sizes To provide a reference dataset for evaluating research As a shortcut alternative to creating a large dataset with APIs (e.g. The Echo Nest's) To help new researchers get started in the MIR field 25
84 26
85 Dataset is a sqllite database of about 100 attributes for each song. 26
86 Dataset is a sqllite database of about 100 attributes for each song. Subset of 10k song attributes available 26
87 Dataset is a sqllite database of about 100 attributes for each song. Subset of 10k song attributes available The song IS NOT part of the database. Need to access using a different database using metadata (e.g. Grooveshark). 26
88 27
89 Compute Architecture at ICSI
90 Compute Architecture at ICSI Each enrolled student gets account at ICSI
91 Compute Architecture at ICSI Each enrolled student gets account at ICSI ICSI = International Computer Science Institute: Location: 1947 Center Street, 6th floor
92 Compute Architecture at ICSI
93 Compute Architecture at ICSI Accounts belong to speech group and allow access to Unix compute cluster of that group
94 Compute Architecture at ICSI Accounts belong to speech group and allow access to Unix compute cluster of that group Compute Cluster is currently 160 CPUs
95 Compute Architecture at ICSI Accounts belong to speech group and allow access to Unix compute cluster of that group Compute Cluster is currently 160 CPUs Main compute: Squids 8x8 CPUs, 8x2 GPUs
96 Compute Architecture at ICSI
97 Compute Architecture at ICSI Most important page for technical Info: speechwiki/index.php/main_page
98 Compute Architecture at ICSI Most important page for technical Info: speechwiki/index.php/main_page Includes Ganglia Monitoring
99 Compute Architecture at ICSI Most important page for technical Info: speechwiki/index.php/main_page Includes Ganglia Monitoring
100 Compute Architecture at ICSI Most important page for technical Info: speechwiki/index.php/main_page Includes Ganglia Monitoring
101 Compute Pool
102 Compute Pool Main usage policy: Be nice to each other
103 Compute Pool Main usage policy: Be nice to each other If you want to start a job using more than 16 CPUs, please send to: speech-users@icsi.berkeley.edu.
104 Compute Pool Main usage policy: Be nice to each other If you want to start a job using more than 16 CPUs, please send to: speech-users@icsi.berkeley.edu. Never login into a compute machine to run jobs!
105 Compute Pool Main usage policy: Be nice to each other If you want to start a job using more than 16 CPUs, please send to: speech-users@icsi.berkeley.edu. Never login into a compute machine to run jobs! If in doubt or trouble: Send me .
106 ICSI Compute Pool: Basic Usage Easy compared to Amazon!
107 ICSI Compute Pool: Basic Usage showjobs -- Shows job currently running Easy compared to Amazon!
108 ICSI Compute Pool: Basic Usage showjobs -- Shows job currently running run-command -- Starts a job Easy compared to Amazon!
109 ICSI Compute Pool: Basic Usage showjobs -- Shows job currently running run-command -- Starts a job ssh machine /bin/kill pid -- Kill a job Easy compared to Amazon!
110 ICSI Compute Pool: Data Storage
111 ICSI Compute Pool: Data Storage Home/Project directory (backed up, strictly quota d)
112 ICSI Compute Pool: Data Storage Home/Project directory (backed up, strictly quota d) Local scratch space (fast, local machine, not backed up)
113 ICSI Compute Pool: Data Storage Home/Project directory (backed up, strictly quota d) Local scratch space (fast, local machine, not backed up) Networked scratch space (not backed up)
114 ICSI Compute Pool: Data Storage Home/Project directory (backed up, strictly quota d) Local scratch space (fast, local machine, not backed up) Networked scratch space (not backed up) Temporary space (so-called ttmp, networked, deleted automatically)
115 ICSI Compute Pool: Availabilty There are always other jobs...
116 Some Project Ideas (MediaEval Dataset)
117 Some Project Ideas (MediaEval Dataset) Build the any tag detector
118 Some Project Ideas (MediaEval Dataset) Build the any tag detector City-scale location estimation
119 Some Project Ideas (MediaEval Dataset) Build the any tag detector City-scale location estimation Rural/Non-Rural Detector
120 Some Project Ideas (MediaEval Dataset) Build the any tag detector City-scale location estimation Rural/Non-Rural Detector Correlate Users among videos
121 Some Project Ideas (MediaEval Dataset) Build the any tag detector City-scale location estimation Rural/Non-Rural Detector Correlate Users among videos Find videos from a certain country
122 Some Project Ideas (MediaEval Dataset) Build the any tag detector City-scale location estimation Rural/Non-Rural Detector Correlate Users among videos Find videos from a certain country Correlate video quality with tag quality
123 Some Project Ideas (TrecVid Dataset)
124 Some Project Ideas (TrecVid Dataset) Build a simple TrecVid MED system!
125 Some Project Ideas (TrecVid Dataset) Build a simple TrecVid MED system! Build a keyword-spotter
126 Some Project Ideas (TrecVid Dataset) Build a simple TrecVid MED system! Build a keyword-spotter Build a face detector
127 Some Project Ideas (TrecVid Dataset) Build a simple TrecVid MED system! Build a keyword-spotter Build a face detector Sort videos by visual similarity
128 Some Project Ideas (TrecVid Dataset) Build a simple TrecVid MED system! Build a keyword-spotter Build a face detector Sort videos by visual similarity
129 Some Project Ideas (TrecVid Dataset) Build a simple TrecVid MED system! Build a keyword-spotter Build a face detector Sort videos by visual similarity
130 Some Project Ideas (1M Song Dataset)
131 Some Project Ideas (1M Song Dataset) Build a dubbed-song recognition system for the TrecVid MED set
132 Some Project Ideas (1M Song Dataset) Build a dubbed-song recognition system for the TrecVid MED set Correlate song similarity with user ratings
133 Some Project Ideas (1M Song Dataset) Build a dubbed-song recognition system for the TrecVid MED set Correlate song similarity with user ratings Cluster and sort songs by tags and correlate with acoustic clustering
134 Some Project Ideas (1M Song Dataset) Build a dubbed-song recognition system for the TrecVid MED set Correlate song similarity with user ratings Cluster and sort songs by tags and correlate with acoustic clustering Try to align lyrics with songs
135 Some Project Ideas (1M Song Dataset) Build a dubbed-song recognition system for the TrecVid MED set Correlate song similarity with user ratings Cluster and sort songs by tags and correlate with acoustic clustering Try to align lyrics with songs
136 This Week (Lecture) Architectural Considerations for Large Scale Conten Analysis 38
137 Next Week (Project Meeting) Amazon EC2 and how to use it 39
Experimental Design for Machine Learning on Multimedia Data See:
Experimental Design for Machine Learning on Multimedia Data See: http://www.icsi.berkeley.edu/~fractor/spring2019/ Dr. Gerald Friedland, fractor@eecs.berkeley.edu 1 was: Hands On: Multimedia Methods for
More informationMultimedia Event Detection for Large Scale Video. Benjamin Elizalde
Multimedia Event Detection for Large Scale Video Benjamin Elizalde Outline Motivation TrecVID task Related work Our approach (System, TF/IDF) Results & Processing time Conclusion & Future work Agenda 2
More informationLabROSA Research Overview
LabROSA Research Overview Dan Ellis Laboratory for Recognition and Organization of Speech and Audio Dept. Electrical Eng., Columbia Univ., NY USA dpwe@ee.columbia.edu 1. Music 2. Environmental sound 3.
More informationHands On: Multimedia Methods for Large Scale Video Analysis Dr. Gerald Friedland,
Hands On: Multimedia Methods for Large Scale Video Analysis Dr. Gerald Friedland, fractor@icsi.berkeley.edu 1 Multimedia in the Internet is Growing Raphaël Troncy: Linked Media: Weaving non-textual content
More informationTeam SRI-Sarnoff s AURORA TRECVID 2011
Team SRI-Sarnoff s AURORA System @ TRECVID 2011 Hui Cheng, Amir Tamrakar, Saad Ali, Qian Yu, Omar Javed, Jingen Liu, Ajay Divakaran, Harpreet S. Sawhney, Alex Hauptmann, Mubarak Shah, Subhabrata Bhattacharya,
More informationThe YLI MED Corpus: Characteristics, Procedures, and Plans
The YLI MED Corpus: Characteristics, Procedures, and Plans Julia Bernd, Damian Borth, Benjamin Elizalde, Gerald Friedland, Heather Gallagher, Luke Gottlieb, Adam Janin, Sara Karabashlieva, Jocelyn Takahashi,
More informationHands On: Multimedia Methods for Large Scale Video Analysis (Lecture) Dr. Gerald Friedland,
Hands On: Multimedia Methods for Large Scale Video Analysis (Lecture) Dr. Gerald Friedland, fractor@icsi.berkeley.edu 1 Today Recap: Some more Machine Learning Multimedia Systems An example Multimedia
More informationOn the Applicability of Speaker Diarization to Audio Concept Detection for Multimedia Retrieval
2011 IEEE International Symposium on Multimedia On the Applicability of Speaker Diarization to Audio Concept Detection for Multimedia Retrieval Robert Mertens International Computer Science Institute 1947
More informationHello, I am from the State University of Library Studies and Information Technologies, Bulgaria
Hello, My name is Svetla Boytcheva, I am from the State University of Library Studies and Information Technologies, Bulgaria I am goingto present you work in progress for a research project aiming development
More informationConsumer Video Understanding
Consumer Video Understanding A Benchmark Database + An Evaluation of Human & Machine Performance Yu-Gang Jiang, Guangnan Ye, Shih-Fu Chang, Daniel Ellis, Alexander C. Loui Columbia University Kodak Research
More information8 th Grade Animation Exam Study Guide
Name: Period: What is our class website? What day of the week can you come to class during lunch to make up missed work? What does CPU stand for? What type of files are used for audio? What is hardware?
More informationCollaborative Mapping with Streetlevel Images in the Wild. Yubin Kuang Co-founder and Computer Vision Lead
Collaborative Mapping with Streetlevel Images in the Wild Yubin Kuang Co-founder and Computer Vision Lead Mapillary Mapillary is a street-level imagery platform, powered by collaboration and computer vision.
More informationThe Stanford/Technicolor/Fraunhofer HHI Video Semantic Indexing System
The Stanford/Technicolor/Fraunhofer HHI Video Semantic Indexing System Our first participation on the TRECVID workshop A. F. de Araujo 1, F. Silveira 2, H. Lakshman 3, J. Zepeda 2, A. Sheth 2, P. Perez
More informationWIth ever expanding multimedia collections, multimedia
Knowledge Adaptation with Partially Shared Features for Event Detection Using Few Exemplars Zhigang Ma, Yi Yang, Nicu Sebe, and Alexander G. Hauptmann Abstract Multimedia event detection (MED) is an emerging
More informationarxiv: v2 [cs.cv] 17 Aug 2015
EventNet: A Large Scale Structured Concept Library for Complex Event Detection in Video Guangnan Ye, Yitong Li, Hongliang Xu, Dong Liu, Shih-Fu Chang Department of Electrical Engineering, Columbia University,
More informationPS2 out today. Lab 2 out today. Lab 1 due today - how was it?
6.830 Lecture 7 9/25/2017 PS2 out today. Lab 2 out today. Lab 1 due today - how was it? Project Teams Due Wednesday Those of you who don't have groups -- send us email, or hand in a sheet with just your
More informationAutomatic summarization of video data
Automatic summarization of video data Presented by Danila Potapov Joint work with: Matthijs Douze Zaid Harchaoui Cordelia Schmid LEAR team, nria Grenoble Khronos-Persyvact Spring School 1.04.2015 Definition
More informationHigh-level Event Recognition in Internet Videos
High-level Event Recognition in Internet Videos Yu-Gang Jiang School of Computer Science Fudan University, Shanghai, China ygj@fudan.edu.cn Joint work with Guangnan Ye 1, Subh Bhattacharya 2, Dan Ellis
More informationSit all three speakers next to each other, starting with the Echo and ending with the Dot, and you'd get one tall, one medium, and one short.
Echo Tap Dot Sit all three speakers next to each other, starting with the Echo and ending with the Dot, and you'd get one tall, one medium, and one short. The differences between Amazon's speakers aren't
More informationMultimedia Information Retrieval
Multimedia Information Retrieval Prof Stefan Rüger Multimedia and Information Systems Knowledge Media Institute The Open University http://kmi.open.ac.uk/mmis Multimedia Information Retrieval 1. What are
More informationOnline Photo Sharing with Flickr Website:
Website: http://etc.usf.edu/te/ Flickr (http://flickr.com) is a website that allows you store, sort, search, and share your photos online. The free version of Flickr allows you to upload up to 100MB of
More informationAdvanced Multimodal Machine Learning
Advanced Multimodal Machine Learning Lecture 1.2: Challenges and applications Louis-Philippe Morency Tadas Baltrušaitis 1 Objectives Identify the 5 technical challenges in multimodal machine learning Identify
More informationTemporal Analysis of Inter-Community User Flows in Online Knowledge-Sharing Networks
Temporal Analysis of Inter-Community User Flows in Online Knowledge-Sharing Networks Anna Guimarães, Ana Paula Couto da Silva, Jussara Almeida Department of Computer Science - UFMG (Brazil) August 10,
More informationBlackboard 5 Level One Student Manual
Blackboard 5 Level One Student Manual Blackboard, Inc. 1899 L Street NW 5 th Floor Washington DC 20036 Copyright 2000 by Blackboard Inc. All rights reserved. No part of the contents of this manual may
More informationMultimedia Information Retrieval The case of video
Multimedia Information Retrieval The case of video Outline Overview Problems Solutions Trends and Directions Multimedia Information Retrieval Motivation With the explosive growth of digital media data,
More informationSanta Monica College. GRAPHIC DESIGN 65: Web Design I Course Syllabus
GRAPHIC DESIGN 65: Web Design I Course Syllabus Instructor: Anastasia Triviza Term: Spring 2010 Section: 4266 Time and Place: Thursdays, 6:30 PM-9:35 PM, AET 105 Arrange - 1 Hour Program website: http://www.smc.edu/designtech/graphic_design/
More informationHands On: Multimedia Methods for Large Scale Video Analysis (Lecture) Dr. Gerald Friedland,
Hands On: Multimedia Methods for Large Scale Video Analysis (Lecture) Dr. Gerald Friedland, fractor@icsi.berkeley.edu 1 Today Answers to Questions How to estimate resources for large data projects - Some
More informationSECURING AWS ACCESS WITH MODERN IDENTITY SOLUTIONS
WHITE PAPER SECURING AWS ACCESS WITH MODERN IDENTITY SOLUTIONS The Challenges Of Securing AWS Access and How To Address Them In The Modern Enterprise Executive Summary When operating in Amazon Web Services
More informationCOLLABORATIVE LOCATION AND ACTIVITY RECOMMENDATIONS WITH GPS HISTORY DATA
COLLABORATIVE LOCATION AND ACTIVITY RECOMMENDATIONS WITH GPS HISTORY DATA Vincent W. Zheng, Yu Zheng, Xing Xie, Qiang Yang Hong Kong University of Science and Technology Microsoft Research Asia WWW 2010
More informationGot Isilon? Need IOPS? Get Avere.
Got Isilon? Need IOPS? Get Avere. Scalable I/O Performance to Complement Any EMC Isilon Environment By: Jeff Tabor, Director of Product Marketing Achieving Performance Scaling Overcoming Random I/O and
More informationEECS3421 Introduction to Database Management Systems. Thanks to John Mylopoulos and Ryan Johnson for material in these slides
EECS3421 Introduction to Database Management Systems Thanks to John Mylopoulos and Ryan Johnson for material in these slides Overview What is a database? Course administrivia The relational model 2 What
More informationComposite Concept Discovery for Zero-Shot Video Event Detection
Composite Concept Discovery for Zero-Shot Video Event Detection Amirhossein Habibian, Thomas Mensink, and Cees G. M. Snoek ISLA, Informatics Institute, University of Amsterdam Science Park 904, 098 XH,
More informationMultimedia Databases. 9 Video Retrieval. 9.1 Hidden Markov Model. 9.1 Hidden Markov Model. 9.1 Evaluation. 9.1 HMM Example 12/18/2009
9 Video Retrieval Multimedia Databases 9 Video Retrieval 9.1 Hidden Markov Models (continued from last lecture) 9.2 Introduction into Video Retrieval Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme
More informationDistributed Systems CS6421
Distributed Systems CS6421 Intro to Distributed Systems and the Cloud Prof. Tim Wood v I teach: Software Engineering, Operating Systems, Sr. Design I like: distributed systems, networks, building cool
More informationAudio Concept Ranking for Video Event Detection on User-Generated Content
ISCA Archive http://www.isca-speech.org/archive First Workshop on Speech, Language and Audio in Multimedia Marseille, France August 22-23, 2013 Audio Concept Ranking for Video Event Detection on User-Generated
More informationA Consumer Photo Tagging Ontology
A Consumer Photo Tagging Ontology Concepts and Annotations Stefanie Nowak Semantic Audiovisual Systems Fraunhofer IDMT Corfu, 29.09.2009 stefanie.nowak@idmt.fraunhofer.de slide 1 Outline Introduction Related
More informationSeamless transfer of ambient media from environment to mobile device
Technical Disclosure Commons Defensive Publications Series May 23, 2018 Seamless transfer of ambient media from environment to mobile device Dominik Roblek Matthew Sharifi Follow this and additional works
More informationData and File Structures Chapter 3. Secondary Storage and System Software: CD-ROM & Issues in Data Management
Data and File Structures Chapter 3 Secondary Storage and System Software: CD-ROM & Issues in Data Management 1 Overview CD-ROM (Compact Disk, Read-Only Memory) A Journey of a Byte Buffer Management I/O
More informationSupplementary Material Summary Transfer: Exemplar-based Subset Selection for Video Summarization
In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, June 2016. Supplementary Material Summary Transfer: Exemplar-based Subset Selection for Video Summarization
More informationWeb-scale Multimedia Search for Internet Video Content
CARNEGIE MELLON UNIVERSITY Web-scale Multimedia Search for Internet Video Content by Lu Jiang Ph.D Thesis Proposal Thesis Committee: Dr. Alex Hauptmann, Carnegie Mellon University Dr. Teruko Mitamura,
More informationLecture 12: Video Representation, Summarisation, and Query
Lecture 12: Video Representation, Summarisation, and Query Dr Jing Chen NICTA & CSE UNSW CS9519 Multimedia Systems S2 2006 jchen@cse.unsw.edu.au Last week Structure of video Frame Shot Scene Story Why
More informationWeb-scale Multimedia Search for Internet Video Content
CARNEGIE MELLON UNIVERSITY Web-scale Multimedia Search for Internet Video Content Lu Jiang CMU-LTI-17-003 Language and Information Technologies School of Computer Science Carnegie Mellon University 5000
More informationANALYZING THE MILLION SONG DATASET USING MAPREDUCE
PROGRAMMING ASSIGNMENT 3 ANALYZING THE MILLION SONG DATASET USING MAPREDUCE Version 1.0 DUE DATE: Wednesday, October 18 th, 2017 @ 5:00 pm OBJECTIVE You will be developing MapReduce programs that parse
More informationConceptual Modeling on Tencent s Distributed Database Systems. Pan Anqun, Wang Xiaoyu, Li Haixiang Tencent Inc.
Conceptual Modeling on Tencent s Distributed Database Systems Pan Anqun, Wang Xiaoyu, Li Haixiang Tencent Inc. Outline Introduction System overview of TDSQL Conceptual Modeling on TDSQL Applications Conclusion
More informationUser Strategies in Video Retrieval: a Case Study
User Strategies in Video Retrieval: a Case Study L. Hollink 1, G.P. Nguyen 2, D.C. Koelma 2, A.Th. Schreiber 1, M. Worring 2 1 Business Informatics, Free University Amsterdam. {hollink,schreiber}@cs.vu.nl
More informationLarge-Scale Web Applications
Large-Scale Web Applications Mendel Rosenblum Web Application Architecture Web Browser Web Server / Application server Storage System HTTP Internet CS142 Lecture Notes - Intro LAN 2 Large-Scale: Scale-Out
More informationDiscovering Video Clusters from Visual Features and Noisy Tags
Discovering Video Clusters from Visual Features and Noisy Tags Arash Vahdat, Guang-Tong Zhou, and Greg Mori School of Computing Science, Simon Fraser University, Canada {avahdat,gza11,mori}@cs.sfu.ca Abstract.
More informationHow many people are online? As of Sept. 2002: an educated guess suggests: World Total: million. Internet. Types of Computers on Internet
Internet Hazelwood East High School How many people are online? As of Sept. 2002: an educated guess suggests: World Total: 605.6 million Africa: 6.31 million Asia/ Pacific: 187.24 million Europe: 190.91
More informationProgressTestA Unit 5. Vocabulary. Grammar
ProgressTestA Unit Vocabulary 1 Completethesentenceswithappropriate words.thefirstlettersofthewordshavebeen given. a Can you believe it? She s getting married to a man she has met on a s networking site!
More informationCS Unix Tools. Fall 2010 Lecture 10. Hussam Abu-Libdeh based on slides by David Slater. September 29th, 2010
Fall 2010 Lecture 10 Hussam Abu-Libdeh based on slides by David Slater September 29th, 2010 Vim = Awesome! Vim is a powerful lightweight text editor. The name Vim is an acronym for Vi IMproved vi is an
More informationMultimedia Databases. Wolf-Tilo Balke Younès Ghammad Institut für Informationssysteme Technische Universität Braunschweig
Multimedia Databases Wolf-Tilo Balke Younès Ghammad Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de Previous Lecture Audio Retrieval - Query by Humming
More informationBlackboard 5. Instructor Manual Level One Release 5.5
Bringing Education Online Blackboard 5 Instructor Manual Level One Release 5.5 Copyright 2001 by Blackboard Inc. All rights reserved. No part of the contents of this manual may be reproduced or transmitted
More informationEncoding Concept Prototypes for Video Event Detection and Summarization
Encoding Concept Prototypes for Video Event Detection and Summarization Masoud Mazloom, Amirhossein Habibian, Dong Liu, Cees G.M. Snoek, Shih-Fu Chang University of Amsterdam Qualcomm Research Netherlands
More informationHow to ask the right questions about backup reporting products Lindsay Morris Product Architect
When the SRM Honeymoon s over How to ask the right questions about backup reporting products Lindsay Morris Product Architect The software honeymoon cycle 1. We need some help! Let s see what s out there.
More informationA Popular Introduction to the Problem. Question. Our Observations Social Cause. Question
Sharing Multimedia on the Internet and the Impact for Online Privacy A Popular Introduction to the Problem Dr. Gerald Friedland Director Audio and Multimedia Group International Computer Science Institute
More informationFig 1.1 A designer working on a personal computer
Computer systems Computers are information processing machines. They process data to produce information. The most common mistake made by people when they talk about computers is to believe they are intelligent
More informationLecture 5: Jobs and Processes
Lecture 5: and CS2042 - UNIX Tools October 8, 2008 and Lecture Outline 1 2 Manipulating and Intro to Definition: A process is an instance of a running program. More specific than a program because it s
More information745: Advanced Database Systems
745: Advanced Database Systems Yanlei Diao University of Massachusetts Amherst Outline Overview of course topics Course requirements Database Management Systems 1. Online Analytical Processing (OLAP) vs.
More informationFreesound. Frederic Font Corbera CompMusic Meeting, July 9th 2012
Outline Introduction to Uploading CompMusic content to communities and CompMusic Part I: What is? Online collaborative sound database People share audio clips under Creative Commons licenses Started in
More informationLevel 2 Designing and creating multimedia presentations (7266/ )
Level 2 Designing and creating multimedia presentations (7266/7267-030) e-quals Assignment guide for Candidates Assignment A www.cityandguilds.com/e-quals07 August 2008 Version 2.0 About City & Guilds
More informationHybrid Recommendation System Using Clustering and Collaborative Filtering
Hybrid Recommendation System Using Clustering and Collaborative Filtering Roshni Padate Assistant Professor roshni@frcrce.ac.in Priyanka Bane B.E. Student priyankabane56@gmail.com Jayesh Kudase B.E. Student
More informationZero-Example Event Detection and Recounting
Zero-Example Event Detection and Recounting Speaker: Yi-Jie Lu Yi-Jie Lu, Hao Zhang, Ting Yao, Chong-Wah Ngo On behalf of VIREO Group, City University of Hong Kong Feb. 12, 2015 Outline Multimedia Event
More informationebooks & ecomics WHAT: Book Creator is an ipad and Android app that lets you design and publish your own customized ebook.
ebooks & ecomics WHAT: Book Creator is an ipad and Android app that lets you design and publish your own customized ebook. YOUR CHALLENGE: Using data collected from your lab work, create an interactive
More informationOnline music is constantly changing. Static artist bios and old images from the archives no longer deliver an engaging experience.
Online music is constantly changing. Static artist bios and old images from the archives no longer deliver an engaging experience. Music fans want a real-time, socially-aware window into the world of music.
More informationMOBILE APPLICATIONS OVERVIEW. 21W.789 CLASS 1 Frank Bentley
MOBILE APPLICATIONS OVERVIEW 21W.789 CLASS 1 Frank Bentley Is this class for you? Today is an overview of topics/methods Project-based class Teams of 3-4 to design, build, and document a novel mobile application
More informationWhite Paper. How the Meltdown and Spectre bugs work and what you can do to prevent a performance plummet. Contents
White Paper How the Meltdown and Spectre bugs work and what you can do to prevent a performance plummet Programs that do a lot of I/O are likely to be the worst hit by the patches designed to fix the Meltdown
More informationEditing & Color Grading 101 in DaVinci Resolve 15
Editing & Color Grading 101 in DaVinci Resolve 15 1. Exploring Resolve Exploring Resolve The Media Page The Edit Page The Fusion Page The Color Page The Fairlight Page The Deliver Page The Processing Pipeline
More informationThe New Definition in Home Entertainment. Entertainment Server
The New Definition in Home Entertainment Entertainment Server Entertainment Server The Highest Quality Blu-ray Server, Period. Life is good... with Mozaex Entertainment should be a pleasure, not a chore.
More informationData Clustering on the Parallel Hadoop MapReduce Model. Dimitrios Verraros
Data Clustering on the Parallel Hadoop MapReduce Model Dimitrios Verraros Overview The purpose of this thesis is to implement and benchmark the performance of a parallel K- means clustering algorithm on
More informationViewing & Saving Items from American Memory
1-5 Viewing & Saving Items from American Memory What Do I Need to View Text Documents? The Library of Congress (LOC) American Memory collections contain hundreds of thousands of images of text documents,
More informationSEMANTIC NETWORK AND SEARCH IN VEHICLE ENGINEERING
Martin Sturm, Sylke Rosenplaenter SEMANTIC NETWORK AND SEARCH IN VEHICLE ENGINEERING From Concept to Deployment Vehicle Design Operations & System Development GM Europe Engineering Adam Opel AG www.opel.com
More informationWindows Movie Maker / Microsoft Photo Story Digital Video
Windows Movie Maker / Microsoft Photo Story Digital Video http://intranet/technology/index.html TRC HELP DESK X5092 April 2006 Photo Story and Movie Maker Microsoft Photo Story 3 allows you to create fantastic
More informationPLATFORM AND SOFTWARE AS A SERVICE THE MAPREDUCE PROGRAMMING MODEL AND IMPLEMENTATIONS
PLATFORM AND SOFTWARE AS A SERVICE THE MAPREDUCE PROGRAMMING MODEL AND IMPLEMENTATIONS By HAI JIN, SHADI IBRAHIM, LI QI, HAIJUN CAO, SONG WU and XUANHUA SHI Prepared by: Dr. Faramarz Safi Islamic Azad
More informationGet Started in Web Conference Classes: During the Semester
Get Started in Web Conference Classes: During the Semester Online classroom etiquette Log in to your WebEx class Change views, go full-screen Chat tool Class presentations Need help? 1-877-348-6503 or
More informationComputer Networking A Top Down Approach 6th Solutions
Computer Networking A Top Down Approach 6th Solutions We have made it easy for you to find a PDF Ebooks without any digging. And by having access to our ebooks online or by storing it on your computer,
More informationRecognizing Complex Events in Videos by Learning Key Static-Dynamic Evidences
Recognizing Complex Events in Videos by Learning Key Static-Dynamic Evidences Kuan-Ting Lai, Dong Liu, Ming-Syan Chen and Shih-Fu Chang Graduate Institute of Electrical Engineering, National Taiwan University,
More informationAn Interactive Web-Based System Using Cloud for Large-Scale Visual Analytics
-QEKMRKERH1YPXMQIHME%REP]XMGWMRE;IFERH1SFMPI;SVPH An Interactive Web-Based System Using Cloud for Large-Scale Visual Analytics Ahmed S. Kaseb, Everett Berry, Erik Rozolis, Kyle McNulty, Seth Bontrager,
More informationMultimodal Location Estimation on Flickr Videos
Multimodal Location Estimation on Flickr Videos Gerald Friedland, Jaeyoung Choi, Howard Lei, Adam Janin International Computer Science Institute 1947 Center Street, Suite 600 Berkeley, CA 94704-1198 {fractor,
More informationCMSC 313 COMPUTER ORGANIZATION & ASSEMBLY LANGUAGE PROGRAMMING LECTURE 27, FALL 2012
CMSC 313 COMPUTER ORGANIZATION & ASSEMBLY LANGUAGE PROGRAMMING LECTURE 27, FALL 2012 ANNOUNCEMENTS Need student input on Lecturer Search Max Morawski Lecture 2:30pm 3:15pm, Fri 12/7, ITE 217 Meet with
More informationSpecifications Document
Contents Specifications Document 1 The XMMS2 Client Project 2 1.1 Project Description................................ 2 1.2 Target Audience.................................. 2 1.3 Goals........................................
More informationIEEE TRANSACTIONS ON MULTIMEDIA 1. VRFP: On-the-fly Video Retrieval using Web Images and Fast Fisher Vector Products
IEEE TRANSACTIONS ON MULTIMEDIA 1 VRFP: On-the-fly Video Retrieval using Web Images and Fast Fisher Vector Products Xintong Han*, Bharat Singh*, Vlad I. Morariu, Larry S. Davis, Fellow, IEEE Abstract VRFP
More informationTHE FUTURE OF PERSONALIZATION IS VISUAL WHITE PAPER
WHITE PAPER The Future of Personalization is Visual 1 It s hard to believe that ecommerce has been around for more than two decades, and juggernaut sites like Amazon and ebay were first launched in the
More informationDeriving Knowledge from Audio and Multimedia Data
Deriving Knowledge from Audio and Multimedia Data? Dr. Gerald Friedland Director Audio and Multimedia Lab International Computer Science Institute Berkeley, CA fractor@icsi.berkeley.edu Multimedia in the
More informationNEW COMPANY ~ NEW ERA ~ RENEWED COMMITMENT A DEALER PROGRAM DESIGNED FOR YOUR SUCCESS
1811 Taylor Drive Gilbert, SC 29054 Office (803) 485-1544 Fax (866) 435-4111 Admin@FriendlySongs.com A division of KMConsolidated, LLC NEW COMPANY ~ NEW ERA ~ RENEWED COMMITMENT A DEALER PROGRAM DESIGNED
More informationBacktesting in the Cloud
Backtesting in the Cloud A Scalable Market Data Optimization Model for Amazon s AWS Environment A Tick Data Custom Data Solutions Group Case Study Bob Fenster, Software Engineer and AWS Certified Solutions
More informationIEOR E4008: Computational Discrete Optimization
Yuri Faenza IEOR Department Jan 23th, 2018 Logistics Instructor: Yuri Faenza Assistant Professor @ IEOR from 2016 Research area: Discrete Optimization Schedule: MW, 10:10-11:25 Room: 303 Mudd Office Hours:
More informationCybercasing the Joint: On the Privacy Implications of Geo-Tagging
Cybercasing the Joint: On the Privacy Implications of Geo-Tagging Gerald Friedland, Robin Sommer International Computer Science Institute Berkeley, CA fractor,robin@icsi.berkeley.edu What is Geotagging?
More informationPark Ranger Mobile App
Park Ranger Mobile App Oklahoma Oolagah Lake Tenkiller Ferry Lake Allatoona Lake Introduction Smart phone technology is changing the way we do business in many ways. From QR codes to Geocaching, our public
More informationCS 186/286 Spring 2018 Midterm 1
CS 186/286 Spring 2018 Midterm 1 Do not turn this page until instructed to start the exam. You should receive 1 single-sided answer sheet and a 18-page exam packet. All answers should be written on the
More informationCalendar Project. Project Brief. Part I: A Date to Remember. Assignments are evaluated for understanding
HTML and CSS Building HTML Tables and Introducing HTML5 Calendar Project HTML tables have a storied history on the Web. Championed as a Web design layout tool in the 1990s, they are now chiefly used for
More informationIntroduction to Web 2.0 Data Mashups
Lecture Notes on Web Data Management Birzeit University, Palestine 2013 Introduction to Web 2.0 Data Mashups Dr. Mustafa Jarrar University of Birzeit mjarrar@birzeit.edu www.jarrar.info Jarrar 2013 1 Watch
More informationDiscovery Education Streaming Overview
Discovery Education Streaming Overview St. Elmo Digital Literacy Team Members Cristin Cole- Facilitator Laura Dawes Stacy Davis Jennifer Tschudy A Guide to Discovery Education streaming Digital Resources
More informationNotebook paper: TNO instance search submission 2012
Notebook paper: TNO instance search submission 2012 John Schavemaker, Corné Versloot, Joost de Wit, Wessel Kraaij TNO Technical Sciences Brassersplein 2, 2612 CT, Delft, The Netherlands E-mail of corresponding
More informationUsing Lightroom. Lightroom is broken down into seven (7) modules: Library Develop Map Book Slideshow Print Web
I highly recommend buying Scott Kelby s book the Adobe Photoshop Lightroom CC book for digital photographers. It covers step by step procedures on how to use Lightroom CC. I also recommend Fast Stone Image
More informationMoodify. 1. Introduction. 2. System Architecture. 2.1 Data Fetching Component. W205-1 Rock Baek, Saru Mehta, Vincent Chio, Walter Erquingo Pezo
1. Introduction Moodify Moodify is an music web application that recommend songs to user based on mood. There are two ways a user can interact with the application. First, users can select a mood that
More informationGEOG 487 Lesson 2: Step-by-Step Activity
GEOG 487 Lesson 2: Step-by-Step Activity In Lesson 2, we are going to create a website that contains interactive maps with datasets related to our project scenario described in the Introduction. We will
More informationWaste Fleet Safety: Reducing Driver Distractions
Waste Fleet Safety: Reducing Driver Distractions White Paper www.fleetmind.com Table of Contents Introduction... 1 Types of driving distractions... 2 Reducing distractions for waste fleet drivers... 3
More informationAction recognition in videos
Action recognition in videos Cordelia Schmid INRIA Grenoble Joint work with V. Ferrari, A. Gaidon, Z. Harchaoui, A. Klaeser, A. Prest, H. Wang Action recognition - goal Short actions, i.e. drinking, sit
More informationMessage Server Change Log
Message Server Change Log MESSAGE SERVER 12.5 DECEMBER 2016 1. Possibility to configure a default template for messages created via the API; 2. Possibility to show article geo location in the PC/TV Players;
More informationSupplementary Materials of Bridging the Ultimate Semantic Gap: A Semantic Search Engine for Internet Videos
Supplementary Materials of Bridging the Ultimate Semantic Gap: A Semantic Search Engine for Internet Videos Lu Jiang 1, Shoou-I Yu 1, Deyu Meng 2, Teruko Mitamura 1, Alexander G. Hauptmann 1 1 School of
More information