MULTIMEDIA ANALYTICS: SYNERGY BETWEEN HUMAN AND MACHINE BY VISUALIZATION

Size: px
Start display at page:

Download "MULTIMEDIA ANALYTICS: SYNERGY BETWEEN HUMAN AND MACHINE BY VISUALIZATION"

Transcription

1 MULTIMEDIA ANALYTICS: SYNERGY BETWEEN HUMAN AND MACHINE BY VISUALIZATION Marcel Worring, Jan Zahálka, Stevan Rudinac Intelligent Systems Lab Amsterdam Amsterdam Data Science University of Amsterdam Amsterdam Data Science

2 INTRODUCTION Multimedia data increasingly important

3 INTRODUCTION Multimedia data increasingly important Valuable sources of knowledge, for example: Forensics: analyze multimedia data for evidence of ISIS involvement Travel industry: analyze social media data to map trending places of interest...

4 MULTIMEDIA AS A KNOWLEDGE SOURCE Night Watch by Rembrandt. How to describe it? g

5 MULTIMEDIA AS A KNOWLEDGE SOURCE Art? Painting? People? Military unit? Amsterdam? g

6 MULTIMEDIA AS A KNOWLEDGE SOURCE Art? Painting? People? Military unit? Amsterdam?... Content, technical parameters, geo location,...

7 MULTIMEDIA AS A KNOWLEDGE SOURCE Description depends on context provided by the analyst Analyst needs to interact with the system

8 MULTIMEDIA AS A KNOWLEDGE SOURCE Image Tags Comments Metadata... Multimedia items contain multiple types of data Integrating them improves the information gain

9 M ULTIMEDIA AS A K NOWLEDGE S OURCE I What if we have millions of images, tags, metadata...? Intelligent navigation capabilities required from the system

10 MULTIMEDIA ANALYTICS How do we move towards interactive, intelligent, and integrated multimedia systems?

11 MULTIMEDIA ANALYTICS How do we move towards interactive, intelligent, and integrated multimedia systems? Possible answer: multimedia analytics InfoVis Multimedia Analytics Visual Analytics Multimedia Analysis

12 RELATED WORK Extensive survey work involving 800 references

13 RELATED WORK Extensive survey work involving 800 references Covered relevant work from last 10 years: Multimedia analytics Multimedia visualization Information visualization Visual analytics Automated multimedia analysis

14 RELATED WORK Extensive survey work involving 800 references Covered relevant work from last 10 years: Multimedia analytics Multimedia visualization Information visualization Visual analytics Automated multimedia analysis Multimedia Analytics Article Library (MAAL): staff.fnwi.uva.nl/j.zahalka/maal.html 374 catalogued references

15 PIPELINE Visualization Data MM collection Images Annotations Metadata interactive navigation model update directions Model Knowledge Category 1 people 61 items... Category 2 nature 93 items Multimedia instantiation of the visual analytics process (Keim et al., Visual analytics: Scope and challenges, 2008)

16 TASK MODEL Exploration Search Exploration: uncovering the overall structure Search: finding particular items

17 TASK MODEL Exploration Search Exploration: uncovering the overall structure Search: finding particular items Exploration-search axis: E-S ratio changes dynamically

18 TASK MODEL Exploration Start Search Exploration: uncovering the overall structure Search: finding particular items Exploration-search axis: E-S ratio changes dynamically

19 TASK MODEL Exploration Start End Search Exploration: uncovering the overall structure Search: finding particular items Exploration-search axis: E-S ratio changes dynamically

20 TASK MODEL Exploration Start End Search Exploration: uncovering the overall structure Search: finding particular items Exploration-search axis: E-S ratio changes dynamically Mental model attributes: semantic categorical

21 TASK MODEL Exploration Start Categorization End Search Exploration: uncovering the overall structure Search: finding particular items Exploration-search axis: E-S ratio changes dynamically Mental model attributes: semantic categorical

22 CATEGORIZATION Categorization assigning individual multimedia items into categories defined by the analyst

23 CHALLENGE: THE GAPS Multimedia analysis capabilities very different for humans and machines

24 CHALLENGE: THE GAPS semantic gap Complex and abstract semantics Recognized instantly Put in context Limited semantics Takes time, computationally costly No context Multimedia analysis capabilities very different for humans and machines Semantic gap [Smeulders et al. 2000] richness of semantics

25 CHALLENGE: THE GAPS pragmatic gap New categories on the fly Non-exclusive categories Dynamic category semantics Static no. of classes Exclusive classes Static class semantics Multimedia analysis capabilities very different for humans and machines Semantic gap [Smeulders et al. 2000] richness of semantics Pragmatic gap (our work) flexibility of the model

26 SIMILARITY BROWSER

27 FORK BROWSER

28 PHOTO CUBE

29 MULTIMEDIA PIVOT TABLES

30 STATE OF THE ART pragmatic gap Advanced Goal Intermediate Similarity browser MediaTable INA browser Limited Canopy Informedia svisit I-SI Newdle semantic gap Limited Intermediate Advanced

31 STATE OF THE ART pragmatic gap Advanced Goal Intermediate Similarity browser MediaTable INA browser Limited Canopy Informedia svisit I-SI Newdle semantic gap Limited Intermediate Advanced Systems advance w.r.t. gaps

32 STATE OF THE ART pragmatic gap Advanced Goal Intermediate Similarity browser MediaTable INA browser Limited Canopy Informedia svisit I-SI Newdle semantic gap Limited Intermediate Advanced Systems advance w.r.t. gaps Algorithms and techniques allow realization of our model

33 INSTANTIATING THE MODEL

34 NEW YORKER MELANGE Interactive New York venue recommender

35 NEW YORKER MELANGE Interactive New York venue recommender Explore the city through the eyes of social media users that share interests with you.

36 NEW YORKER MELANGE Interactive New York venue recommender Explore the city through the eyes of social media users that share interests with you. newyorkermelange.com

37 NEW YORKER MELANGE Interactive New York venue recommender Explore the city through the eyes of social media users that share interests with you. newyorkermelange.com ACM Multimedia Grand Challenge st Prize

38 NEW YORKER MELANGE: INGREDIENTS Grid, map Visual & text features for venues & users indicate relevant users & venues suggest more relevant users & venues Interesting venues to visit SVM

39 NEW YORKER MELANGE: INGREDIENTS Grid, map Visual & text features for venues & users indicate relevant users & venues suggest more relevant users & venues Interesting venues to visit SVM Exploration NY Melange Search

40 N EW YORKER M ELANGE

41 N EW YORKER M ELANGE

42 DATASET New York venues Venue images

43 DATASET Q(venue name,geo) New York venues Venue images Images, metadata

44 DATASET >1M New York venue images with metadata

45 DATASET >1M New York venue images with metadata Real dataset with a purpose

46 DATASET >1M New York venue images with metadata Real dataset with a purpose Query strategy designed to reduce noise Exploitable size-noise tradeoff

47 DATASET >1M New York venue images with metadata Real dataset with a purpose Query strategy designed to reduce noise Exploitable size-noise tradeoff Each image has a venue category label ready for classification

48 VENUE/USER TOPICS Dataset Images Foursquare Flickr Picasa Annotations

49 VENUE/USER TOPICS Dataset Images Foursquare Flickr Picasa Annotations ConvNet LDA Features 1000 visual concepts 100 latent topics

50 VENUE/USER TOPICS Dataset Images Foursquare Flickr Picasa Annotations ConvNet LDA Features 1000 visual concepts 100 latent topics Clustering Venue topics Visual Text User topics Visual Text

51 USER PREFERENCE LEARNING Initial interface

52 USER PREFERENCE LEARNING empty Negatives Initial interface +relevant venues Positives

53 USER PREFERENCE LEARNING empty Negatives (random sample) User topics Initial interface +relevant venues Positives

54 USER PREFERENCE LEARNING empty Negatives (random sample) User topics Initial interface Linear SVM +relevant venues Positives

55 USER PREFERENCE LEARNING empty Negatives (random sample) User topics Initial interface Linear SVM User ranking +relevant venues Positives

56 USER PREFERENCE LEARNING empty Negatives (random sample) User topics Initial interface Linear SVM User ranking +relevant venues Positives Venue topics Venue selection

57 USER PREFERENCE LEARNING empty Negatives (random sample) User topics Initial interface Linear SVM User ranking +relevant venues Positives Map Venue topics Venue interface selection

58 USER PREFERENCE LEARNING empty Negatives (random sample) +non-relevant User topics Initial interface Linear SVM users User ranking +relevant venues Positives Map +relevant users Venue topics Venue interface selection

59 USER PREFERENCE LEARNING empty Negatives (random sample) +non-relevant User topics Initial interface Linear SVM users User ranking +relevant venues Positives Map +relevant users Venue topics Venue interface selection

60 EVALUATION: SCHEME Real user data

61 EVALUATION: SCHEME Real user data 25% of the visited venues withheld, rest used to seed the system

62 EVALUATION: SCHEME Real user data 25% of the visited venues withheld, rest used to seed the system 10 interaction rounds

63 EVALUATION: SCHEME Real user data 25% of the visited venues withheld, rest used to seed the system 10 interaction rounds Measure: average recall of the withheld venues

64 EVALUATION: SCHEME Real user data 25% of the visited venues withheld, rest used to seed the system 10 interaction rounds Measure: average recall of the withheld venues Only exact withheld venues count as match

65 EVALUATION: RESULTS Baseline NYM-V NYM-T NYM-VT 0.25 Average Recall Interaction Round

66 FUTURE OF MELANGE: SOFTWARE Consolidated Melange deployable everywhere

67 FUTURE OF MELANGE: SOFTWARE Consolidated Melange deployable everywhere Amsterdam

68 FUTURE OF MELANGE: SOFTWARE Consolidated Melange deployable everywhere Amsterdam Hong Kong

69 FUTURE OF MELANGE: SOFTWARE Consolidated Melange deployable everywhere Amsterdam Hong Kong Beijing

70 FUTURE OF MELANGE: SOFTWARE Consolidated Melange deployable everywhere Amsterdam Hong Kong Beijing Washington, D. C.

71 FUTURE OF MELANGE: SOFTWARE Consolidated Melange deployable everywhere Amsterdam Hong Kong Beijing Washington, D. C. Prague

72 FUTURE OF MELANGE: SOFTWARE Consolidated Melange deployable everywhere Amsterdam Hong Kong Beijing Washington, D. C. Prague Rennes

73 FUTURE OF MELANGE: SOFTWARE Consolidated Melange deployable everywhere Amsterdam Hong Kong Beijing Washington, D. C. Prague Rennes...

74 C ONCLUSION I A model of multimedia analytics integration, tasks and challenges Images Text Metadata

75 C ONCLUSION I I A model of multimedia analytics integration, tasks and challenges Based on extensive survey work I Multimedia Analytics Article Library: staff.fnwi.uva.nl/j.zahalka/maal.html Images Text Metadata

76 C ONCLUSION I I A model of multimedia analytics integration, tasks and challenges Based on extensive survey work I I Multimedia Analytics Article Library: staff.fnwi.uva.nl/j.zahalka/maal.html Current state-of-the-art techniques allow realization I Ample research opportunities in closing the gaps Images Text Metadata

77 C ONCLUSION I I A model of multimedia analytics integration, tasks and challenges Based on extensive survey work I I Current state-of-the-art techniques allow realization I I Multimedia Analytics Article Library: staff.fnwi.uva.nl/j.zahalka/maal.html Ample research opportunities in closing the gaps Model already successfuly instantiated I New Yorker Melange: newyorkermelange.com Images Text Metadata

arxiv: v1 [cs.mm] 12 Jan 2016

arxiv: v1 [cs.mm] 12 Jan 2016 Learning Subclass Representations for Visually-varied Image Classification Xinchao Li, Peng Xu, Yue Shi, Martha Larson, Alan Hanjalic Multimedia Information Retrieval Lab, Delft University of Technology

More information

ACM MM Dong Liu, Shuicheng Yan, Yong Rui and Hong-Jiang Zhang

ACM MM Dong Liu, Shuicheng Yan, Yong Rui and Hong-Jiang Zhang ACM MM 2010 Dong Liu, Shuicheng Yan, Yong Rui and Hong-Jiang Zhang Harbin Institute of Technology National University of Singapore Microsoft Corporation Proliferation of images and videos on the Internet

More information

Semantic Website Clustering

Semantic Website Clustering Semantic Website Clustering I-Hsuan Yang, Yu-tsun Huang, Yen-Ling Huang 1. Abstract We propose a new approach to cluster the web pages. Utilizing an iterative reinforced algorithm, the model extracts semantic

More information

Topic Diversity Method for Image Re-Ranking

Topic Diversity Method for Image Re-Ranking Topic Diversity Method for Image Re-Ranking D.Ashwini 1, P.Jerlin Jeba 2, D.Vanitha 3 M.E, P.Veeralakshmi M.E., Ph.D 4 1,2 Student, 3 Assistant Professor, 4 Associate Professor 1,2,3,4 Department of Information

More information

Kristina Lerman University of Southern California. This lecture is partly based on slides prepared by Anon Plangprasopchok

Kristina Lerman University of Southern California. This lecture is partly based on slides prepared by Anon Plangprasopchok Kristina Lerman University of Southern California This lecture is partly based on slides prepared by Anon Plangprasopchok Social Web is a platform for people to create, organize and share information Users

More information

Supervised Models for Multimodal Image Retrieval based on Visual, Semantic and Geographic Information

Supervised Models for Multimodal Image Retrieval based on Visual, Semantic and Geographic Information Supervised Models for Multimodal Image Retrieval based on Visual, Semantic and Geographic Information Duc-Tien Dang-Nguyen, Giulia Boato, Alessandro Moschitti, Francesco G.B. De Natale Department of Information

More information

Query-Sensitive Similarity Measure for Content-Based Image Retrieval

Query-Sensitive Similarity Measure for Content-Based Image Retrieval Query-Sensitive Similarity Measure for Content-Based Image Retrieval Zhi-Hua Zhou Hong-Bin Dai National Laboratory for Novel Software Technology Nanjing University, Nanjing 2193, China {zhouzh, daihb}@lamda.nju.edu.cn

More information

Technical Brief: Domain Risk Score Proactively uncover threats using DNS and data science

Technical Brief: Domain Risk Score Proactively uncover threats using DNS and data science Technical Brief: Domain Risk Score Proactively uncover threats using DNS and data science 310 Million + Current Domain Names 11 Billion+ Historical Domain Profiles 5 Million+ New Domain Profiles Daily

More information

Non-negative Matrix Factorization for Multimodal Image Retrieval

Non-negative Matrix Factorization for Multimodal Image Retrieval Non-negative Matrix Factorization for Multimodal Image Retrieval Fabio A. González PhD Bioingenium Research Group Computer Systems and Industrial Engineering Department Universidad Nacional de Colombia

More information

A Text-Based Approach to the ImageCLEF 2010 Photo Annotation Task

A Text-Based Approach to the ImageCLEF 2010 Photo Annotation Task A Text-Based Approach to the ImageCLEF 2010 Photo Annotation Task Wei Li, Jinming Min, Gareth J. F. Jones Center for Next Generation Localisation School of Computing, Dublin City University Dublin 9, Ireland

More information

Classifying Twitter Data in Multiple Classes Based On Sentiment Class Labels

Classifying Twitter Data in Multiple Classes Based On Sentiment Class Labels Classifying Twitter Data in Multiple Classes Based On Sentiment Class Labels Richa Jain 1, Namrata Sharma 2 1M.Tech Scholar, Department of CSE, Sushila Devi Bansal College of Engineering, Indore (M.P.),

More information

Non-negative Matrix Factorization for Multimodal Image Retrieval

Non-negative Matrix Factorization for Multimodal Image Retrieval Non-negative Matrix Factorization for Multimodal Image Retrieval Fabio A. González PhD Machine Learning 2015-II Universidad Nacional de Colombia F. González NMF for MM IR ML 2015-II 1 / 54 Outline 1 The

More information

IJREAT International Journal of Research in Engineering & Advanced Technology, Volume 1, Issue 5, Oct-Nov, 2013 ISSN:

IJREAT International Journal of Research in Engineering & Advanced Technology, Volume 1, Issue 5, Oct-Nov, 2013 ISSN: Semi Automatic Annotation Exploitation Similarity of Pics in i Personal Photo Albums P. Subashree Kasi Thangam 1 and R. Rosy Angel 2 1 Assistant Professor, Department of Computer Science Engineering College,

More information

LaHC at CLEF 2015 SBS Lab

LaHC at CLEF 2015 SBS Lab LaHC at CLEF 2015 SBS Lab Nawal Ould-Amer, Mathias Géry To cite this version: Nawal Ould-Amer, Mathias Géry. LaHC at CLEF 2015 SBS Lab. Conference and Labs of the Evaluation Forum, Sep 2015, Toulouse,

More information

SLIPO. Scalable Linking and Integration of Big POI data. Giorgos Giannopoulos IMIS/Athena RC

SLIPO. Scalable Linking and Integration of Big POI data. Giorgos Giannopoulos IMIS/Athena RC SLIPO Scalable Linking and Integration of Big POI data I n f o r m a ti o n a n d N e t w o r ki n g D a y s o n H o ri z o n 2 0 2 0 B i g Da ta Public-Priva te Partnership To p i c : I C T 14 B i g D

More information

BUAA AUDR at ImageCLEF 2012 Photo Annotation Task

BUAA AUDR at ImageCLEF 2012 Photo Annotation Task BUAA AUDR at ImageCLEF 2012 Photo Annotation Task Lei Huang, Yang Liu State Key Laboratory of Software Development Enviroment, Beihang University, 100191 Beijing, China huanglei@nlsde.buaa.edu.cn liuyang@nlsde.buaa.edu.cn

More information

Social Tagging. Kristina Lerman. USC Information Sciences Institute Thanks to Anon Plangprasopchok for providing material for this lecture.

Social Tagging. Kristina Lerman. USC Information Sciences Institute Thanks to Anon Plangprasopchok for providing material for this lecture. Social Tagging Kristina Lerman USC Information Sciences Institute Thanks to Anon Plangprasopchok for providing material for this lecture. essembly Bugzilla delicious Social Web essembly Bugzilla Social

More information

Mining the Web 2.0 to improve Search

Mining the Web 2.0 to improve Search Mining the Web 2.0 to improve Search Ricardo Baeza-Yates VP, Yahoo! Research Agenda The Power of Data Examples Improving Image Search (Faceted Clusters) Searching the Wikipedia (Correlator) Understanding

More information

The Stanford/Technicolor/Fraunhofer HHI Video Semantic Indexing System

The Stanford/Technicolor/Fraunhofer HHI Video Semantic Indexing System The Stanford/Technicolor/Fraunhofer HHI Video Semantic Indexing System Our first participation on the TRECVID workshop A. F. de Araujo 1, F. Silveira 2, H. Lakshman 3, J. Zepeda 2, A. Sheth 2, P. Perez

More information

USING THE MUSICBRAINZ DATABASE IN THE CLASSROOM. Cédric Mesnage Southampton Solent University United Kingdom

USING THE MUSICBRAINZ DATABASE IN THE CLASSROOM. Cédric Mesnage Southampton Solent University United Kingdom USING THE MUSICBRAINZ DATABASE IN THE CLASSROOM Cédric Mesnage Southampton Solent University United Kingdom Abstract Musicbrainz is a crowd-sourced database of music metadata. The level 6 class of Data

More information

Recommendation System for Location-based Social Network CS224W Project Report

Recommendation System for Location-based Social Network CS224W Project Report Recommendation System for Location-based Social Network CS224W Project Report Group 42, Yiying Cheng, Yangru Fang, Yongqing Yuan 1 Introduction With the rapid development of mobile devices and wireless

More information

An Enhanced Image Retrieval Using K-Mean Clustering Algorithm in Integrating Text and Visual Features

An Enhanced Image Retrieval Using K-Mean Clustering Algorithm in Integrating Text and Visual Features An Enhanced Image Retrieval Using K-Mean Clustering Algorithm in Integrating Text and Visual Features S.Najimun Nisha 1, Mrs.K.A.Mehar Ban 2, 1 PG Student, SVCET, Puliangudi. najimunnisha@yahoo.com 2 AP/CSE,

More information

Experimental Design for Machine Learning on Multimedia Data See:

Experimental Design for Machine Learning on Multimedia Data See: Experimental Design for Machine Learning on Multimedia Data See: http://www.icsi.berkeley.edu/~fractor/spring2019/ Dr. Gerald Friedland, fractor@eecs.berkeley.edu 1 was: Hands On: Multimedia Methods for

More information

Developing Focused Crawlers for Genre Specific Search Engines

Developing Focused Crawlers for Genre Specific Search Engines Developing Focused Crawlers for Genre Specific Search Engines Nikhil Priyatam Thesis Advisor: Prof. Vasudeva Varma IIIT Hyderabad July 7, 2014 Examples of Genre Specific Search Engines MedlinePlus Naukri.com

More information

DL User Interfaces. Giuseppe Santucci Dipartimento di Informatica e Sistemistica Università di Roma La Sapienza

DL User Interfaces. Giuseppe Santucci Dipartimento di Informatica e Sistemistica Università di Roma La Sapienza DL User Interfaces Giuseppe Santucci Dipartimento di Informatica e Sistemistica Università di Roma La Sapienza Delos work on DL interfaces Delos Cluster 4: User interfaces and visualization Cluster s goals:

More information

Learning to Match. Jun Xu, Zhengdong Lu, Tianqi Chen, Hang Li

Learning to Match. Jun Xu, Zhengdong Lu, Tianqi Chen, Hang Li Learning to Match Jun Xu, Zhengdong Lu, Tianqi Chen, Hang Li 1. Introduction The main tasks in many applications can be formalized as matching between heterogeneous objects, including search, recommendation,

More information

An Efficient Methodology for Image Rich Information Retrieval

An Efficient Methodology for Image Rich Information Retrieval An Efficient Methodology for Image Rich Information Retrieval 56 Ashwini Jaid, 2 Komal Savant, 3 Sonali Varma, 4 Pushpa Jat, 5 Prof. Sushama Shinde,2,3,4 Computer Department, Siddhant College of Engineering,

More information

Multimedia Data Management M

Multimedia Data Management M ALMA MATER STUDIORUM - UNIVERSITÀ DI BOLOGNA Multimedia Data Management M Second cycle degree programme (LM) in Computer Engineering University of Bologna Semantic Multimedia Data Annotation Home page:

More information

Total Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval O. Chum, et al.

Total Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval O. Chum, et al. Total Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval O. Chum, et al. Presented by Brandon Smith Computer Vision Fall 2007 Objective Given a query image of an object,

More information

INFORMATION MANAGEMENT FOR SEMANTIC REPRESENTATION IN RANDOM FOREST

INFORMATION MANAGEMENT FOR SEMANTIC REPRESENTATION IN RANDOM FOREST International Journal of Computer Engineering and Applications, Volume IX, Issue VIII, August 2015 www.ijcea.com ISSN 2321-3469 INFORMATION MANAGEMENT FOR SEMANTIC REPRESENTATION IN RANDOM FOREST Miss.Priyadarshani

More information

An Introduction to Search Engines and Web Navigation

An Introduction to Search Engines and Web Navigation An Introduction to Search Engines and Web Navigation MARK LEVENE ADDISON-WESLEY Ал imprint of Pearson Education Harlow, England London New York Boston San Francisco Toronto Sydney Tokyo Singapore Hong

More information

In the recent past, the World Wide Web has been witnessing an. explosive growth. All the leading web search engines, namely, Google,

In the recent past, the World Wide Web has been witnessing an. explosive growth. All the leading web search engines, namely, Google, 1 1.1 Introduction In the recent past, the World Wide Web has been witnessing an explosive growth. All the leading web search engines, namely, Google, Yahoo, Askjeeves, etc. are vying with each other to

More information

[ PARADIGM SCIENTIFIC SEARCH ] A POWERFUL SOLUTION for Enterprise-Wide Scientific Information Access

[ PARADIGM SCIENTIFIC SEARCH ] A POWERFUL SOLUTION for Enterprise-Wide Scientific Information Access A POWERFUL SOLUTION for Enterprise-Wide Scientific Information Access ENABLING EASY ACCESS TO Enterprise-Wide Scientific Information Waters Paradigm Scientific Search Software enables fast, easy, high

More information

Chapter 27 Introduction to Information Retrieval and Web Search

Chapter 27 Introduction to Information Retrieval and Web Search Chapter 27 Introduction to Information Retrieval and Web Search Copyright 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 27 Outline Information Retrieval (IR) Concepts Retrieval

More information

IBM Research - China

IBM Research - China TIARA: A Visual Exploratory Text Analytic System Furu Wei +, Shixia Liu +, Yangqiu Song +, Shimei Pan #, Michelle X. Zhou*, Weihong Qian +, Lei Shi +, Li Tan + and Qiang Zhang + + IBM Research China, Beijing,

More information

Leveraging flickr images for object detection

Leveraging flickr images for object detection Leveraging flickr images for object detection Elisavet Chatzilari Spiros Nikolopoulos Yiannis Kompatsiaris Outline Introduction to object detection Our proposal Experiments Current research 2 Introduction

More information

IEEE 2013 JAVA PROJECTS Contact No: KNOWLEDGE AND DATA ENGINEERING

IEEE 2013 JAVA PROJECTS  Contact No: KNOWLEDGE AND DATA ENGINEERING IEEE 2013 JAVA PROJECTS www.chennaisunday.com Contact No: 9566137117 KNOWLEDGE AND DATA ENGINEERING (DATA MINING) 1. A Fast Clustering-Based Feature Subset Selection Algorithm for High Dimensional Data

More information

Tuesday, April 19, 2016

Tuesday, April 19, 2016 Relativity Users Group Richmond Assisted Review Best Practices & Tips Tuesday, April 19, 2016 Agenda Planning Stage Checklists Index Optimization Reviewer Training Project Stage Random vs. Judgmental Sampling

More information

AUTOMATIC VISUAL CONCEPT DETECTION IN VIDEOS

AUTOMATIC VISUAL CONCEPT DETECTION IN VIDEOS AUTOMATIC VISUAL CONCEPT DETECTION IN VIDEOS Nilam B. Lonkar 1, Dinesh B. Hanchate 2 Student of Computer Engineering, Pune University VPKBIET, Baramati, India Computer Engineering, Pune University VPKBIET,

More information

Crawling, Indexing, and Similarity Searching Images on the Web

Crawling, Indexing, and Similarity Searching Images on the Web Crawling, Indexing, and Similarity Searching Images on the Web (Extended Abstract) M. Batko 1 and F. Falchi 2 and C. Lucchese 2 and D. Novak 1 and R. Perego 2 and F. Rabitti 2 and J. Sedmidubsky 1 and

More information

Social Business Intelligence in Action

Social Business Intelligence in Action Social Business Intelligence in ction Matteo Francia, nrico Gallinucci, Matteo Golfarelli, Stefano Rizzi DISI University of Bologna, Italy Introduction Several Social-Media Monitoring tools are available

More information

Classifying Images with Visual/Textual Cues. By Steven Kappes and Yan Cao

Classifying Images with Visual/Textual Cues. By Steven Kappes and Yan Cao Classifying Images with Visual/Textual Cues By Steven Kappes and Yan Cao Motivation Image search Building large sets of classified images Robotics Background Object recognition is unsolved Deformable shaped

More information

UvA-DARE (Digital Academic Repository) Active Bucket Categorization for High Recall Video Retrieval de Rooij, O.; Worring, M.

UvA-DARE (Digital Academic Repository) Active Bucket Categorization for High Recall Video Retrieval de Rooij, O.; Worring, M. UvA-DARE (Digital Academic Repository) Active Bucket Categorization for High Recall Video Retrieval de Rooij, O.; Worring, M. Published in: IEEE Transactions on Multimedia DOI: 10.1109/TMM.2013.2237894

More information

PASSPORT USER GUIDE. This guide provides a detailed overview of how to use Passport, allowing you to find the information you need more efficiently.

PASSPORT USER GUIDE. This guide provides a detailed overview of how to use Passport, allowing you to find the information you need more efficiently. PASSPORT USER GUIDE Euromonitor International s Passport is an integrated online database, providing business intelligence on industries, economies and consumers. Its simple-to-use interface makes it easy

More information

An Improvement of Search Results Access by Designing a Search Engine Result Page with a Clustering Technique

An Improvement of Search Results Access by Designing a Search Engine Result Page with a Clustering Technique An Improvement of Search Results Access by Designing a Search Engine Result Page with a Clustering Technique 60 2 Within-Subjects Design Counter Balancing Learning Effect 1 [1 [2www.worldwidewebsize.com

More information

Part 11: Collaborative Filtering. Francesco Ricci

Part 11: Collaborative Filtering. Francesco Ricci Part : Collaborative Filtering Francesco Ricci Content An example of a Collaborative Filtering system: MovieLens The collaborative filtering method n Similarity of users n Methods for building the rating

More information

Chapter 5: Summary and Conclusion CHAPTER 5 SUMMARY AND CONCLUSION. Chapter 1: Introduction

Chapter 5: Summary and Conclusion CHAPTER 5 SUMMARY AND CONCLUSION. Chapter 1: Introduction CHAPTER 5 SUMMARY AND CONCLUSION Chapter 1: Introduction Data mining is used to extract the hidden, potential, useful and valuable information from very large amount of data. Data mining tools can handle

More information

InBeat: News Recommender System as a CLEF-NEWSREEL 14

InBeat: News Recommender System as a CLEF-NEWSREEL 14 InBeat: News Recommender System as a Service @ CLEF-NEWSREEL 14 Jaroslav Kuchař 1,2 and Tomáš Kliegr 2,3 1 Web Engineering Group, Faculty of Information Technology, Czech Technical University in Prague

More information

Search Framework for a Large Digital Records Archive DLF SPRING 2007 April 23-25, 25, 2007 Dyung Le & Quyen Nguyen ERA Systems Engineering National Ar

Search Framework for a Large Digital Records Archive DLF SPRING 2007 April 23-25, 25, 2007 Dyung Le & Quyen Nguyen ERA Systems Engineering National Ar Search Framework for a Large Digital Records Archive DLF SPRING 2007 April 23-25, 25, 2007 Dyung Le & Quyen Nguyen ERA Systems Engineering National Archives & Records Administration Agenda ERA Overview

More information

3) CHARLIE HULL. Implementing open source search for a major specialist recruiting firm

3) CHARLIE HULL. Implementing open source search for a major specialist recruiting firm Advice: The time spent on pre-launch analysis is worth the effort to avoid starting from scratch and further alienating already frustrated users by implementing a search which appears to have no connection

More information

Effect of log-based Query Term Expansion on Retrieval Effectiveness in Patent Searching

Effect of log-based Query Term Expansion on Retrieval Effectiveness in Patent Searching Effect of log-based Query Term Expansion on Retrieval Effectiveness in Patent Searching Wolfgang Tannebaum, Parvaz Madabi and Andreas Rauber Institute of Software Technology and Interactive Systems, Vienna

More information

White Paper. EVERY THING CONNECTED How Web Object Technology Is Putting Every Physical Thing On The Web

White Paper. EVERY THING CONNECTED How Web Object Technology Is Putting Every Physical Thing On The Web White Paper EVERY THING CONNECTED Is Putting Every Physical Thing Every Thing Connected The Internet of Things a term first used by technology visionaries at the AUTO-ID Labs at MIT in the 90s 1 has received

More information

This tutorial has been prepared for computer science graduates to help them understand the basic-to-advanced concepts related to data mining.

This tutorial has been prepared for computer science graduates to help them understand the basic-to-advanced concepts related to data mining. About the Tutorial Data Mining is defined as the procedure of extracting information from huge sets of data. In other words, we can say that data mining is mining knowledge from data. The tutorial starts

More information

Link Mining & Entity Resolution. Lise Getoor University of Maryland, College Park

Link Mining & Entity Resolution. Lise Getoor University of Maryland, College Park Link Mining & Entity Resolution Lise Getoor University of Maryland, College Park Learning in Structured Domains Traditional machine learning and data mining approaches assume: A random sample of homogeneous

More information

Tag Recommendation for Photos

Tag Recommendation for Photos Tag Recommendation for Photos Gowtham Kumar Ramani, Rahul Batra, Tripti Assudani December 10, 2009 Abstract. We present a real-time recommendation system for photo annotation that can be used in Flickr.

More information

COLLABORATIVE LOCATION AND ACTIVITY RECOMMENDATIONS WITH GPS HISTORY DATA

COLLABORATIVE LOCATION AND ACTIVITY RECOMMENDATIONS WITH GPS HISTORY DATA COLLABORATIVE LOCATION AND ACTIVITY RECOMMENDATIONS WITH GPS HISTORY DATA Vincent W. Zheng, Yu Zheng, Xing Xie, Qiang Yang Hong Kong University of Science and Technology Microsoft Research Asia WWW 2010

More information

Key differentiating technologies for mobile search

Key differentiating technologies for mobile search Key differentiating technologies for mobile search Orange Labs Michel PLU, ORANGE Labs - Research & Development Exploring the Future of Mobile Search Workshop, GHENT Some key differentiating technologies

More information

PASSPORT USER GUIDE. This guide provides a detailed overview of how to use Passport, allowing you to find the information you need more efficiently.

PASSPORT USER GUIDE. This guide provides a detailed overview of how to use Passport, allowing you to find the information you need more efficiently. PASSPORT USER GUIDE Euromonitor International s Passport is an integrated online database, providing business intelligence on industries, economies and consumers. Its simple-to-use interface makes it easy

More information

OnCrawl Metrics. What SEO indicators do we analyze for you? Dig into our board of metrics to find the one you are looking for.

OnCrawl Metrics. What SEO indicators do we analyze for you? Dig into our board of metrics to find the one you are looking for. 1 OnCrawl Metrics What SEO indicators do we analyze for you? Dig into our board of metrics to find the one you are looking for. UNLEASH YOUR SEO POTENTIAL Table of content 01 Crawl Analysis 02 Logs Monitoring

More information

How GPUs Power Comcast's X1 Voice Remote and Smart Video Analytics. Jan Neumann Comcast Labs DC May 10th, 2017

How GPUs Power Comcast's X1 Voice Remote and Smart Video Analytics. Jan Neumann Comcast Labs DC May 10th, 2017 How GPUs Power Comcast's X1 Voice Remote and Smart Video Analytics Jan Neumann Comcast Labs DC May 10th, 2017 Comcast Applied Artificial Intelligence Lab Media & Video Analytics Smart TV Deep Learning

More information

Qualitative Data Analysis Software. A workshop for staff & students School of Psychology Makerere University

Qualitative Data Analysis Software. A workshop for staff & students School of Psychology Makerere University Qualitative Data Analysis Software A workshop for staff & students School of Psychology Makerere University (PhD) January 27, 2016 Outline for the workshop CAQDAS NVivo Overview Practice 2 CAQDAS Before

More information

A REVIEW ON SEARCH BASED FACE ANNOTATION USING WEAKLY LABELED FACIAL IMAGES

A REVIEW ON SEARCH BASED FACE ANNOTATION USING WEAKLY LABELED FACIAL IMAGES A REVIEW ON SEARCH BASED FACE ANNOTATION USING WEAKLY LABELED FACIAL IMAGES Dhokchaule Sagar Patare Swati Makahre Priyanka Prof.Borude Krishna ABSTRACT This paper investigates framework of face annotation

More information

Trending Words in Digital Library for Term Cloud-based Navigation

Trending Words in Digital Library for Term Cloud-based Navigation Trending Words in Digital Library for Term Cloud-based Navigation Samuel Molnár, Róbert Móro, Mária Bieliková Institute of Informatics and Software Engineering, Faculty of Informatics and Information Technologies,

More information

CIRGDISCO at RepLab2012 Filtering Task: A Two-Pass Approach for Company Name Disambiguation in Tweets

CIRGDISCO at RepLab2012 Filtering Task: A Two-Pass Approach for Company Name Disambiguation in Tweets CIRGDISCO at RepLab2012 Filtering Task: A Two-Pass Approach for Company Name Disambiguation in Tweets Arjumand Younus 1,2, Colm O Riordan 1, and Gabriella Pasi 2 1 Computational Intelligence Research Group,

More information

Information Retrieval

Information Retrieval Information Retrieval CSC 375, Fall 2016 An information retrieval system will tend not to be used whenever it is more painful and troublesome for a customer to have information than for him not to have

More information

PASSPORT USER GUIDE. This guide provides a detailed overview of how to use Passport, allowing you to find the information you need more efficiently.

PASSPORT USER GUIDE. This guide provides a detailed overview of how to use Passport, allowing you to find the information you need more efficiently. PASSPORT USER GUIDE Passport is a global market research database providing insight on industries, economies and consumers worldwide, helping our clients analyse market context and identify future trends

More information

Setting up Flickr. Open a web browser such as Internet Explorer and type this url in the address bar.

Setting up Flickr. Open a web browser such as Internet Explorer and type this url in the address bar. Workshop 15 th July 2008 Page 1 http://blog.larkin.net.au/ Setting up Flickr Flickr is a photo sharing tool that has rich functionality and allows the public to share their photographs with others., It

More information

PASSPORT USER GUIDE. This guide provides a detailed overview of how to use Passport, allowing you to find the information you need more efficiently.

PASSPORT USER GUIDE. This guide provides a detailed overview of how to use Passport, allowing you to find the information you need more efficiently. PASSPORT USER GUIDE Passport is a global market research database providing insight on industries, economies and consumers worldwide, helping our clients analyse market context and identify future trends

More information

Survey on Recommendation of Personalized Travel Sequence

Survey on Recommendation of Personalized Travel Sequence Survey on Recommendation of Personalized Travel Sequence Mayuri D. Aswale 1, Dr. S. C. Dharmadhikari 2 ME Student, Department of Information Technology, PICT, Pune, India 1 Head of Department, Department

More information

USER SEARCH INTERFACES. Design and Application

USER SEARCH INTERFACES. Design and Application USER SEARCH INTERFACES Design and Application KEEP IT SIMPLE Search is a means towards some other end, rather than a goal in itself. Search is a mentally intensive task. Task Example: You have a friend

More information

Mapping the library future: Subject navigation for today's and tomorrow's library catalogs

Mapping the library future: Subject navigation for today's and tomorrow's library catalogs University of Pennsylvania ScholarlyCommons Scholarship at Penn Libraries Penn Libraries January 2008 Mapping the library future: Subject navigation for today's and tomorrow's library catalogs John Mark

More information

Landmark Recognition: State-of-the-Art Methods in a Large-Scale Scenario

Landmark Recognition: State-of-the-Art Methods in a Large-Scale Scenario Landmark Recognition: State-of-the-Art Methods in a Large-Scale Scenario Magdalena Rischka and Stefan Conrad Institute of Computer Science Heinrich-Heine-University Duesseldorf D-40225 Duesseldorf, Germany

More information

mediax STANFORD UNIVERSITY

mediax STANFORD UNIVERSITY PUBLISH ON DEMAND TweakCorps: Re-Targeting Existing Webpages for Diverse Devices and Users FALL 2013 UPDATE mediax STANFORD UNIVERSITY mediax connects businesses with Stanford University s world-renowned

More information

Connecting relevant video content to audiences CREDENTIALS DECK

Connecting relevant video content to audiences CREDENTIALS DECK Connecting relevant video content to audiences CREDENTIALS DECK 1 Hello, We re Vilynx We've developed machine learning technology to drive video discovery and engagement. US company, headquarters in Palo

More information

Canonical Image Selection for Large-scale Flickr Photos using Hadoop

Canonical Image Selection for Large-scale Flickr Photos using Hadoop Canonical Image Selection for Large-scale Flickr Photos using Hadoop Guan-Long Wu National Taiwan University, Taipei Nov. 10, 2009, @NCHC Communication and Multimedia Lab ( 通訊與多媒體實驗室 ), Department of Computer

More information

Last Week: Visualization Design II

Last Week: Visualization Design II Last Week: Visualization Design II Chart Junks Vis Lies 1 Last Week: Visualization Design II Sensory representation Understand without learning Sensory immediacy Cross-cultural validity Arbitrary representation

More information

Beyond Ten Blue Links Seven Challenges

Beyond Ten Blue Links Seven Challenges Beyond Ten Blue Links Seven Challenges Ricardo Baeza-Yates VP of Yahoo! Research for EMEA & LatAm Barcelona, Spain Thanks to Andrei Broder, Yoelle Maarek & Prabhakar Raghavan Agenda Past and Present Wisdom

More information

KNOW At The Social Book Search Lab 2016 Suggestion Track

KNOW At The Social Book Search Lab 2016 Suggestion Track KNOW At The Social Book Search Lab 2016 Suggestion Track Hermann Ziak and Roman Kern Know-Center GmbH Inffeldgasse 13 8010 Graz, Austria hziak, rkern@know-center.at Abstract. Within this work represents

More information

Reading group on Ontologies and NLP:

Reading group on Ontologies and NLP: Reading group on Ontologies and NLP: Machine Learning27th infebruary Automated 2014 1 / 25 Te Reading group on Ontologies and NLP: Machine Learning in Automated Text Categorization, by Fabrizio Sebastianini.

More information

Scalable Data Analysis (CIS )

Scalable Data Analysis (CIS ) Scalable Data Analysis (CIS 602-01) Introduction Dr. David Koop NYC Taxi Data [Analyzing 1.1 Billion NYC Taxi and Uber Trips, with a Vengeance, T. W. Schneider] 2 What are your questions about this data?

More information

Supervised Reranking for Web Image Search

Supervised Reranking for Web Image Search for Web Image Search Query: Red Wine Current Web Image Search Ranking Ranking Features http://www.telegraph.co.uk/306737/red-wineagainst-radiation.html 2 qd, 2.5.5 0.5 0 Linjun Yang and Alan Hanjalic 2

More information

Information Retrieval

Information Retrieval Multimedia Computing: Algorithms, Systems, and Applications: Information Retrieval and Search Engine By Dr. Yu Cao Department of Computer Science The University of Massachusetts Lowell Lowell, MA 01854,

More information

Multimodal Medical Image Retrieval based on Latent Topic Modeling

Multimodal Medical Image Retrieval based on Latent Topic Modeling Multimodal Medical Image Retrieval based on Latent Topic Modeling Mandikal Vikram 15it217.vikram@nitk.edu.in Suhas BS 15it110.suhas@nitk.edu.in Aditya Anantharaman 15it201.aditya.a@nitk.edu.in Sowmya Kamath

More information

Implementation of a High-Performance Distributed Web Crawler and Big Data Applications with Husky

Implementation of a High-Performance Distributed Web Crawler and Big Data Applications with Husky Implementation of a High-Performance Distributed Web Crawler and Big Data Applications with Husky The Chinese University of Hong Kong Abstract Husky is a distributed computing system, achieving outstanding

More information

ELEC6910Q Analytics and Systems for Social Media and Big Data Applications Lecture 4. Prof. James She

ELEC6910Q Analytics and Systems for Social Media and Big Data Applications Lecture 4. Prof. James She ELEC6910Q Analytics and Systems for Social Media and Big Data Applications Lecture 4 Prof. James She james.she@ust.hk 1 Selected Works of Activity 4 2 Selected Works of Activity 4 3 Last lecture 4 Mid-term

More information

Annotating Spatio-Temporal Information in Documents

Annotating Spatio-Temporal Information in Documents Annotating Spatio-Temporal Information in Documents Jannik Strötgen University of Heidelberg Institute of Computer Science Database Systems Research Group http://dbs.ifi.uni-heidelberg.de stroetgen@uni-hd.de

More information

Vulnerability Disclosure in the Age of Social Media: Exploiting Twitter for Predicting Real-World Exploits

Vulnerability Disclosure in the Age of Social Media: Exploiting Twitter for Predicting Real-World Exploits Vulnerability Disclosure in the Age of Social Media: Exploiting Twitter for Predicting Real-World Exploits Carl Sabottke Octavian Suciu Tudor Dumitraș University of Maryland 2 Problem Increasing number

More information

User Strategies in Video Retrieval: a Case Study

User Strategies in Video Retrieval: a Case Study User Strategies in Video Retrieval: a Case Study L. Hollink 1, G.P. Nguyen 2, D.C. Koelma 2, A.Th. Schreiber 1, M. Worring 2 1 Business Informatics, Free University Amsterdam. {hollink,schreiber}@cs.vu.nl

More information

Experiments of Image Retrieval Using Weak Attributes

Experiments of Image Retrieval Using Weak Attributes Columbia University Computer Science Department Technical Report # CUCS 005-12 (2012) Experiments of Image Retrieval Using Weak Attributes Felix X. Yu, Rongrong Ji, Ming-Hen Tsai, Guangnan Ye, Shih-Fu

More information

Performance Enhancement of an Image Retrieval by Integrating Text and Visual Features

Performance Enhancement of an Image Retrieval by Integrating Text and Visual Features Performance Enhancement of an Image Retrieval by Integrating Text and Visual Features I Najimun Nisha S, II Mehar Ban K.A I Final Year ME, Dept. of CSE, S.Veerasamy Chettiar College of Engg & Tech, Puliangudi

More information

VisoLink: A User-Centric Social Relationship Mining

VisoLink: A User-Centric Social Relationship Mining VisoLink: A User-Centric Social Relationship Mining Lisa Fan and Botang Li Department of Computer Science, University of Regina Regina, Saskatchewan S4S 0A2 Canada {fan, li269}@cs.uregina.ca Abstract.

More information

Tag Based Image Search by Social Re-ranking

Tag Based Image Search by Social Re-ranking Tag Based Image Search by Social Re-ranking Vilas Dilip Mane, Prof.Nilesh P. Sable Student, Department of Computer Engineering, Imperial College of Engineering & Research, Wagholi, Pune, Savitribai Phule

More information

4 FEBRUARY, Information architecture in theory

4 FEBRUARY, Information architecture in theory Information architecture in theory Literature Rosenfeld, L., Morville, P., & Arango, J. (2015). Information architecture: For the web and beyond (4th ed.). Beijing: O Reilly. Information architecture?

More information

Image Similarity Measurements Using Hmok- Simrank

Image Similarity Measurements Using Hmok- Simrank Image Similarity Measurements Using Hmok- Simrank A.Vijay Department of computer science and Engineering Selvam College of Technology, Namakkal, Tamilnadu,india. k.jayarajan M.E (Ph.D) Assistant Professor,

More information

Overview of Web Mining Techniques and its Application towards Web

Overview of Web Mining Techniques and its Application towards Web Overview of Web Mining Techniques and its Application towards Web *Prof.Pooja Mehta Abstract The World Wide Web (WWW) acts as an interactive and popular way to transfer information. Due to the enormous

More information

Better Contextual Suggestions in ClueWeb12 Using Domain Knowledge Inferred from The Open Web

Better Contextual Suggestions in ClueWeb12 Using Domain Knowledge Inferred from The Open Web Better Contextual Suggestions in ClueWeb12 Using Domain Knowledge Inferred from The Open Web Thaer Samar 1, Alejandro Bellogín 2, and Arjen P. de Vries 1 1 Centrum Wiskunde & Informatica, {samar,arjen}@cwi.nl

More information

User Interfaces for Information Retrieval on the WWW

User Interfaces for Information Retrieval on the WWW User Interfaces for Information Retrieval on the WWW Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu INFORUM 2005 Prague May 24-27, 2005 Message On the WWW, the User Interface

More information

Photo Tourism: Exploring Photo Collections in 3D

Photo Tourism: Exploring Photo Collections in 3D Click! Click! Oooo!! Click! Zoom click! Click! Some other camera noise!! Photo Tourism: Exploring Photo Collections in 3D Click! Click! Ahhh! Click! Click! Overview of Research at Microsoft, 2007 Jeremy

More information

D B M G Data Base and Data Mining Group of Politecnico di Torino

D B M G Data Base and Data Mining Group of Politecnico di Torino DataBase and Data Mining Group of Data mining fundamentals Data Base and Data Mining Group of Data analysis Most companies own huge databases containing operational data textual documents experiment results

More information

User Strategies in Video Retrieval: a Case Study

User Strategies in Video Retrieval: a Case Study User Strategies in Video Retrieval: a Case Study L. Hollink 1, G.P. Nguyen 2, D.C. Koelma 2, A.Th. Schreiber 1, M. Worring 2 1 Section Business Informatics Free University Amsterdam De Boelelaan 1081a

More information