MAAYA: Multimedia Analysis and Access for Documentation and Decipherment of Maya Epigraphy. April Morton Gulcan Can Rui Hu. February 27 th, 2013

Size: px
Start display at page:

Download "MAAYA: Multimedia Analysis and Access for Documentation and Decipherment of Maya Epigraphy. April Morton Gulcan Can Rui Hu. February 27 th, 2013"

Transcription

1 MAAYA: Multimedia Analysis and Access for Documentation and Decipherment of Maya Epigraphy April Morton Gulcan Can Rui Hu February 27 th, 2013

2 1 The MAAYA Project Main goal: Advance the state of the art in image description and visualization techniques, while providing support to epigraphers Dr. Daniel Gatica-Perez Gulcan Can Dr. Jean-Marc Odobez Dr Rui Hu Prof. Nikolai Grube Carlos Pallan Guido Krempel Prof. Stéphane Marchand-Maillet Dr. Edgar Roman-Rangel April Morton Oscar Dabrowski

3 2 Outline Mayan Overview Project Overview Data Preparation/Storage Computer Vision Algorithms Using Context to Improve Glyph Recognition Visualization Conclusion

4 3 Mayan Overview Ancient Mayan Culture Flourished from BC AD

5 4 Mayan Overview Mayan Writing System Syllabographs Iconography Logographs

6 5 Mayan Overview Documentation Process Take Photographs Obtain Digital Line Drawings Identify Glyphs Annotate Glyphs Need better digital preservation and automatic analysis techniques

7 6 Project Overview The CODICES Project Statistical Shape Descriptors CBIR System Main goal: Develop statistical shape descriptors and a CBIR system

8 7 Project Overview The MAAYA Project Data Preparation/Storage Content-Based Data Processing/Computer Vision Algorithms High Level Analysis Visualization Main Goal: Advance the state of the art in image description and visualization techniques, while providing support to epigraphers

9 8 Data Preparation/Storage Process Segment glyphs and blocks Upload segmented page into database Annotate and store glyphs

10 9 Computer Vision Algorithms Localization Segmentation Decomposition Where is the data? Glyph Representation How to recognize the data? Identification (Classification - Retrieval) Shape Descriptors Sparse Representation Attribute Learning Part-based Representation

11 10 Computer Vision Algorithms Localization

12 11 Computer Vision Algorithms Localization

13 12 Computer Vision Algorithms Segmentation

14 13 Computer Vision Algorithms Hierarchical Decomposition Codices Page T'ol Row of Blocks Block Glyph

15 14 Computer Vision Algorithms Recognition Glyph representation + Identification Can we utilize/capture diagnostic features?

16 15 Computer Vision Algorithms Diagnostic Features

17 16 Computer Vision Algorithms Histogram-of-Orientations Shape Context

18 17 Computer Vision Algorithms Learning Features with Autoencoders

19 18 Computer Vision Algorithms Identification Glyph Retrieval Compute pivots and HOOSC descriptors k-means clustering & bag-of-visual-words representation Ranking of bov s of each glyph

20 Computer Vision Algorithms Identification - Classification Compute pivots and HOOSC descriptors Classify each pivot Apply voting for glyph-level prediction 16 19

21 Using context to improve glyph recognition 20

22 Using context to improve glyph recognition 21

23 Using context to improve glyph recognition 22

24 23 Using context to improve glyph recognition Category:T668.T102 Cha-ki Meaning: Rain god Category:T227:T561.T23 xib?-ka an-na Meaning: man, sky,?

25 24 Using context to improve glyph recognition Data preparation

26 25 Using context to improve glyph recognition Glyph matching

27 26 Using context to improve glyph recognition Glyph matching

28 27 Using context to improve glyph recognition Statistic language model Icon Translation Category:T668.T102 Cha-ki Meaning: Rain god Category:T227:T561.T23 xib?-ka an-na Meaning: man, sky,?

29 28 Using context to improve glyph recognition Context Information

30 29 Using context to improve glyph recognition Improve recognition accuracy Help with noisy and partially missing examples High-level translation

31 30 Visualization A final goal is to advance state-of-the art in effective interactive visualization tools Input Data Update Parameters Apply Data Mining Technique Accept User Input Display Visualization

32 31 Visualization Interactive Clustering MDS projection based on weighted Euclidean distance function Data from UCI wine data set Eli T. Brown, Jingjing Liu, Carla E. Brodley, Remco Chang: Dis-function: Learning distance functions interactively. IEEE VAST 2012: 83-92

33 32 Visualization Interactive Clustering Re-projection Eli T. Brown, Jingjing Liu, Carla E. Brodley, Remco Chang: Dis-function: Learning distance functions interactively. IEEE VAST 2012: 83-92

34 33 Visualization Interactive Clustering Re-projection Could think of data points as glyphs Distribution of values among attributes Updated Weights Eli T. Brown, Jingjing Liu, Carla E. Brodley, Remco Chang: Dis-function: Learning distance functions interactively. IEEE VAST 2012: 83-92

35 34 Visualization Topic Model Visualization Area encodes probabilities Can filter and sort words based on probability of co-occurrence Jason Chuang, Christopher D. Manning, Jeffrey Heer: Termite: visualization techniques for assessing textual topic models. AVI 2012: 74-77

36 35 Visualization Topic Model Visualization Can think of terms as glyphs Area encodes probabilities Can filter and sort words based on probability of co-occurrence Can think of documents as codices (add) Jason Chuang, Christopher D. Manning, Jeffrey Heer: Termite: visualization techniques for assessing textual topic models. AVI 2012: 74-77

37 36 Conclusion The MAAYA project aims to improve the entire process of digital glyph analysis Data Preparation/Storage Content-Based Data Processing/Computer Vision Algorithms High Level Analysis Visualization Main Goal: Advance the state of the art in image description and visualization techniques, while providing support to epigraphers

38 37 Acknowledgements And a special thanks to the Swiss National Science Foundation: Project CR21I2L_144238

39 Questions 38

40 Backup Slides

41 The Online Wizard The webpage includes a user friendly upload wizard for segmented files

42 The Data Annotation Page As well as a standardized data annotation page

43 5 Mayan Overview Mayan Writing System

44 6 Mayan Overview Mayan Writing System

Indexing Mayan Hieroglyphs with Neural Codes

Indexing Mayan Hieroglyphs with Neural Codes Indexing Mayan Hieroglyphs with Neural Codes Edgar Roman-Rangel CVMLab - University of Geneva. Switzerland. edgar.romanrangel@unige.ch Stephane Marchand-Maillet CVMLab - University of Geneva. Switzerland.

More information

Evaluating Shape Descriptors for Detection of Maya Hieroglyphs

Evaluating Shape Descriptors for Detection of Maya Hieroglyphs Evaluating Shape Descriptors for Detection of Maya Hieroglyphs Edgar Roman-Rangel 1, Jean-Marc Odobez 2,3, and Daniel Gatica-Perez 2,3 1 University of Geneva, Switzerland 2 Idiap Research Institute, Switzerland

More information

Evaluating Shape Representations for Maya Glyph Classification

Evaluating Shape Representations for Maya Glyph Classification Page 1 of 26 1 Evaluating Shape Representations for Maya Glyph Classification GÜLCAN CAN, JEAN-MARC ODOBEZ, and DANIEL GATICA-PEREZ, Idiap Research Institute and École Polytechnique Fédérale de Lausanne

More information

Extracting Maya Glyphs from Degraded Ancient Documents via Image Segmentation

Extracting Maya Glyphs from Degraded Ancient Documents via Image Segmentation 1 Extracting Maya Glyphs from Degraded Ancient Documents via Image Segmentation Rui Hu, Idiap Research Institute Jean-Marc Odobez, Idiap Research Institute and École Polytechnique Fédérale de Lausanne

More information

Multimodal Information Spaces for Content-based Image Retrieval

Multimodal Information Spaces for Content-based Image Retrieval Research Proposal Multimodal Information Spaces for Content-based Image Retrieval Abstract Currently, image retrieval by content is a research problem of great interest in academia and the industry, due

More information

Visual Analysis of Maya Glyphs via Crowdsourcing and Deep Learning

Visual Analysis of Maya Glyphs via Crowdsourcing and Deep Learning Visual Analysis of Maya Glyphs via Crowdsourcing and Deep Learning THÈSE N O 8058 (2017) PRÉSENTÉE LE 27 NOVEMBRE 2017 À LA FACULTÉ DES SCIENCES ET TECHNIQUES DE L'INGÉNIEUR LABORATOIRE DE L'IDIAP PROGRAMME

More information

Extracting Maya Glyphs from Degraded Ancient Documents via Image Segmentation

Extracting Maya Glyphs from Degraded Ancient Documents via Image Segmentation Extracting Maya Glyphs from Degraded Ancient Documents via Image Segmentation RUI HU, Idiap Research Institute JEAN-MARC ODOBEZ and DANIEL GATICA-PEREZ, Idiap Research Institute and École Polytechnique

More information

Class 5: Attributes and Semantic Features

Class 5: Attributes and Semantic Features Class 5: Attributes and Semantic Features Rogerio Feris, Feb 21, 2013 EECS 6890 Topics in Information Processing Spring 2013, Columbia University http://rogerioferis.com/visualrecognitionandsearch Project

More information

Recognition. Topics that we will try to cover:

Recognition. Topics that we will try to cover: Recognition Topics that we will try to cover: Indexing for fast retrieval (we still owe this one) Object classification (we did this one already) Neural Networks Object class detection Hough-voting techniques

More information

Multimodal Medical Image Retrieval based on Latent Topic Modeling

Multimodal Medical Image Retrieval based on Latent Topic Modeling Multimodal Medical Image Retrieval based on Latent Topic Modeling Mandikal Vikram 15it217.vikram@nitk.edu.in Suhas BS 15it110.suhas@nitk.edu.in Aditya Anantharaman 15it201.aditya.a@nitk.edu.in Sowmya Kamath

More information

Image Retrieval Based on its Contents Using Features Extraction

Image Retrieval Based on its Contents Using Features Extraction Image Retrieval Based on its Contents Using Features Extraction Priyanka Shinde 1, Anushka Sinkar 2, Mugdha Toro 3, Prof.Shrinivas Halhalli 4 123Student, Computer Science, GSMCOE,Maharashtra, Pune, India

More information

Artistic ideation based on computer vision methods

Artistic ideation based on computer vision methods Journal of Theoretical and Applied Computer Science Vol. 6, No. 2, 2012, pp. 72 78 ISSN 2299-2634 http://www.jtacs.org Artistic ideation based on computer vision methods Ferran Reverter, Pilar Rosado,

More information

Traffic Sign Recognition Senior Project Proposal

Traffic Sign Recognition Senior Project Proposal Traffic Sign Recognition Senior Project Proposal Jacob Carlson and Sean St. Onge Advisor Dr. Thomas Stewart December 5 th, 2007 Abstract The Traffic Sign Recognition project aims to create a system using

More information

String distance for automatic image classification

String distance for automatic image classification String distance for automatic image classification Nguyen Hong Thinh*, Le Vu Ha*, Barat Cecile** and Ducottet Christophe** *University of Engineering and Technology, Vietnam National University of HaNoi,

More information

Probabilistic Graphical Models Part III: Example Applications

Probabilistic Graphical Models Part III: Example Applications Probabilistic Graphical Models Part III: Example Applications Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Fall 2014 CS 551, Fall 2014 c 2014, Selim

More information

Searching the Past: An Improved Shape Descriptor to Retrieve Maya Hieroglyphs

Searching the Past: An Improved Shape Descriptor to Retrieve Maya Hieroglyphs Searching the Past: An Improved Shape Descriptor to Retrieve Maya Hieroglyphs Edgar Roman-Rangel 1, 2 eroman@idiap.ch Carlos Pallan Gayol 3 pallan.carlos@gmail.com Jean-Marc Odobez 1, 2 odobez@idiap.ch

More information

An Efficient Methodology for Image Rich Information Retrieval

An Efficient Methodology for Image Rich Information Retrieval An Efficient Methodology for Image Rich Information Retrieval 56 Ashwini Jaid, 2 Komal Savant, 3 Sonali Varma, 4 Pushpa Jat, 5 Prof. Sushama Shinde,2,3,4 Computer Department, Siddhant College of Engineering,

More information

Searching the Past: An Improved Shape Descriptor to Retrieve Maya Hieroglyphs

Searching the Past: An Improved Shape Descriptor to Retrieve Maya Hieroglyphs Searching the Past: An Improved Shape Descriptor to Retrieve Maya Hieroglyphs Edgar Roman-Rangel 1, 2 eroman@idiap.ch Carlos Pallan Gayol 3 pallan.carlos@gmail.com Jean-Marc Odobez 1, 2 odobez@idiap.ch

More information

Image retrieval based on bag of images

Image retrieval based on bag of images University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 2009 Image retrieval based on bag of images Jun Zhang University of Wollongong

More information

Previously. Part-based and local feature models for generic object recognition. Bag-of-words model 4/20/2011

Previously. Part-based and local feature models for generic object recognition. Bag-of-words model 4/20/2011 Previously Part-based and local feature models for generic object recognition Wed, April 20 UT-Austin Discriminative classifiers Boosting Nearest neighbors Support vector machines Useful for object recognition

More information

A Review: Content Base Image Mining Technique for Image Retrieval Using Hybrid Clustering

A Review: Content Base Image Mining Technique for Image Retrieval Using Hybrid Clustering A Review: Content Base Image Mining Technique for Image Retrieval Using Hybrid Clustering Gurpreet Kaur M-Tech Student, Department of Computer Engineering, Yadawindra College of Engineering, Talwandi Sabo,

More information

An Introduction to Content Based Image Retrieval

An Introduction to Content Based Image Retrieval CHAPTER -1 An Introduction to Content Based Image Retrieval 1.1 Introduction With the advancement in internet and multimedia technologies, a huge amount of multimedia data in the form of audio, video and

More information

CHAPTER 4 DETECTION OF DISEASES IN PLANT LEAF USING IMAGE SEGMENTATION

CHAPTER 4 DETECTION OF DISEASES IN PLANT LEAF USING IMAGE SEGMENTATION CHAPTER 4 DETECTION OF DISEASES IN PLANT LEAF USING IMAGE SEGMENTATION 4.1. Introduction Indian economy is highly dependent of agricultural productivity. Therefore, in field of agriculture, detection of

More information

Pre-Requisites: CS2510. NU Core Designations: AD

Pre-Requisites: CS2510. NU Core Designations: AD DS4100: Data Collection, Integration and Analysis Teaches how to collect data from multiple sources and integrate them into consistent data sets. Explains how to use semi-automated and automated classification

More information

A Content Based Image Retrieval System Based on Color Features

A Content Based Image Retrieval System Based on Color Features A Content Based Image Retrieval System Based on Features Irena Valova, University of Rousse Angel Kanchev, Department of Computer Systems and Technologies, Rousse, Bulgaria, Irena@ecs.ru.acad.bg Boris

More information

International Journal of Modern Trends in Engineering and Research e-issn No.: , Date: 2-4 July, 2015

International Journal of Modern Trends in Engineering and Research   e-issn No.: , Date: 2-4 July, 2015 International Journal of Modern Trends in Engineering and Research www.ijmter.com e-issn No.:2349-9745, Date: 2-4 July, 2015 SKETCH BASED IMAGE RETRIEVAL Prof. S. B. Ambhore¹, Priyank Shah², Mahendra Desarda³,

More information

VC 11/12 T14 Visual Feature Extraction

VC 11/12 T14 Visual Feature Extraction VC 11/12 T14 Visual Feature Extraction Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos Miguel Tavares Coimbra Outline Feature Vectors Colour Texture

More information

Natural Language Processing

Natural Language Processing Natural Language Processing Machine Learning Potsdam, 26 April 2012 Saeedeh Momtazi Information Systems Group Introduction 2 Machine Learning Field of study that gives computers the ability to learn without

More information

Local Features and Bag of Words Models

Local Features and Bag of Words Models 10/14/11 Local Features and Bag of Words Models Computer Vision CS 143, Brown James Hays Slides from Svetlana Lazebnik, Derek Hoiem, Antonio Torralba, David Lowe, Fei Fei Li and others Computer Engineering

More information

Beyond bags of features: Adding spatial information. Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba

Beyond bags of features: Adding spatial information. Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba Beyond bags of features: Adding spatial information Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba Adding spatial information Forming vocabularies from pairs of nearby features doublets

More information

Leaf Classification from Boundary Analysis

Leaf Classification from Boundary Analysis Leaf Classification from Boundary Analysis Anne Jorstad AMSC 663 Midterm Progress Report Fall 2007 Advisor: Dr. David Jacobs, Computer Science 1 Outline Background, Problem Statement Algorithm Validation

More information

Efficient Content Based Image Retrieval System with Metadata Processing

Efficient Content Based Image Retrieval System with Metadata Processing IJIRST International Journal for Innovative Research in Science & Technology Volume 1 Issue 10 March 2015 ISSN (online): 2349-6010 Efficient Content Based Image Retrieval System with Metadata Processing

More information

Unstructured Data. CS102 Winter 2019

Unstructured Data. CS102 Winter 2019 Winter 2019 Big Data Tools and Techniques Basic Data Manipulation and Analysis Performing well-defined computations or asking well-defined questions ( queries ) Data Mining Looking for patterns in data

More information

Search Engines. Information Retrieval in Practice

Search Engines. Information Retrieval in Practice Search Engines Information Retrieval in Practice All slides Addison Wesley, 2008 Beyond Bag of Words Bag of Words a document is considered to be an unordered collection of words with no relationships Extending

More information

Visual Material Traits Recognizing Per-Pixel Material Context

Visual Material Traits Recognizing Per-Pixel Material Context Visual Material Traits Recognizing Per-Pixel Material Context Gabriel Schwartz gbs25@drexel.edu Ko Nishino kon@drexel.edu 1 / 22 2 / 22 Materials as Visual Context What tells us this road is unsafe? 3

More information

Bing Liu. Web Data Mining. Exploring Hyperlinks, Contents, and Usage Data. With 177 Figures. Springer

Bing Liu. Web Data Mining. Exploring Hyperlinks, Contents, and Usage Data. With 177 Figures. Springer Bing Liu Web Data Mining Exploring Hyperlinks, Contents, and Usage Data With 177 Figures Springer Table of Contents 1. Introduction 1 1.1. What is the World Wide Web? 1 1.2. A Brief History of the Web

More information

Re-Ranking of Web Image Search Using Relevance Preserving Ranking Techniques

Re-Ranking of Web Image Search Using Relevance Preserving Ranking Techniques Re-Ranking of Web Image Search Using Relevance Preserving Ranking Techniques Delvia Mary Vadakkan #1, Dr.D.Loganathan *2 # Final year M. Tech CSE, MET S School of Engineering, Mala, Trissur, Kerala * HOD,

More information

PERFORMANCE EVALUATION OF ONTOLOGY AND FUZZYBASE CBIR

PERFORMANCE EVALUATION OF ONTOLOGY AND FUZZYBASE CBIR PERFORMANCE EVALUATION OF ONTOLOGY AND FUZZYBASE CBIR ABSTRACT Tajman sandhu (Research scholar) Department of Information Technology Chandigarh Engineering College, Landran, Punjab, India yuvi_taj@yahoo.com

More information

ImgSeek: Capturing User s Intent For Internet Image Search

ImgSeek: Capturing User s Intent For Internet Image Search ImgSeek: Capturing User s Intent For Internet Image Search Abstract - Internet image search engines (e.g. Bing Image Search) frequently lean on adjacent text features. It is difficult for them to illustrate

More information

IJESRT. Scientific Journal Impact Factor: (ISRA), Impact Factor: [82] [Thakur, 4(2): February, 2015] ISSN:

IJESRT. Scientific Journal Impact Factor: (ISRA), Impact Factor: [82] [Thakur, 4(2): February, 2015] ISSN: IJESRT INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY A PSEUDO RELEVANCE BASED IMAGE RETRIEVAL MODEL Kamini Thakur*, Ms. Preetika Saxena M.Tech, Computer Science &Engineering, Acropolis

More information

Data Mining: STATISTICA

Data Mining: STATISTICA Outline Data Mining: STATISTICA Prepare the data Classification and regression (C & R, ANN) Clustering Association rules Graphic user interface Prepare the Data Statistica can read from Excel,.txt and

More information

Image Retrieval Based on LBP Pyramidal Multiresolution using Reversible Watermarking

Image Retrieval Based on LBP Pyramidal Multiresolution using Reversible Watermarking Image Retrieval Based on LBP Pyramidal Multiresolution using Reversible Watermarking H. Ouahi* 1, K. Afdel* 2,M.Machkour* 3 * Laboratory Computing Systems & Vision LabSiv University Ibn Zohr of Agadir

More information

Semantic-based image analysis with the goal of assisting artistic creation

Semantic-based image analysis with the goal of assisting artistic creation Semantic-based image analysis with the goal of assisting artistic creation Pilar Rosado 1, Ferran Reverter 2, Eva Figueras 1, and Miquel Planas 1 1 Fine Arts Faculty, University of Barcelona, Spain, pilarrosado@ub.edu,

More information

Object Recognition. Lecture 11, April 21 st, Lexing Xie. EE4830 Digital Image Processing

Object Recognition. Lecture 11, April 21 st, Lexing Xie. EE4830 Digital Image Processing Object Recognition Lecture 11, April 21 st, 2008 Lexing Xie EE4830 Digital Image Processing http://www.ee.columbia.edu/~xlx/ee4830/ 1 Announcements 2 HW#5 due today HW#6 last HW of the semester Due May

More information

Case-Based Reasoning. CS 188: Artificial Intelligence Fall Nearest-Neighbor Classification. Parametric / Non-parametric.

Case-Based Reasoning. CS 188: Artificial Intelligence Fall Nearest-Neighbor Classification. Parametric / Non-parametric. CS 188: Artificial Intelligence Fall 2008 Lecture 25: Kernels and Clustering 12/2/2008 Dan Klein UC Berkeley Case-Based Reasoning Similarity for classification Case-based reasoning Predict an instance

More information

CS 188: Artificial Intelligence Fall 2008

CS 188: Artificial Intelligence Fall 2008 CS 188: Artificial Intelligence Fall 2008 Lecture 25: Kernels and Clustering 12/2/2008 Dan Klein UC Berkeley 1 1 Case-Based Reasoning Similarity for classification Case-based reasoning Predict an instance

More information

Projet ANR- 11-IS02-001

Projet ANR- 11-IS02-001 Projet ANR- 11-IS02-001 MEX-CULTURE/ Multimedia libraries indexing for the preservation and dissemination of the Mexican Culture Deliverable Final report on scalable visual descriptors Programme Blanc

More information

Recognition of Animal Skin Texture Attributes in the Wild. Amey Dharwadker (aap2174) Kai Zhang (kz2213)

Recognition of Animal Skin Texture Attributes in the Wild. Amey Dharwadker (aap2174) Kai Zhang (kz2213) Recognition of Animal Skin Texture Attributes in the Wild Amey Dharwadker (aap2174) Kai Zhang (kz2213) Motivation Patterns and textures are have an important role in object description and understanding

More information

Action Recognition & Categories via Spatial-Temporal Features

Action Recognition & Categories via Spatial-Temporal Features Action Recognition & Categories via Spatial-Temporal Features 华俊豪, 11331007 huajh7@gmail.com 2014/4/9 Talk at Image & Video Analysis taught by Huimin Yu. Outline Introduction Frameworks Feature extraction

More information

Improving Instance Search Performance in Video Collections

Improving Instance Search Performance in Video Collections Improving Instance Search Performance in Video Collections Zhenxing Zhang School of Computing Dublin City University Supervisor: Dr. Cathal Gurrin and Prof. Alan Smeaton This dissertation is submitted

More information

Outline. Prepare the data Classification and regression Clustering Association rules Graphic user interface

Outline. Prepare the data Classification and regression Clustering Association rules Graphic user interface Data Mining: i STATISTICA Outline Prepare the data Classification and regression Clustering Association rules Graphic user interface 1 Prepare the Data Statistica can read from Excel,.txt and many other

More information

Latest development in image feature representation and extraction

Latest development in image feature representation and extraction International Journal of Advanced Research and Development ISSN: 2455-4030, Impact Factor: RJIF 5.24 www.advancedjournal.com Volume 2; Issue 1; January 2017; Page No. 05-09 Latest development in image

More information

Supervised learning. y = f(x) function

Supervised learning. y = f(x) function Supervised learning y = f(x) output prediction function Image feature Training: given a training set of labeled examples {(x 1,y 1 ),, (x N,y N )}, estimate the prediction function f by minimizing the

More information

Volume 2, Issue 6, June 2014 International Journal of Advance Research in Computer Science and Management Studies

Volume 2, Issue 6, June 2014 International Journal of Advance Research in Computer Science and Management Studies Volume 2, Issue 6, June 2014 International Journal of Advance Research in Computer Science and Management Studies Research Article / Survey Paper / Case Study Available online at: www.ijarcsms.com Internet

More information

A Hybrid Image Mining Technique using LIM-based Data Mining Algorithm

A Hybrid Image Mining Technique using LIM-based Data Mining Algorithm Volume 25 o.2, July 2011 A Hybrid Mining Technique using LIM-based Data Mining Algorithm C. Lakshmi Devasena Department of Software Systems Karpagam University Coimbatore-21 M. Hemalatha Department of

More information

The Stanford/Technicolor/Fraunhofer HHI Video Semantic Indexing System

The Stanford/Technicolor/Fraunhofer HHI Video Semantic Indexing System The Stanford/Technicolor/Fraunhofer HHI Video Semantic Indexing System Our first participation on the TRECVID workshop A. F. de Araujo 1, F. Silveira 2, H. Lakshman 3, J. Zepeda 2, A. Sheth 2, P. Perez

More information

TA Section: Problem Set 4

TA Section: Problem Set 4 TA Section: Problem Set 4 Outline Discriminative vs. Generative Classifiers Image representation and recognition models Bag of Words Model Part-based Model Constellation Model Pictorial Structures Model

More information

Semantic Image Retrieval Using Correspondence Topic Model with Background Distribution

Semantic Image Retrieval Using Correspondence Topic Model with Background Distribution Semantic Image Retrieval Using Correspondence Topic Model with Background Distribution Nguyen Anh Tu Department of Computer Engineering Kyung Hee University, Korea Email: tunguyen@oslab.khu.ac.kr Jinsung

More information

A Novel Image Retrieval Method Using Segmentation and Color Moments

A Novel Image Retrieval Method Using Segmentation and Color Moments A Novel Image Retrieval Method Using Segmentation and Color Moments T.V. Saikrishna 1, Dr.A.Yesubabu 2, Dr.A.Anandarao 3, T.Sudha Rani 4 1 Assoc. Professor, Computer Science Department, QIS College of

More information

Toward Retail Product Recognition on Grocery Shelves

Toward Retail Product Recognition on Grocery Shelves Toward Retail Product Recognition on Grocery Shelves Gül Varol gul.varol@boun.edu.tr Boğaziçi University, İstanbul, Turkey İdea Teknoloji Çözümleri, İstanbul, Turkey Rıdvan S. Kuzu ridvan.salih@boun.edu.tr

More information

Visualization and text mining of patent and non-patent data

Visualization and text mining of patent and non-patent data of patent and non-patent data Anton Heijs Information Solutions Delft, The Netherlands http://www.treparel.com/ ICIC conference, Nice, France, 2008 Outline Introduction Applications on patent and non-patent

More information

Topic Model Visualization with IPython

Topic Model Visualization with IPython Topic Model Visualization with IPython Sergey Karpovich 1, Alexander Smirnov 2,3, Nikolay Teslya 2,3, Andrei Grigorev 3 1 Mos.ru, Moscow, Russia 2 SPIIRAS, St.Petersburg, Russia 3 ITMO University, St.Petersburg,

More information

Content-Based Image Retrieval. Queries Commercial Systems Retrieval Features Indexing in the FIDS System Lead-in to Object Recognition

Content-Based Image Retrieval. Queries Commercial Systems Retrieval Features Indexing in the FIDS System Lead-in to Object Recognition Content-Based Image Retrieval Queries Commercial Systems Retrieval Features Indexing in the FIDS System Lead-in to Object Recognition 1 Content-based Image Retrieval (CBIR) Searching a large database for

More information

An Efficient Semantic Image Retrieval based on Color and Texture Features and Data Mining Techniques

An Efficient Semantic Image Retrieval based on Color and Texture Features and Data Mining Techniques An Efficient Semantic Image Retrieval based on Color and Texture Features and Data Mining Techniques Doaa M. Alebiary Department of computer Science, Faculty of computers and informatics Benha University

More information

Building Effective Representations for Sketch Recognition

Building Effective Representations for Sketch Recognition Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence Building Effective Representations for Sketch Recognition Jun Guo Sun Yat-sen University, Guangzhou, P.R.China Changhu Wang Microsoft

More information

Object Recognition. Computer Vision. Slides from Lana Lazebnik, Fei-Fei Li, Rob Fergus, Antonio Torralba, and Jean Ponce

Object Recognition. Computer Vision. Slides from Lana Lazebnik, Fei-Fei Li, Rob Fergus, Antonio Torralba, and Jean Ponce Object Recognition Computer Vision Slides from Lana Lazebnik, Fei-Fei Li, Rob Fergus, Antonio Torralba, and Jean Ponce How many visual object categories are there? Biederman 1987 ANIMALS PLANTS OBJECTS

More information

FACULTY OF ENGINEERING AND INFORMATION TECHNOLOGY DEPARTMENT OF COMPUTER SCIENCE. Project Plan

FACULTY OF ENGINEERING AND INFORMATION TECHNOLOGY DEPARTMENT OF COMPUTER SCIENCE. Project Plan FACULTY OF ENGINEERING AND INFORMATION TECHNOLOGY DEPARTMENT OF COMPUTER SCIENCE Project Plan Structured Object Recognition for Content Based Image Retrieval Supervisors: Dr. Antonio Robles Kelly Dr. Jun

More information

TERM BASED WEIGHT MEASURE FOR INFORMATION FILTERING IN SEARCH ENGINES

TERM BASED WEIGHT MEASURE FOR INFORMATION FILTERING IN SEARCH ENGINES TERM BASED WEIGHT MEASURE FOR INFORMATION FILTERING IN SEARCH ENGINES Mu. Annalakshmi Research Scholar, Department of Computer Science, Alagappa University, Karaikudi. annalakshmi_mu@yahoo.co.in Dr. A.

More information

A CBIR System for the Recognition of Agricultural Machinery

A CBIR System for the Recognition of Agricultural Machinery A CBIR System for the Recognition of Agricultural Machinery Rodolfo Rojas Ruiz 1, Lisbeth Rodríguez-Mazahua 1, Asdrúbal López-Chau 2, Silvestre Gustavo Peláez-Camarena 1, María Antonieta Abud-Figueroa

More information

Integrating Visual and Textual Cues for Query-by-String Word Spotting

Integrating Visual and Textual Cues for Query-by-String Word Spotting Integrating Visual and Textual Cues for D. Aldavert, M. Rusiñol, R. Toledo and J. Lladós Computer Vision Center, Dept. Ciències de la Computació Edifici O, Univ. Autònoma de Barcelona, Bellaterra(Barcelona),

More information

Associating video frames with text

Associating video frames with text Associating video frames with text Pinar Duygulu and Howard Wactlar Informedia Project School of Computer Science University Informedia Digital Video Understanding Project IDVL interface returned for "El

More information

Content Based Image Retrieval

Content Based Image Retrieval Content Based Image Retrieval R. Venkatesh Babu Outline What is CBIR Approaches Features for content based image retrieval Global Local Hybrid Similarity measure Trtaditional Image Retrieval Traditional

More information

Review on Text Mining

Review on Text Mining Review on Text Mining Aarushi Rai #1, Aarush Gupta *2, Jabanjalin Hilda J. #3 #1 School of Computer Science and Engineering, VIT University, Tamil Nadu - India #2 School of Computer Science and Engineering,

More information

Visuelle Perzeption für Mensch- Maschine Schnittstellen

Visuelle Perzeption für Mensch- Maschine Schnittstellen Visuelle Perzeption für Mensch- Maschine Schnittstellen Vorlesung, WS 2009 Prof. Dr. Rainer Stiefelhagen Dr. Edgar Seemann Institut für Anthropomatik Universität Karlsruhe (TH) http://cvhci.ira.uka.de

More information

Motion in 2D image sequences

Motion in 2D image sequences Motion in 2D image sequences Definitely used in human vision Object detection and tracking Navigation and obstacle avoidance Analysis of actions or activities Segmentation and understanding of video sequences

More information

R07. FirstRanker. 7. a) What is text mining? Describe about basic measures for text retrieval. b) Briefly describe document cluster analysis.

R07. FirstRanker. 7. a) What is text mining? Describe about basic measures for text retrieval. b) Briefly describe document cluster analysis. www..com www..com Set No.1 1. a) What is data mining? Briefly explain the Knowledge discovery process. b) Explain the three-tier data warehouse architecture. 2. a) With an example, describe any two schema

More information

Bridging the Gap Between Local and Global Approaches for 3D Object Recognition. Isma Hadji G. N. DeSouza

Bridging the Gap Between Local and Global Approaches for 3D Object Recognition. Isma Hadji G. N. DeSouza Bridging the Gap Between Local and Global Approaches for 3D Object Recognition Isma Hadji G. N. DeSouza Outline Introduction Motivation Proposed Methods: 1. LEFT keypoint Detector 2. LGS Feature Descriptor

More information

Columbia University High-Level Feature Detection: Parts-based Concept Detectors

Columbia University High-Level Feature Detection: Parts-based Concept Detectors TRECVID 2005 Workshop Columbia University High-Level Feature Detection: Parts-based Concept Detectors Dong-Qing Zhang, Shih-Fu Chang, Winston Hsu, Lexin Xie, Eric Zavesky Digital Video and Multimedia Lab

More information

A Pivot-based Index Structure for Combination of Feature Vectors

A Pivot-based Index Structure for Combination of Feature Vectors A Pivot-based Index Structure for Combination of Feature Vectors Benjamin Bustos Daniel Keim Tobias Schreck Department of Computer and Information Science, University of Konstanz Universitätstr. 10 Box

More information

VIDEO SEARCHING AND BROWSING USING VIEWFINDER

VIDEO SEARCHING AND BROWSING USING VIEWFINDER VIDEO SEARCHING AND BROWSING USING VIEWFINDER By Dan E. Albertson Dr. Javed Mostafa John Fieber Ph. D. Student Associate Professor Ph. D. Candidate Information Science Information Science Information Science

More information

Efficient Indexing and Searching Framework for Unstructured Data

Efficient Indexing and Searching Framework for Unstructured Data Efficient Indexing and Searching Framework for Unstructured Data Kyar Nyo Aye, Ni Lar Thein University of Computer Studies, Yangon kyarnyoaye@gmail.com, nilarthein@gmail.com ABSTRACT The proliferation

More information

The Research of Real 3D Modeling in the Digital Heritage Protection of Ancient Architecture

The Research of Real 3D Modeling in the Digital Heritage Protection of Ancient Architecture The Research of Real 3D Modeling in the Digital Heritage Protection of Ancient Architecture Conghua Wang 1,2, Shanxin Zhang 1,2, Erping Zhao 1, Xiaodan Guo 1 1. School of Information Engineering Tibet

More information

Published in A R DIGITECH

Published in A R DIGITECH IMAGE RETRIEVAL USING LATENT SEMANTIC INDEXING Rachana C Patil*1, Imran R. Shaikh*2 *1 (M.E Student S.N.D.C.O.E.R.C, Yeola) *2(Professor, S.N.D.C.O.E.R.C, Yeola) rachanap4@gmail.com*1, imran.shaikh22@gmail.com*2

More information

Generalized Principal Component Analysis CVPR 2007

Generalized Principal Component Analysis CVPR 2007 Generalized Principal Component Analysis Tutorial @ CVPR 2007 Yi Ma ECE Department University of Illinois Urbana Champaign René Vidal Center for Imaging Science Institute for Computational Medicine Johns

More information

Leveraging flickr images for object detection

Leveraging flickr images for object detection Leveraging flickr images for object detection Elisavet Chatzilari Spiros Nikolopoulos Yiannis Kompatsiaris Outline Introduction to object detection Our proposal Experiments Current research 2 Introduction

More information

BUAA AUDR at ImageCLEF 2012 Photo Annotation Task

BUAA AUDR at ImageCLEF 2012 Photo Annotation Task BUAA AUDR at ImageCLEF 2012 Photo Annotation Task Lei Huang, Yang Liu State Key Laboratory of Software Development Enviroment, Beihang University, 100191 Beijing, China huanglei@nlsde.buaa.edu.cn liuyang@nlsde.buaa.edu.cn

More information

Seeing and Reading Red: Hue and Color-word Correlation in Images and Attendant Text on the WWW

Seeing and Reading Red: Hue and Color-word Correlation in Images and Attendant Text on the WWW Seeing and Reading Red: Hue and Color-word Correlation in Images and Attendant Text on the WWW Shawn Newsam School of Engineering University of California at Merced Merced, CA 9534 snewsam@ucmerced.edu

More information

Extending Image Retrieval Systems with a Thesaurus for Shapes

Extending Image Retrieval Systems with a Thesaurus for Shapes Extending Image Retrieval Systems with a Thesaurus for Shapes Master Thesis Lars-Jacob Hove Institute for Information and Media Sciences University of Bergen Lars.Hove@student.uib.no October 12 th, 2004

More information

OnPoint s Guide to MimioStudio 9

OnPoint s Guide to MimioStudio 9 1 OnPoint s Guide to MimioStudio 9 Getting started with MimioStudio 9 Mimio Studio 9 Notebook Overview.... 2 MimioStudio 9 Notebook...... 3 MimioStudio 9 ActivityWizard.. 4 MimioStudio 9 Tools Overview......

More information

A REVIEW ON IMAGE RETRIEVAL USING HYPERGRAPH

A REVIEW ON IMAGE RETRIEVAL USING HYPERGRAPH A REVIEW ON IMAGE RETRIEVAL USING HYPERGRAPH Sandhya V. Kawale Prof. Dr. S. M. Kamalapur M.E. Student Associate Professor Deparment of Computer Engineering, Deparment of Computer Engineering, K. K. Wagh

More information

EAGLE Europeana Network of Ancient Greek and Latin Epigraphy A Digital Bridge to the Ancient World

EAGLE Europeana Network of Ancient Greek and Latin Epigraphy A Digital Bridge to the Ancient World EAGLE Europeana Network of Ancient Greek and Latin Epigraphy A Digital Bridge to the Ancient World Giuseppe Amato 1, Vittore Casarosa 1, Philippe Martineau 2, Silvia Orlandi 3, Raffaella Santucci 3 and

More information

Content-Based Image Retrieval Readings: Chapter 8:

Content-Based Image Retrieval Readings: Chapter 8: Content-Based Image Retrieval Readings: Chapter 8: 8.1-8.4 Queries Commercial Systems Retrieval Features Indexing in the FIDS System Lead-in to Object Recognition 1 Content-based Image Retrieval (CBIR)

More information

Texture Analysis of Painted Strokes 1) Martin Lettner, Paul Kammerer, Robert Sablatnig

Texture Analysis of Painted Strokes 1) Martin Lettner, Paul Kammerer, Robert Sablatnig Texture Analysis of Painted Strokes 1) Martin Lettner, Paul Kammerer, Robert Sablatnig Vienna University of Technology, Institute of Computer Aided Automation, Pattern Recognition and Image Processing

More information

Performance Enhancement of an Image Retrieval by Integrating Text and Visual Features

Performance Enhancement of an Image Retrieval by Integrating Text and Visual Features Performance Enhancement of an Image Retrieval by Integrating Text and Visual Features I Najimun Nisha S, II Mehar Ban K.A I Final Year ME, Dept. of CSE, S.Veerasamy Chettiar College of Engg & Tech, Puliangudi

More information

Extraction of Web Image Information: Semantic or Visual Cues?

Extraction of Web Image Information: Semantic or Visual Cues? Extraction of Web Image Information: Semantic or Visual Cues? Georgina Tryfou and Nicolas Tsapatsoulis Cyprus University of Technology, Department of Communication and Internet Studies, Limassol, Cyprus

More information

Beyond Bags of Features

Beyond Bags of Features : for Recognizing Natural Scene Categories Matching and Modeling Seminar Instructed by Prof. Haim J. Wolfson School of Computer Science Tel Aviv University December 9 th, 2015

More information

Story: Count the Eggs. Instructional Essential Standards

Story: Count the Eggs. Instructional Essential Standards September Topic 1: Numbers 0 to 5 Domain: Counting and Cardinality Cluster: Know number names and the count sequence; Count to tell the number of objects. Story: Count the Eggs Number Uses, Classification,

More information

Image Similarity Measurements Using Hmok- Simrank

Image Similarity Measurements Using Hmok- Simrank Image Similarity Measurements Using Hmok- Simrank A.Vijay Department of computer science and Engineering Selvam College of Technology, Namakkal, Tamilnadu,india. k.jayarajan M.E (Ph.D) Assistant Professor,

More information

CS6670: Computer Vision

CS6670: Computer Vision CS6670: Computer Vision Noah Snavely Lecture 16: Bag-of-words models Object Bag of words Announcements Project 3: Eigenfaces due Wednesday, November 11 at 11:59pm solo project Final project presentations:

More information

Large-scale visual recognition The bag-of-words representation

Large-scale visual recognition The bag-of-words representation Large-scale visual recognition The bag-of-words representation Florent Perronnin, XRCE Hervé Jégou, INRIA CVPR tutorial June 16, 2012 Outline Bag-of-words Large or small vocabularies? Extensions for instance-level

More information