Gas Source Declaration With a Mobile Robot

Size: px
Start display at page:

Download "Gas Source Declaration With a Mobile Robot"

Transcription

1 Gas Source Declaration With a Mobile Robot Achim Lilienthal, Holger Ulmer, Holger Fröhlich, Andreas Stützle, Felix Werner, Andreas Zell University of Tübingen, WSI

2 Contents 1) Applications for Gas-Sensitive Mobile Robots 2) Gas Source Localisation 3) Gas Source Declaration Strategy 4) Experimental Setup 5) Classification (Support Vector Machine) 6) Results 7) Summary & Outlook 2

3 1 Gas-Sensitive Mobile Robots the catastropy in Baden-Baden

4 1 Gas-Sensitive Mobile Robots 4

5 1 Application Domains dedicated systems security, surveillance: "electronic watchman" rescue robots additional benefit for available robots smell a leaking gas pipe detect a fire at its initial stage (CO) monitor pollutants in the environment 5

6 2 Gas Source Localisation sub-tasks gas finding gas source tracing gas source declaration main difficulties state-of-the art gas sensors turbulent gas distribution no analytical model available 6

7 2 Gas Source Localisation gas distribution in a real-world environment diffusion convection turbulence Smyth & Moum

8 3 Gas Source Declaration Strategy gas source declaration without using additional sensors using general characteristics no analytical model available rotation maneouvre 90 left, 180 right, 90 left 8 sectors with 45 8

9 3 Gas Source Declaration Strategy gas source declaration without using additional sensors using general characteristics no analytical model available rotation maneouvre 90 left, 180 right, 90 left 8 sectors with 45 9

10 3 Data Pre-Processing feature extraction mean and/or standard deviation (µ, σ, µσ) different sensor combinations (7 sensors) linear mapping to [0,1] vertical horizontal f 11, f 12, f 13, f 14, f 15, f 16, f 17, f 18 f 21, f 22, f 23, f 24, f 25, f 26, f 27, f f N1, f N2, f N3, f N4, f N5, f N6, f N7, f N8 10

11 3 Data Pre-Processing 14 sensor combinations 1 sensor: 2 sensors: 3 sensors: 4 sensors: 11

12 3 Data Pre-Processing 14 sensor combinations 5 sensors: 7 sensors: 12

13 4 Experimental Setup Robot, Gas Source "Arthur" (ATRV-Jr.) footprint = 80 x 65 cm, height = 55 cm Sensors 7 metal oxide gas sensors odometry laser range scanner Gas Source bowl with Whiskey (D = 14cm) 13

14 4 Experimental Setup - Environment office room uncontrolled environment 14

15 4 Experimental Setup - Environment office room 3 different positions of the gas source 15

16 4 Experimental Setup - Environment office room "direct in front of the source" pos. examples 16

17 4 Experimental Setup - Environment d 5 cm neg. examples 4 neg./ 4 pos. trials for each distance 1056 trials 17

18 5 Classification positive examples (+1) mean value (µ) 18

19 5 Classification negative examples mean value (µ) 19

20 5 Classification negative examples mean value (µ) 20

21 5 Classification negative examples mean value (µ) 21

22 5 Classification - Machine Learning Support Vector Machine (SVM) optimal separating hyperplane in the feature space maximise margin between two classes transformation implicitely done by kernel functions kernel = similarity measure between feature vectors learning quadratic optimisation problem 22

23 5 Classification - Machine Learning Support Vector Machine (SVM) RBF kernel SVM parameters kernel parameter γ penalty parameter C 23

24 6 Results grid search γ = 2 m with m = 6, 5.75,, 5.75, 6 C = 2 n with n = 3, 2.75,, 8.75, 9 cross-validation hit rate 5-fold cross-validation (C*,γ*) max. cross.-val. hit rate train predict

25 6 Results dependency on the distance to the gas source distinguish d = 0 from d d ns different distances d ns d ns = 60 cm d = 60/80/100 cm d ns = 80 cm positive examples negative examples 25

26 6 Results vertical normalisation, (µσ), HR [%] d ns = 60 cm d ns = 80 cm HR = 89.5 % 26 d ns [cm]

27 6 Results horizontal normalisation, (µσ), HR [%] d ns = 60 cm d ns = 80 cm HR = 78.6 % 27 d ns [cm]

28 6 Results comparison with threshold classifier HR [%] best, vert. best, hor. d ns = 60 cm d ns = 80 cm 75.5 % 28 d ns [cm]

29 6 Results roughly constant plateau HR [%] best, vert. best, hor. 29 d ns [cm]

30 6 Results comparison of sensor configurations rel. HR [%] 30

31 7 Summary gas source declaration method introduced based on gas sensor measurements only machine learning for classification demonstration of the feasibility of the approach analysis of the classification performance high classification rates with SVM >> simple threshold classifier 31

32 7 Outlook maneuovre optimisation optimal rotational speed other maneuvres feature selection optimal sensor location regression Bayesian learning 32

33

34 Gas Source Declaration With a Mobile Robot Thank you! Achim Lilienthal, Holger Ulmer, Holger Fröhlich, Andreas Stützle, Felix Werner, Andreas Zell University of Tübingen, WSI

Module 4. Non-linear machine learning econometrics: Support Vector Machine

Module 4. Non-linear machine learning econometrics: Support Vector Machine Module 4. Non-linear machine learning econometrics: Support Vector Machine THE CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION Introduction When the assumption of linearity

More information

Classification by Support Vector Machines

Classification by Support Vector Machines Classification by Support Vector Machines Florian Markowetz Max-Planck-Institute for Molecular Genetics Computational Molecular Biology Berlin Practical DNA Microarray Analysis 2003 1 Overview I II III

More information

Gas Distribution Modeling Using Sparse Gaussian Process Mixture Models

Gas Distribution Modeling Using Sparse Gaussian Process Mixture Models Gas Distribution Modeling Using Sparse Gaussian Process Mixture Models Cyrill Stachniss, Christian Plagemann, Achim Lilienthal, Wolfram Burgard University of Freiburg, Germany & Örebro University, Sweden

More information

Computerlinguistische Anwendungen Support Vector Machines

Computerlinguistische Anwendungen Support Vector Machines with Scikitlearn Computerlinguistische Anwendungen Support Vector Machines Thang Vu CIS, LMU thangvu@cis.uni-muenchen.de May 20, 2015 1 Introduction Shared Task 1 with Scikitlearn Today we will learn about

More information

EE 8591 Homework 4 (10 pts) Fall 2018 SOLUTIONS Topic: SVM classification and regression GRADING: Problems 1,2,4 3pts each, Problem 3 1 point.

EE 8591 Homework 4 (10 pts) Fall 2018 SOLUTIONS Topic: SVM classification and regression GRADING: Problems 1,2,4 3pts each, Problem 3 1 point. 1 EE 8591 Homework 4 (10 pts) Fall 2018 SOLUTIONS Topic: SVM classification and regression GRADING: Problems 1,2,4 3pts each, Problem 3 1 point. Problem 1 (problem 7.6 from textbook) C=10e- 4 C=10e- 3

More information

Classification by Support Vector Machines

Classification by Support Vector Machines Classification by Support Vector Machines Florian Markowetz Max-Planck-Institute for Molecular Genetics Computational Molecular Biology Berlin Practical DNA Microarray Analysis 2003 1 Overview I II III

More information

Neetha Das Prof. Andy Khong

Neetha Das Prof. Andy Khong Neetha Das Prof. Andy Khong Contents Introduction and aim Current system at IMI Proposed new classification model Support Vector Machines Initial audio data collection and processing Features and their

More information

COMS 4771 Support Vector Machines. Nakul Verma

COMS 4771 Support Vector Machines. Nakul Verma COMS 4771 Support Vector Machines Nakul Verma Last time Decision boundaries for classification Linear decision boundary (linear classification) The Perceptron algorithm Mistake bound for the perceptron

More information

Lab 2: Support vector machines

Lab 2: Support vector machines Artificial neural networks, advanced course, 2D1433 Lab 2: Support vector machines Martin Rehn For the course given in 2006 All files referenced below may be found in the following directory: /info/annfk06/labs/lab2

More information

Combining SVMs with Various Feature Selection Strategies

Combining SVMs with Various Feature Selection Strategies Combining SVMs with Various Feature Selection Strategies Yi-Wei Chen and Chih-Jen Lin Department of Computer Science, National Taiwan University, Taipei 106, Taiwan Summary. This article investigates the

More information

Supervised Learning (contd) Linear Separation. Mausam (based on slides by UW-AI faculty)

Supervised Learning (contd) Linear Separation. Mausam (based on slides by UW-AI faculty) Supervised Learning (contd) Linear Separation Mausam (based on slides by UW-AI faculty) Images as Vectors Binary handwritten characters Treat an image as a highdimensional vector (e.g., by reading pixel

More information

A New Fuzzy Membership Computation Method for Fuzzy Support Vector Machines

A New Fuzzy Membership Computation Method for Fuzzy Support Vector Machines A New Fuzzy Membership Computation Method for Fuzzy Support Vector Machines Trung Le, Dat Tran, Wanli Ma and Dharmendra Sharma Faculty of Information Sciences and Engineering University of Canberra, Australia

More information

Large synthetic data sets to compare different data mining methods

Large synthetic data sets to compare different data mining methods Large synthetic data sets to compare different data mining methods Victoria Ivanova, Yaroslav Nalivajko Superviser: David Pfander, IPVS ivanova.informatics@gmail.com yaroslav.nalivayko@gmail.com June 3,

More information

Optimal Separating Hyperplane and the Support Vector Machine. Volker Tresp Summer 2018

Optimal Separating Hyperplane and the Support Vector Machine. Volker Tresp Summer 2018 Optimal Separating Hyperplane and the Support Vector Machine Volker Tresp Summer 2018 1 (Vapnik s) Optimal Separating Hyperplane Let s consider a linear classifier with y i { 1, 1} If classes are linearly

More information

Micrometeorology and Ecology

Micrometeorology and Ecology Monique Y. Leclerc Thomas Foken Footprints in Micrometeorology and Ecology With Contributions by M. J. Savage and M. Gockede 4^1 Springer 1 History and Definition 1 1.1 Micrometeorological Measurements

More information

Behavioral Data Mining. Lecture 10 Kernel methods and SVMs

Behavioral Data Mining. Lecture 10 Kernel methods and SVMs Behavioral Data Mining Lecture 10 Kernel methods and SVMs Outline SVMs as large-margin linear classifiers Kernel methods SVM algorithms SVMs as large-margin classifiers margin The separating plane maximizes

More information

Multimodal Ranking for Non-Compliance Detection in Retail Surveillance

Multimodal Ranking for Non-Compliance Detection in Retail Surveillance Multimodal Ranking for Non-Compliance Detection in Retail Surveillance Hoang Trinh Sharath Pankanti Quanfu Fan IBM T. J. Watson Research Center 19 Skylikne Dr, Hawthorne, NY 10532 Abstract In retail stores,

More information

Support Vector Machines

Support Vector Machines Support Vector Machines RBF-networks Support Vector Machines Good Decision Boundary Optimization Problem Soft margin Hyperplane Non-linear Decision Boundary Kernel-Trick Approximation Accurancy Overtraining

More information

Learning from Data: Adaptive Basis Functions

Learning from Data: Adaptive Basis Functions Learning from Data: Adaptive Basis Functions November 21, 2005 http://www.anc.ed.ac.uk/ amos/lfd/ Neural Networks Hidden to output layer - a linear parameter model But adapt the features of the model.

More information

SVM in Oracle Database 10g: Removing the Barriers to Widespread Adoption of Support Vector Machines

SVM in Oracle Database 10g: Removing the Barriers to Widespread Adoption of Support Vector Machines SVM in Oracle Database 10g: Removing the Barriers to Widespread Adoption of Support Vector Machines Boriana Milenova, Joseph Yarmus, Marcos Campos Data Mining Technologies Oracle Overview Support Vector

More information

Eyes Wide Open - Finding Closed Eyes in Digital Photographs Anthony Nelson BSc Computing with Artificial Intelligence (Industry) 2006/2007

Eyes Wide Open - Finding Closed Eyes in Digital Photographs Anthony Nelson BSc Computing with Artificial Intelligence (Industry) 2006/2007 Eyes Wide Open - Finding Closed Eyes in Digital Photographs Anthony Nelson BSc Computing with Artificial Intelligence (Industry) 2006/2007 The candidate confirms that the work submitted is their own and

More information

CS6375: Machine Learning Gautam Kunapuli. Mid-Term Review

CS6375: Machine Learning Gautam Kunapuli. Mid-Term Review Gautam Kunapuli Machine Learning Data is identically and independently distributed Goal is to learn a function that maps to Data is generated using an unknown function Learn a hypothesis that minimizes

More information

Classification by Nearest Shrunken Centroids and Support Vector Machines

Classification by Nearest Shrunken Centroids and Support Vector Machines Classification by Nearest Shrunken Centroids and Support Vector Machines Florian Markowetz florian.markowetz@molgen.mpg.de Max Planck Institute for Molecular Genetics, Computational Diagnostics Group,

More information

차세대지능형자동차를위한신호처리기술 정호기

차세대지능형자동차를위한신호처리기술 정호기 차세대지능형자동차를위한신호처리기술 008.08. 정호기 E-mail: hgjung@mando.com hgjung@yonsei.ac.kr 0 . 지능형자동차의미래 ) 단위 system functions 운전자상황인식 얼굴방향인식 시선방향인식 졸음운전인식 운전능력상실인식 차선인식, 전방장애물검출및분류 Lane Keeping System + Adaptive Cruise

More information

Automatic Generation of Indoor VR-Models by a Mobile Robot with a Laser Range Finder and a Color Camera

Automatic Generation of Indoor VR-Models by a Mobile Robot with a Laser Range Finder and a Color Camera Automatic Generation of Indoor VR-Models by a Mobile Robot with a Laser Range Finder and a Color Camera Christian Weiss and Andreas Zell Universität Tübingen, Wilhelm-Schickard-Institut für Informatik,

More information

Support Vector Machines: Brief Overview" November 2011 CPSC 352

Support Vector Machines: Brief Overview November 2011 CPSC 352 Support Vector Machines: Brief Overview" Outline Microarray Example Support Vector Machines (SVMs) Software: libsvm A Baseball Example with libsvm Classifying Cancer Tissue: The ALL/AML Dataset Golub et

More information

Learning from High Dimensional fmri Data using Random Projections

Learning from High Dimensional fmri Data using Random Projections Learning from High Dimensional fmri Data using Random Projections Author: Madhu Advani December 16, 011 Introduction The term the Curse of Dimensionality refers to the difficulty of organizing and applying

More information

Practical 7: Support vector machines

Practical 7: Support vector machines Practical 7: Support vector machines Support vector machines are implemented in several R packages, including e1071, caret and kernlab. We will use the e1071 package in this practical. install.packages('e1071')

More information

Machine Learning for. Artem Lind & Aleskandr Tkachenko

Machine Learning for. Artem Lind & Aleskandr Tkachenko Machine Learning for Object Recognition Artem Lind & Aleskandr Tkachenko Outline Problem overview Classification demo Examples of learning algorithms Probabilistic modeling Bayes classifier Maximum margin

More information

Data Mining Practical Machine Learning Tools and Techniques. Slides for Chapter 6 of Data Mining by I. H. Witten and E. Frank

Data Mining Practical Machine Learning Tools and Techniques. Slides for Chapter 6 of Data Mining by I. H. Witten and E. Frank Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter 6 of Data Mining by I. H. Witten and E. Frank Implementation: Real machine learning schemes Decision trees Classification

More information

Applying Supervised Learning

Applying Supervised Learning Applying Supervised Learning When to Consider Supervised Learning A supervised learning algorithm takes a known set of input data (the training set) and known responses to the data (output), and trains

More information

Project Presentation. Pattern Recognition. Under the guidance of Prof. Sumeet Agar wal

Project Presentation. Pattern Recognition. Under the guidance of Prof. Sumeet Agar wal Project Presentation in Pattern Recognition Under the guidance of Prof. Sumeet Agar wal By- ABHISHEK KUMAR (2009CS10175) GAURAV AGARWAL (2009EE10390) Aim Classification of customers based on their attributes

More information

Robustness of Selective Desensitization Perceptron Against Irrelevant and Partially Relevant Features in Pattern Classification

Robustness of Selective Desensitization Perceptron Against Irrelevant and Partially Relevant Features in Pattern Classification Robustness of Selective Desensitization Perceptron Against Irrelevant and Partially Relevant Features in Pattern Classification Tomohiro Tanno, Kazumasa Horie, Jun Izawa, and Masahiko Morita University

More information

Lecture 9: Support Vector Machines

Lecture 9: Support Vector Machines Lecture 9: Support Vector Machines William Webber (william@williamwebber.com) COMP90042, 2014, Semester 1, Lecture 8 What we ll learn in this lecture Support Vector Machines (SVMs) a highly robust and

More information

An Artificial Potential Field based Sampling Strategy for a Gas-Sensitive Micro-Drone

An Artificial Potential Field based Sampling Strategy for a Gas-Sensitive Micro-Drone An Artificial Potential Field based Sampling Strategy for a Gas-Sensitive Micro-Drone Patrick Neumann, Sahar Asadi, Jochen H. Schiller, Achim Lilienthal and Matthias Bartholmai Abstract This paper presents

More information

Data Analysis 3. Support Vector Machines. Jan Platoš October 30, 2017

Data Analysis 3. Support Vector Machines. Jan Platoš October 30, 2017 Data Analysis 3 Support Vector Machines Jan Platoš October 30, 2017 Department of Computer Science Faculty of Electrical Engineering and Computer Science VŠB - Technical University of Ostrava Table of

More information

Lab 2: Support Vector Machines

Lab 2: Support Vector Machines Articial neural networks, advanced course, 2D1433 Lab 2: Support Vector Machines March 13, 2007 1 Background Support vector machines, when used for classication, nd a hyperplane w, x + b = 0 that separates

More information

Support Vector Machines + Classification for IR

Support Vector Machines + Classification for IR Support Vector Machines + Classification for IR Pierre Lison University of Oslo, Dep. of Informatics INF3800: Søketeknologi April 30, 2014 Outline of the lecture Recap of last week Support Vector Machines

More information

MONITORING SCREW FASTENING PROCESS BASED SUPPORT VECTOR MACHINE CLASSIFICATION

MONITORING SCREW FASTENING PROCESS BASED SUPPORT VECTOR MACHINE CLASSIFICATION MONITORING SCREW FASTENING PROCESS BASED SUPPORT VECTOR MACHINE CLASSIFICATION Supawan Ponpitakchai Department of Electrical and Computer Engineering, Naresuan University, Thailand supawanpo@nu.ac.th ABSTRACT

More information

Support Vector Machines

Support Vector Machines Support Vector Machines RBF-networks Support Vector Machines Good Decision Boundary Optimization Problem Soft margin Hyperplane Non-linear Decision Boundary Kernel-Trick Approximation Accurancy Overtraining

More information

Machine Learning for NLP

Machine Learning for NLP Machine Learning for NLP Support Vector Machines Aurélie Herbelot 2018 Centre for Mind/Brain Sciences University of Trento 1 Support Vector Machines: introduction 2 Support Vector Machines (SVMs) SVMs

More information

Supervised vs unsupervised clustering

Supervised vs unsupervised clustering Classification Supervised vs unsupervised clustering Cluster analysis: Classes are not known a- priori. Classification: Classes are defined a-priori Sometimes called supervised clustering Extract useful

More information

Terrain Roughness Identification for High-Speed UGVs

Terrain Roughness Identification for High-Speed UGVs Proceedings of the International Conference of Control, Dynamic Systems, and Robotics Ottawa, Ontario, Canada, May 15-16 2014 Paper No. 11 Terrain Roughness Identification for High-Speed UGVs Graeme N.

More information

Pedestrian Detection Using Correlated Lidar and Image Data EECS442 Final Project Fall 2016

Pedestrian Detection Using Correlated Lidar and Image Data EECS442 Final Project Fall 2016 edestrian Detection Using Correlated Lidar and Image Data EECS442 Final roject Fall 2016 Samuel Rohrer University of Michigan rohrer@umich.edu Ian Lin University of Michigan tiannis@umich.edu Abstract

More information

Support Vector Machines

Support Vector Machines Support Vector Machines Chapter 9 Chapter 9 1 / 50 1 91 Maximal margin classifier 2 92 Support vector classifiers 3 93 Support vector machines 4 94 SVMs with more than two classes 5 95 Relationshiop to

More information

A Novel Smoke Detection Method Using Support Vector Machine

A Novel Smoke Detection Method Using Support Vector Machine A Novel Smoke Detection Method Using Support Vector Machine Hidenori Maruta Information Media Center Nagasaki University, Japan 1-14 Bunkyo-machi, Nagasaki-shi Nagasaki, Japan Email: hmaruta@nagasaki-u.ac.jp

More information

Support Vector Machines. James McInerney Adapted from slides by Nakul Verma

Support Vector Machines. James McInerney Adapted from slides by Nakul Verma Support Vector Machines James McInerney Adapted from slides by Nakul Verma Last time Decision boundaries for classification Linear decision boundary (linear classification) The Perceptron algorithm Mistake

More information

Object Tracking using HOG and SVM

Object Tracking using HOG and SVM Object Tracking using HOG and SVM Siji Joseph #1, Arun Pradeep #2 Electronics and Communication Engineering Axis College of Engineering and Technology, Ambanoly, Thrissur, India Abstract Object detection

More information

Choosing the kernel parameters for SVMs by the inter-cluster distance in the feature space Authors: Kuo-Ping Wu, Sheng-De Wang Published 2008

Choosing the kernel parameters for SVMs by the inter-cluster distance in the feature space Authors: Kuo-Ping Wu, Sheng-De Wang Published 2008 Choosing the kernel parameters for SVMs by the inter-cluster distance in the feature space Authors: Kuo-Ping Wu, Sheng-De Wang Published 2008 Presented by: Nandini Deka UH Mathematics Spring 2014 Workshop

More information

CS 229 Midterm Review

CS 229 Midterm Review CS 229 Midterm Review Course Staff Fall 2018 11/2/2018 Outline Today: SVMs Kernels Tree Ensembles EM Algorithm / Mixture Models [ Focus on building intuition, less so on solving specific problems. Ask

More information

SUPPORT VECTOR MACHINES

SUPPORT VECTOR MACHINES SUPPORT VECTOR MACHINES Today Reading AIMA 18.9 Goals (Naïve Bayes classifiers) Support vector machines 1 Support Vector Machines (SVMs) SVMs are probably the most popular off-the-shelf classifier! Software

More information

Supervised classification exercice

Supervised classification exercice Universitat Politècnica de Catalunya Master in Artificial Intelligence Computational Intelligence Supervised classification exercice Authors: Miquel Perelló Nieto Marc Albert Garcia Gonzalo Date: December

More information

Machine Learning. Chao Lan

Machine Learning. Chao Lan Machine Learning Chao Lan Machine Learning Prediction Models Regression Model - linear regression (least square, ridge regression, Lasso) Classification Model - naive Bayes, logistic regression, Gaussian

More information

Topics in Machine Learning

Topics in Machine Learning Topics in Machine Learning Gilad Lerman School of Mathematics University of Minnesota Text/slides stolen from G. James, D. Witten, T. Hastie, R. Tibshirani and A. Ng Machine Learning - Motivation Arthur

More information

Machine Learning: Algorithms and Applications Mockup Examination

Machine Learning: Algorithms and Applications Mockup Examination Machine Learning: Algorithms and Applications Mockup Examination 14 May 2012 FIRST NAME STUDENT NUMBER LAST NAME SIGNATURE Instructions for students Write First Name, Last Name, Student Number and Signature

More information

arxiv: v1 [cs.ro] 26 Nov 2018

arxiv: v1 [cs.ro] 26 Nov 2018 Fast Gaussian Process Occupancy Maps Yijun Yuan, Haofei Kuang and Sören Schwertfeger arxiv:1811.10156v1 [cs.ro] 26 Nov 2018 Abstract In this paper, we demonstrate our work on Gaussian Process Occupancy

More information

SVM Toolbox. Theory, Documentation, Experiments. S.V. Albrecht

SVM Toolbox. Theory, Documentation, Experiments. S.V. Albrecht SVM Toolbox Theory, Documentation, Experiments S.V. Albrecht (sa@highgames.com) Darmstadt University of Technology Department of Computer Science Multimodal Interactive Systems Contents 1 Introduction

More information

Classification by Support Vector Machines

Classification by Support Vector Machines Classification by Support Vector Machines Florian Markowetz Max-Planck-Institute for Molecular Genetics Computational Molecular Biology Berlin Practical DNA Microarray Analysis 2003 1 Overview I II III

More information

5 Learning hypothesis classes (16 points)

5 Learning hypothesis classes (16 points) 5 Learning hypothesis classes (16 points) Consider a classification problem with two real valued inputs. For each of the following algorithms, specify all of the separators below that it could have generated

More information

Revising Stereo Vision Maps in Particle Filter Based SLAM using Localisation Confidence and Sample History

Revising Stereo Vision Maps in Particle Filter Based SLAM using Localisation Confidence and Sample History Revising Stereo Vision Maps in Particle Filter Based SLAM using Localisation Confidence and Sample History Simon Thompson and Satoshi Kagami Digital Human Research Center National Institute of Advanced

More information

Vulnerability of machine learning models to adversarial examples

Vulnerability of machine learning models to adversarial examples Vulnerability of machine learning models to adversarial examples Petra Vidnerová Institute of Computer Science The Czech Academy of Sciences Hora Informaticae 1 Outline Introduction Works on adversarial

More information

Spreadsheet and Graphing Exercise Biology 210 Introduction to Research

Spreadsheet and Graphing Exercise Biology 210 Introduction to Research 1 Spreadsheet and Graphing Exercise Biology 210 Introduction to Research There are many good spreadsheet programs for analyzing data. In this class we will use MS Excel. Below are a series of examples

More information

Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines

Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Spring 2007 c 2007,

More information

Kernel SVM. Course: Machine Learning MAHDI YAZDIAN-DEHKORDI FALL 2017

Kernel SVM. Course: Machine Learning MAHDI YAZDIAN-DEHKORDI FALL 2017 Kernel SVM Course: MAHDI YAZDIAN-DEHKORDI FALL 2017 1 Outlines SVM Lagrangian Primal & Dual Problem Non-linear SVM & Kernel SVM SVM Advantages Toolboxes 2 SVM Lagrangian Primal/DualProblem 3 SVM LagrangianPrimalProblem

More information

Distance Weighted Discrimination Method for Parkinson s for Automatic Classification of Rehabilitative Speech Treatment for Parkinson s Patients

Distance Weighted Discrimination Method for Parkinson s for Automatic Classification of Rehabilitative Speech Treatment for Parkinson s Patients Operations Research II Project Distance Weighted Discrimination Method for Parkinson s for Automatic Classification of Rehabilitative Speech Treatment for Parkinson s Patients Nicol Lo 1. Introduction

More information

Chapter 5. Conclusions

Chapter 5. Conclusions Chapter 5 Conclusions The main objective of the research work described in this dissertation was the development of a Localisation methodology based only on laser data that did not require any initial

More information

Support Vector Machines.

Support Vector Machines. Support Vector Machines srihari@buffalo.edu SVM Discussion Overview 1. Overview of SVMs 2. Margin Geometry 3. SVM Optimization 4. Overlapping Distributions 5. Relationship to Logistic Regression 6. Dealing

More information

Classification of Digital Photos Taken by Photographers or Home Users

Classification of Digital Photos Taken by Photographers or Home Users Classification of Digital Photos Taken by Photographers or Home Users Hanghang Tong 1, Mingjing Li 2, Hong-Jiang Zhang 2, Jingrui He 1, and Changshui Zhang 3 1 Automation Department, Tsinghua University,

More information

Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features. Wei-Ta Chu

Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features. Wei-Ta Chu 1 Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features Wei-Ta Chu H.-H. Yeh, C.-Y. Yang, M.-S. Lee, and C.-S. Chen, Video Aesthetic Quality Assessment by Temporal

More information

Homework 3: Solutions

Homework 3: Solutions Homework 3: Solutions Statistics 43 Fall 207 Data Analysis: Note: All data analysis results are provided by Yixin Chen STAT43 - HW3 Yixin Chen Data Analysis in R Pipeline (a) Since the purpose is to find

More information

Perceptron Learning Algorithm

Perceptron Learning Algorithm Perceptron Learning Algorithm An iterative learning algorithm that can find linear threshold function to partition linearly separable set of points. Assume zero threshold value. 1) w(0) = arbitrary, j=1,

More information

Automated large area tree species mapping and disease detection using airborne hyperspectral remote sensing

Automated large area tree species mapping and disease detection using airborne hyperspectral remote sensing Automated large area tree species mapping and disease detection using airborne hyperspectral remote sensing William Oxford Neil Fuller, James Caudery, Steve Case, Michael Gajdus, Martin Black Outline About

More information

CPSC 340: Machine Learning and Data Mining. Logistic Regression Fall 2016

CPSC 340: Machine Learning and Data Mining. Logistic Regression Fall 2016 CPSC 340: Machine Learning and Data Mining Logistic Regression Fall 2016 Admin Assignment 1: Marks visible on UBC Connect. Assignment 2: Solution posted after class. Assignment 3: Due Wednesday (at any

More information

Data Mining in Bioinformatics Day 1: Classification

Data Mining in Bioinformatics Day 1: Classification Data Mining in Bioinformatics Day 1: Classification Karsten Borgwardt February 18 to March 1, 2013 Machine Learning & Computational Biology Research Group Max Planck Institute Tübingen and Eberhard Karls

More information

Analysis of Process and biological data using support vector machines

Analysis of Process and biological data using support vector machines Analysis of Process and biological data using support vector machines Sankar Mahadevan, PhD student Supervisor : Dr. Sirish Shah Department of Chemical and Materials Engineering University of Alberta Outline

More information

SUPPORT VECTOR MACHINES

SUPPORT VECTOR MACHINES SUPPORT VECTOR MACHINES Today Reading AIMA 8.9 (SVMs) Goals Finish Backpropagation Support vector machines Backpropagation. Begin with randomly initialized weights 2. Apply the neural network to each training

More information

6.867 Machine Learning

6.867 Machine Learning 6.867 Machine Learning Problem set 3 Due Tuesday, October 22, in class What and how to turn in? Turn in short written answers to the questions explicitly stated, and when requested to explain or prove.

More information

Naïve Bayes for text classification

Naïve Bayes for text classification Road Map Basic concepts Decision tree induction Evaluation of classifiers Rule induction Classification using association rules Naïve Bayesian classification Naïve Bayes for text classification Support

More information

A Practical Guide to Support Vector Classification

A Practical Guide to Support Vector Classification A Practical Guide to Support Vector Classification Chih-Wei Hsu, Chih-Chung Chang, and Chih-Jen Lin Department of Computer Science and Information Engineering National Taiwan University Taipei 106, Taiwan

More information

Comparison of different preprocessing techniques and feature selection algorithms in cancer datasets

Comparison of different preprocessing techniques and feature selection algorithms in cancer datasets Comparison of different preprocessing techniques and feature selection algorithms in cancer datasets Konstantinos Sechidis School of Computer Science University of Manchester sechidik@cs.man.ac.uk Abstract

More information

Constrained optimization

Constrained optimization Constrained optimization A general constrained optimization problem has the form where The Lagrangian function is given by Primal and dual optimization problems Primal: Dual: Weak duality: Strong duality:

More information

Robotics. Lecture 5: Monte Carlo Localisation. See course website for up to date information.

Robotics. Lecture 5: Monte Carlo Localisation. See course website  for up to date information. Robotics Lecture 5: Monte Carlo Localisation See course website http://www.doc.ic.ac.uk/~ajd/robotics/ for up to date information. Andrew Davison Department of Computing Imperial College London Review:

More information

2 OVERVIEW OF RELATED WORK

2 OVERVIEW OF RELATED WORK Utsushi SAKAI Jun OGATA This paper presents a pedestrian detection system based on the fusion of sensors for LIDAR and convolutional neural network based image classification. By using LIDAR our method

More information

Towards a Calibration-Free Robot: The ACT Algorithm for Automatic Online Color Training

Towards a Calibration-Free Robot: The ACT Algorithm for Automatic Online Color Training Towards a Calibration-Free Robot: The ACT Algorithm for Automatic Online Color Training Patrick Heinemann, Frank Sehnke, Felix Streichert, and Andreas Zell Wilhelm-Schickard-Institute, Department of Computer

More information

Content-based image and video analysis. Machine learning

Content-based image and video analysis. Machine learning Content-based image and video analysis Machine learning for multimedia retrieval 04.05.2009 What is machine learning? Some problems are very hard to solve by writing a computer program by hand Almost all

More information

Machine Learning Classifiers and Boosting

Machine Learning Classifiers and Boosting Machine Learning Classifiers and Boosting Reading Ch 18.6-18.12, 20.1-20.3.2 Outline Different types of learning problems Different types of learning algorithms Supervised learning Decision trees Naïve

More information

SELF-ORGANIZING methods such as the Self-

SELF-ORGANIZING methods such as the Self- Proceedings of International Joint Conference on Neural Networks, Dallas, Texas, USA, August 4-9, 2013 Maximal Margin Learning Vector Quantisation Trung Le, Dat Tran, Van Nguyen, and Wanli Ma Abstract

More information

LECTURE 5: DUAL PROBLEMS AND KERNELS. * Most of the slides in this lecture are from

LECTURE 5: DUAL PROBLEMS AND KERNELS. * Most of the slides in this lecture are from LECTURE 5: DUAL PROBLEMS AND KERNELS * Most of the slides in this lecture are from http://www.robots.ox.ac.uk/~az/lectures/ml Optimization Loss function Loss functions SVM review PRIMAL-DUAL PROBLEM Max-min

More information

Time Series Classification in Dissimilarity Spaces

Time Series Classification in Dissimilarity Spaces Proceedings 1st International Workshop on Advanced Analytics and Learning on Temporal Data AALTD 2015 Time Series Classification in Dissimilarity Spaces Brijnesh J. Jain and Stephan Spiegel Berlin Institute

More information

A Simple Metal Detector Model to Predict the Probability of Detection in Landmine Detection

A Simple Metal Detector Model to Predict the Probability of Detection in Landmine Detection A Simple to Predict the Probability of Detection in Landmine Detection Y. Yvinec, P. Druyts, and M. Acheroy Yann.Yvinec@rma.ac.be Royal Military Academy, CISS, Signal and Image Centre, Brussels, Belgium

More information

9. Support Vector Machines. The linearly separable case: hard-margin SVMs. The linearly separable case: hard-margin SVMs. Learning objectives

9. Support Vector Machines. The linearly separable case: hard-margin SVMs. The linearly separable case: hard-margin SVMs. Learning objectives Foundations of Machine Learning École Centrale Paris Fall 25 9. Support Vector Machines Chloé-Agathe Azencot Centre for Computational Biology, Mines ParisTech Learning objectives chloe agathe.azencott@mines

More information

Instructor: Jessica Wu Harvey Mudd College

Instructor: Jessica Wu Harvey Mudd College The Perceptron Instructor: Jessica Wu Harvey Mudd College The instructor gratefully acknowledges Andrew Ng (Stanford), Eric Eaton (UPenn), David Kauchak (Pomona), and the many others who made their course

More information

Global Coverage Measurement Planning Strategies for Mobile Robots Equipped with a Remote Gas Sensor

Global Coverage Measurement Planning Strategies for Mobile Robots Equipped with a Remote Gas Sensor Sensors 215, 15, 6845-6871; doi:1.339/s1536845 OPEN ACCESS sensors ISSN 1424-822 www.mdpi.com/journal/sensors Article Global Coverage Measurement Planning Strategies for Mobile Robots Equipped with a Remote

More information

Behavior-based Authentication Systems. Multimedia Security

Behavior-based Authentication Systems. Multimedia Security Behavior-based Authentication Systems Multimedia Security Part 1: User Authentication Through Typing Biometrics Features Part 2: User Re-Authentication via Mouse Movements 2 User Authentication Through

More information

A Practical Guide to Support Vector Classification

A Practical Guide to Support Vector Classification Support Vector Machines 1 A Practical Guide to Support Vector Classification Chih-Jen Lin Department of Computer Science National Taiwan University Talk at University of Freiburg, July 15, 2003 Support

More information

A generalized quadratic loss for Support Vector Machines

A generalized quadratic loss for Support Vector Machines A generalized quadratic loss for Support Vector Machines Filippo Portera and Alessandro Sperduti Abstract. The standard SVM formulation for binary classification is based on the Hinge loss function, where

More information

Video event detection using subclass discriminant analysis and linear support vector machines

Video event detection using subclass discriminant analysis and linear support vector machines Video event detection using subclass discriminant analysis and linear support vector machines Nikolaos Gkalelis, Damianos Galanopoulos, Vasileios Mezaris / TRECVID 2014 Workshop, Orlando, FL, USA, November

More information

Linear methods for supervised learning

Linear methods for supervised learning Linear methods for supervised learning LDA Logistic regression Naïve Bayes PLA Maximum margin hyperplanes Soft-margin hyperplanes Least squares resgression Ridge regression Nonlinear feature maps Sometimes

More information

Introduction to Automated Text Analysis. bit.ly/poir599

Introduction to Automated Text Analysis. bit.ly/poir599 Introduction to Automated Text Analysis Pablo Barberá School of International Relations University of Southern California pablobarbera.com Lecture materials: bit.ly/poir599 Today 1. Solutions for last

More information

Data Mining and Analytics

Data Mining and Analytics Data Mining and Analytics Aik Choon Tan, Ph.D. Associate Professor of Bioinformatics Division of Medical Oncology Department of Medicine aikchoon.tan@ucdenver.edu 9/22/2017 http://tanlab.ucdenver.edu/labhomepage/teaching/bsbt6111/

More information