Application of Fuzzy Logic Akira Imada Brest State Technical University

Size: px
Start display at page:

Download "Application of Fuzzy Logic Akira Imada Brest State Technical University"

Transcription

1 A slide show of our Lecture Note Application of Fuzzy Logic Akira Imada Brest State Technical University Last modified on 29 October 2016

2 (Contemporary Intelligent Information Techniques) 2 I. Fuzzy Basic Arithmetics

3 (Contemporary Intelligent Information Techniques) 3 Membership Function In Fuzzy logic the probability of how likely A is true is called membership value of A and expressed as µ A. E.g., assuming A = beer is cold, µ A = 1 when temperature of beer is 5 C, while µ A = 0.5 when temperature of beer is 10 C, and µ A = 0 when temperature of beer is 15 C.

4 (Contemporary Intelligent Information Techniques) 4 AND and OR Membership of A AND B and A OR B are given, respectively, as µ A B (x) = min{µ A (x), µ B (x)} and µ A B (x) = max{µ A (x), µ B (x)}

5 (Contemporary Intelligent Information Techniques) 5 IF-THEN Membership of IF A THEN B has proposed by many but here we use this Larsen s proposal. µ A B (x) = µ A (x) µ B (x)

6 (Contemporary Intelligent Information Techniques) 6 4. De-fuzzification When A has some different possibility, we determine most possible value of A by calculating the center of gravity of these membership values. i µ A i (x x i ) = 0 E.g.

7 (Contemporary Intelligent Information Techniques) 7 II. Fuzzy Controller

8 (Contemporary Intelligent Information Techniques) 8 Controll two metro cars Let s create a virtual metro system with 2 cars on a loop line with 1000 pixels. Each car has a pair of 3 parameters of speed x, distance to the car in front y and strength of brake z.

9 (Contemporary Intelligent Information Techniques) 9 Membership function of Speed, Distance and Brake assumed here.

10 (Contemporary Intelligent Information Techniques) 10 Membership value of a rule with specific speed, distance and brake. E.g. The membership value below implies how this brake = 4 will be likely when speed = 7 and distance = 500 under the rule below.

11 (Contemporary Intelligent Information Techniques) 11 An example of Membership value of one rule Membership value of brake = 0,1,2,3,4,5,6,7,8,9 when speed = 20 and distance = 650 under the rule IF speed = medium AND distance = long THEN brake = medium. From the work by Korol Andrey (2015 Fall)

12 (Contemporary Intelligent Information Techniques) 12 Membership value of two rules

13 (Contemporary Intelligent Information Techniques) 13 Membership function of three rules for a pair of a speed and a distance

14 (Contemporary Intelligent Information Techniques) 14 Membership value of 3 rules for a pair of speed & distance From the work by Yulia Bogutskaya (2016 Fall)

15 (Contemporary Intelligent Information Techniques) 15 Defuzzified value of break for a pair of a speed and a distance From the work by Kuchur Alexander (2015 Fall)

16 (Contemporary Intelligent Information Techniques) 16 Membership value of 3 rules for 3 pairs of speed & distance

17 (Contemporary Intelligent Information Techniques) Membership function of 25 rules all combination of speed = very slow..., distance = very short

18 (Contemporary Intelligent Information Techniques) D surface of speed-distance-brake An example of how to draw for a fixed speed and three diferent value of distances/ From the work by Bokhanov Evgenii (2015 Fall)

19 (Contemporary Intelligent Information Techniques) Control metros by 3-D surface of speed-distance-brake

20 (Contemporary Intelligent Information Techniques) 20 III. Fuzzy Classification

21 (Contemporary Intelligent Information Techniques) 21 An example of classification - 3 families of fish

22 (Contemporary Intelligent Information Techniques) Rules to classify as an example

23 (Contemporary Intelligent Information Techniques) Memership function for the size of two parts µ(x) = exp{ (x avg)2 std 2 }

24 (Contemporary Intelligent Information Techniques) 24? How we specify avg and std for each of membership function from dataset given?

25 (Contemporary Intelligent Information Techniques) 25 Question: Which family is this new fish?

26 (Contemporary Intelligent Information Techniques) Takagi Sugeno Formula R k : If x 1 is A k 1, and x 2 is A k 2 and and x N is A k N then y is gk.

27 (Contemporary Intelligent Information Techniques) 27 Takagi-Sugeno rules: Estimation of a single input Estimation of y for an input x = (x 1, x 2,, x N ) y j = H k=1 (M k(x) g k ) H k=1 M k(x) where N M k (x) = µ ik (x i ) i=1 where µ ik is i-th attribute of k-th rule

28 (Contemporary Intelligent Information Techniques) 28 Three rules to classify

29 (Contemporary Intelligent Information Techniques) 29 A benchmark Iris database Iris flower dataset (taken from University of California Urvine Machine Learning Repository) consists of three species of iris flower setosa, versicolor and virginica. Each sample represents four attributes of the iris flower sepal-length, sepal-width, petal-length, and petal-width.

30 (Contemporary Intelligent Information Techniques) 30 Iris Flower Database to design Setosa Versicolor Virginica x 1 x 2 x 3 x 4 x 1 x 2 x 3 x 4 x 1 x 2 x 3 x

31 (Contemporary Intelligent Information Techniques) 31 Iris Flower Database to validate Setosa Versicolor Virginica x 1 x 2 x 3 x 4 x 1 x 2 x 3 x 4 x 1 x 2 x 3 x

32 (Contemporary Intelligent Information Techniques) 32 IV. Time-series prediction by Fuzzy

33 (Contemporary Intelligent Information Techniques) 33 Forcasting a value from its history Assume y(t) is a value of a variable y at time t such as maximum price of a stock during a day. Then T-S formula for singleton consequeance is as follows 1. R i : If y(t 1) is A i 1 and y(t 2) is A i 2 and and y(t n + 1) is A i n then y(t) is g i.

34 (Contemporary Intelligent Information Techniques) 34 Forcasting a value from other related items R i : If x 1 (t) is A i 1 and x 2 (t) is A i 2 and and x n (t) is A i n then y(t) is g i.

35 (Contemporary Intelligent Information Techniques) 35 V. Fuzzy Clustering

36 (Contemporary Intelligent Information Techniques) Fuzzy Relation Example 4... X = {green, yellow, red}, Y = {unripe, semiripe, ripe}. We may assume that a red apple is provably ripe, but a green apple is most likely, and so on. Thus, for example: X \ Y unripe semiripe ripe green yellow red Let s call this relation R 1. Then we think a similar but new Relation.

37 (Contemporary Intelligent Information Techniques) 37 Now 2. Combine two fuzzy relations and Y = {unripe, semiripe, ripe} Let s call this relation R 2. Z = {sour, sour sweet, sweet} X \ Y sour sour-sweet sweet unripen semiripe ripe

38 (Contemporary Intelligent Information Techniques) 38 Combine two fuzzy relations - continued We combine these two relations R 1 and R 2 by the formula the result is: µ R (x, z) max y X {min{µ R(x, y), µ R (y, z)}}, X \ Y sour sour-sweet sweet red yellow green

39 (Contemporary Intelligent Information Techniques) 39 Expression by our daily language This relation could be expressed by our daily language like If tomato is red then it s most likely sweet, possibly sour-sweet, and unlikely sour. If tomato is yellow then probably it s sour-sweet, possibly sour, maybe sweet. If tomato is green then almost always sour, less likely sour-sweet, unlikely sweet. Or, we could say: Now tomato is more or less red, then what is taste like?

40 (Contemporary Intelligent Information Techniques) Clustering by Fuzzy Relation of Proximity

41 (Contemporary Intelligent Information Techniques) 41 Algorithm 1 1. Calculate a max-min similarity-relation R = [a ij ] 2. Set a ij = 0 for all a ij < α and i = j 3. Select s and t such that a st = max{a ij i < j& i, j I}. When tie, select one of these pairs at random WHILE a st 0 DO put s and t into the same cluster C = {s, t} ELSE 4. ELSE all indices I into separated clusters and STOP 4. Choose u I C such that a iu = max { a ij a ij 0} j I C i C i C When a tie, select one such u at random. WHILE such a u exists, put u into C = {s, t, u} and REPEAT Let I = I C and GOTO 3.

42 (Contemporary Intelligent Information Techniques) 42 Example: Let s Start with the following R ( 0), R (0) =

43 (Contemporary Intelligent Information Techniques) 43 Then repeat R (n+1) = R (n) R (n) till R (n) = R (n+1) R (n) =

44 (Contemporary Intelligent Information Techniques) 44 Now ssumming α = 0.55 apply [1.] and [2.]

45 (Contemporary Intelligent Information Techniques) 45 First, set I = {1, 2, 3, 4, 5, 6, 7, 8, 9, 10} and C = { }. Then 3. Now a 18 = a 26 = a 5 10 = 0.9 are maximum and a 18 is randomly selected. Then C = {1, 8}. 4. a 12 + a 82 = a 14 + a 84 = 1.5 are maximum and j = 4 is randomly selected. Then C = {1, 8, 4}. 4. a 12 + a 42 + a 82 = 2.1 is maximum, then C = {1, 8, 4, 2}. 4. There are no j such that a 1j + a 2j + a 4j + a 8j is maximum. Then final C = {1, 8, 4, 2}. a 16 +a 26 +a 46 +a 86 = = 2.2 seems maximum but actually not because a 46 = 0 Note that i C a iu = max j I\C { i C a ij a ij 0}

46 (Contemporary Intelligent Information Techniques) Let I = {3, 5, 6, 7, 9, 10} 3. a 5 10 = 0.9 is maximum. Then renew C as {5, 10}. 4. a 59 + a 10 9 = 1.5 is maximum. Then C = {5, 10, 9}. 4. There are no j in {3, 6, 9} such that a 5j + a 9j + a 10j is maximum. Then final C = {5, 10, 9}. 5. Let I = {3, 6, 7}. 3. Now a 36 = a 37 = a 67 = 0. Then {3}, {6}and {7}are three separated clusters. In fact, a 33 a 36 a a 63 a 66 a 67 = a 73 a 76 a So i {3,6,7} a iu = max j {3,6,7} { i C a ij a ij 0} does not exit any more. In this way, when α = 0.55, we have 5 clasters {1, 8, 4, 2},{5, 10, 9}, {3}, {6} and {7} are obtained.

Fuzzy Logic & Data Processing

Fuzzy Logic & Data Processing Fuzzy Logic & Data Processing Lecture notes for Modern Method of Data Processing (CCOD) in 2014 Akira Imada Brest State Technical University, Belarus (last modified on) December 17, 2014 (still under construction)

More information

Fuzzy Logic & Data Processing

Fuzzy Logic & Data Processing Fuzzy Logic & Data Processing Lecture notes for Modern Method of Data Processing (CCOD) in 2012 Akira Imada Brest State Technical University, Belarus (last modified on) December 11, 2012 1 (Contemporary

More information

Introduction to Artificial Intelligence

Introduction to Artificial Intelligence Introduction to Artificial Intelligence COMP307 Machine Learning 2: 3-K Techniques Yi Mei yi.mei@ecs.vuw.ac.nz 1 Outline K-Nearest Neighbour method Classification (Supervised learning) Basic NN (1-NN)

More information

KTH ROYAL INSTITUTE OF TECHNOLOGY. Lecture 14 Machine Learning. K-means, knn

KTH ROYAL INSTITUTE OF TECHNOLOGY. Lecture 14 Machine Learning. K-means, knn KTH ROYAL INSTITUTE OF TECHNOLOGY Lecture 14 Machine Learning. K-means, knn Contents K-means clustering K-Nearest Neighbour Power Systems Analysis An automated learning approach Understanding states in

More information

Input: Concepts, Instances, Attributes

Input: Concepts, Instances, Attributes Input: Concepts, Instances, Attributes 1 Terminology Components of the input: Concepts: kinds of things that can be learned aim: intelligible and operational concept description Instances: the individual,

More information

Neural Networks Lesson 9 - Fuzzy Logic

Neural Networks Lesson 9 - Fuzzy Logic Neural Networks Lesson 9 - Prof. Michele Scarpiniti INFOCOM Dpt. - Sapienza University of Rome http://ispac.ing.uniroma1.it/scarpiniti/index.htm michele.scarpiniti@uniroma1.it Rome, 26 November 2009 M.

More information

CSCI567 Machine Learning (Fall 2014)

CSCI567 Machine Learning (Fall 2014) CSCI567 Machine Learning (Fall 2014) Drs. Sha & Liu {feisha,yanliu.cs}@usc.edu September 9, 2014 Drs. Sha & Liu ({feisha,yanliu.cs}@usc.edu) CSCI567 Machine Learning (Fall 2014) September 9, 2014 1 / 47

More information

k Nearest Neighbors Super simple idea! Instance-based learning as opposed to model-based (no pre-processing)

k Nearest Neighbors Super simple idea! Instance-based learning as opposed to model-based (no pre-processing) k Nearest Neighbors k Nearest Neighbors To classify an observation: Look at the labels of some number, say k, of neighboring observations. The observation is then classified based on its nearest neighbors

More information

Why Fuzzy Fuzzy Logic and Sets Fuzzy Reasoning. DKS - Module 7. Why fuzzy thinking?

Why Fuzzy Fuzzy Logic and Sets Fuzzy Reasoning. DKS - Module 7. Why fuzzy thinking? Fuzzy Systems Overview: Literature: Why Fuzzy Fuzzy Logic and Sets Fuzzy Reasoning chapter 4 DKS - Module 7 1 Why fuzzy thinking? Experts rely on common sense to solve problems Representation of vague,

More information

An Efficient Method for Extracting Fuzzy Classification Rules from High Dimensional Data

An Efficient Method for Extracting Fuzzy Classification Rules from High Dimensional Data Published in J. Advanced Computational Intelligence, Vol., No., 997 An Efficient Method for Extracting Fuzzy Classification Rules from High Dimensional Data Stephen L. Chiu Rockwell Science Center 049

More information

Hands on Datamining & Machine Learning with Weka

Hands on Datamining & Machine Learning with Weka Step1: Click the Experimenter button to launch the Weka Experimenter. The Weka Experimenter allows you to design your own experiments of running algorithms on datasets, run the experiments and analyze

More information

BL5229: Data Analysis with Matlab Lab: Learning: Clustering

BL5229: Data Analysis with Matlab Lab: Learning: Clustering BL5229: Data Analysis with Matlab Lab: Learning: Clustering The following hands-on exercises were designed to teach you step by step how to perform and understand various clustering algorithm. We will

More information

k-nearest Neighbors + Model Selection

k-nearest Neighbors + Model Selection 10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University k-nearest Neighbors + Model Selection Matt Gormley Lecture 5 Jan. 30, 2019 1 Reminders

More information

Lecture notes. Com Page 1

Lecture notes. Com Page 1 Lecture notes Com Page 1 Contents Lectures 1. Introduction to Computational Intelligence 2. Traditional computation 2.1. Sorting algorithms 2.2. Graph search algorithms 3. Supervised neural computation

More information

Model Selection Introduction to Machine Learning. Matt Gormley Lecture 4 January 29, 2018

Model Selection Introduction to Machine Learning. Matt Gormley Lecture 4 January 29, 2018 10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University Model Selection Matt Gormley Lecture 4 January 29, 2018 1 Q&A Q: How do we deal

More information

Experimental Design + k- Nearest Neighbors

Experimental Design + k- Nearest Neighbors 10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University Experimental Design + k- Nearest Neighbors KNN Readings: Mitchell 8.2 HTF 13.3

More information

A Systematic Overview of Data Mining Algorithms. Sargur Srihari University at Buffalo The State University of New York

A Systematic Overview of Data Mining Algorithms. Sargur Srihari University at Buffalo The State University of New York A Systematic Overview of Data Mining Algorithms Sargur Srihari University at Buffalo The State University of New York 1 Topics Data Mining Algorithm Definition Example of CART Classification Iris, Wine

More information

Basic Concepts Weka Workbench and its terminology

Basic Concepts Weka Workbench and its terminology Changelog: 14 Oct, 30 Oct Basic Concepts Weka Workbench and its terminology Lecture Part Outline Concepts, instances, attributes How to prepare the input: ARFF, attributes, missing values, getting to know

More information

An Introduction to Cluster Analysis. Zhaoxia Yu Department of Statistics Vice Chair of Undergraduate Affairs

An Introduction to Cluster Analysis. Zhaoxia Yu Department of Statistics Vice Chair of Undergraduate Affairs An Introduction to Cluster Analysis Zhaoxia Yu Department of Statistics Vice Chair of Undergraduate Affairs zhaoxia@ics.uci.edu 1 What can you say about the figure? signal C 0.0 0.5 1.0 1500 subjects Two

More information

Orange3 Educational Add-on Documentation

Orange3 Educational Add-on Documentation Orange3 Educational Add-on Documentation Release 0.1 Biolab Jun 01, 2018 Contents 1 Widgets 3 2 Indices and tables 27 i ii Widgets in Educational Add-on demonstrate several key data mining and machine

More information

Application of Or-based Rule Antecedent Fuzzy Neural Networks to Iris Data Classification Problem

Application of Or-based Rule Antecedent Fuzzy Neural Networks to Iris Data Classification Problem Vol.1 (DTA 016, pp.17-1 http://dx.doi.org/10.157/astl.016.1.03 Application of Or-based Rule Antecedent Fuzzy eural etworks to Iris Data Classification roblem Chang-Wook Han Department of Electrical Engineering,

More information

Nearest Neighbor Classification

Nearest Neighbor Classification Nearest Neighbor Classification Professor Ameet Talwalkar Professor Ameet Talwalkar CS260 Machine Learning Algorithms January 11, 2017 1 / 48 Outline 1 Administration 2 First learning algorithm: Nearest

More information

What is all the Fuzz about?

What is all the Fuzz about? What is all the Fuzz about? Fuzzy Systems CPSC 433 Christian Jacob Dept. of Computer Science Dept. of Biochemistry & Molecular Biology University of Calgary Fuzzy Systems in Knowledge Engineering Fuzzy

More information

Data Mining. Practical Machine Learning Tools and Techniques. Slides for Chapter 3 of Data Mining by I. H. Witten, E. Frank and M. A.

Data Mining. Practical Machine Learning Tools and Techniques. Slides for Chapter 3 of Data Mining by I. H. Witten, E. Frank and M. A. Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter 3 of Data Mining by I. H. Witten, E. Frank and M. A. Hall Output: Knowledge representation Tables Linear models Trees Rules

More information

On Sample Weighted Clustering Algorithm using Euclidean and Mahalanobis Distances

On Sample Weighted Clustering Algorithm using Euclidean and Mahalanobis Distances International Journal of Statistics and Systems ISSN 0973-2675 Volume 12, Number 3 (2017), pp. 421-430 Research India Publications http://www.ripublication.com On Sample Weighted Clustering Algorithm using

More information

Classification with Diffuse or Incomplete Information

Classification with Diffuse or Incomplete Information Classification with Diffuse or Incomplete Information AMAURY CABALLERO, KANG YEN Florida International University Abstract. In many different fields like finance, business, pattern recognition, communication

More information

Introduction to R and Statistical Data Analysis

Introduction to R and Statistical Data Analysis Microarray Center Introduction to R and Statistical Data Analysis PART II Petr Nazarov petr.nazarov@crp-sante.lu 22-11-2010 OUTLINE PART II Descriptive statistics in R (8) sum, mean, median, sd, var, cor,

More information

Fuzzy Reasoning. Linguistic Variables

Fuzzy Reasoning. Linguistic Variables Fuzzy Reasoning Linguistic Variables Linguistic variable is an important concept in fuzzy logic and plays a key role in its applications, especially in the fuzzy expert system Linguistic variable is a

More information

arulescba: Classification for Factor and Transactional Data Sets Using Association Rules

arulescba: Classification for Factor and Transactional Data Sets Using Association Rules arulescba: Classification for Factor and Transactional Data Sets Using Association Rules Ian Johnson Southern Methodist University Abstract This paper presents an R package, arulescba, which uses association

More information

Introduction to Fuzzy Logic and Fuzzy Systems Adel Nadjaran Toosi

Introduction to Fuzzy Logic and Fuzzy Systems Adel Nadjaran Toosi Introduction to Fuzzy Logic and Fuzzy Systems Adel Nadjaran Toosi Fuzzy Slide 1 Objectives What Is Fuzzy Logic? Fuzzy sets Membership function Differences between Fuzzy and Probability? Fuzzy Inference.

More information

Stats 170A: Project in Data Science Exploratory Data Analysis: Clustering Algorithms

Stats 170A: Project in Data Science Exploratory Data Analysis: Clustering Algorithms Stats 170A: Project in Data Science Exploratory Data Analysis: Clustering Algorithms Padhraic Smyth Department of Computer Science Bren School of Information and Computer Sciences University of California,

More information

Data Mining Practical Machine Learning Tools and Techniques

Data Mining Practical Machine Learning Tools and Techniques Output: Knowledge representation Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter of Data Mining by I. H. Witten and E. Frank Decision tables Decision trees Decision rules

More information

CS 584 Data Mining. Classification 1

CS 584 Data Mining. Classification 1 CS 584 Data Mining Classification 1 Classification: Definition Given a collection of records (training set ) Each record contains a set of attributes, one of the attributes is the class. Find a model for

More information

Classification: Decision Trees

Classification: Decision Trees Classification: Decision Trees IST557 Data Mining: Techniques and Applications Jessie Li, Penn State University 1 Decision Tree Example Will a pa)ent have high-risk based on the ini)al 24-hour observa)on?

More information

SOLUTION: 1. First define the temperature range, e.g. [0 0,40 0 ].

SOLUTION: 1. First define the temperature range, e.g. [0 0,40 0 ]. 2. 2. USING MATLAB Fuzzy Toolbox GUI PROBLEM 2.1. Let the room temperature T be a fuzzy variable. Characterize it with three different (fuzzy) temperatures: cold,warm, hot. SOLUTION: 1. First define the

More information

Techniques for Dealing with Missing Values in Feedforward Networks

Techniques for Dealing with Missing Values in Feedforward Networks Techniques for Dealing with Missing Values in Feedforward Networks Peter Vamplew, David Clark*, Anthony Adams, Jason Muench Artificial Neural Networks Research Group, Department of Computer Science, University

More information

CISC 4631 Data Mining

CISC 4631 Data Mining CISC 4631 Data Mining Lecture 03: Introduction to classification Linear classifier Theses slides are based on the slides by Tan, Steinbach and Kumar (textbook authors) Eamonn Koegh (UC Riverside) 1 Classification:

More information

Derivation of Relational Fuzzy Classification Rules Using Evolutionary Computation

Derivation of Relational Fuzzy Classification Rules Using Evolutionary Computation Derivation of Relational Fuzzy Classification Rules Using Evolutionary Computation Vahab Akbarzadeh Alireza Sadeghian Marcus V. dos Santos Abstract An evolutionary system for derivation of fuzzy classification

More information

Summary. Machine Learning: Introduction. Marcin Sydow

Summary. Machine Learning: Introduction. Marcin Sydow Outline of this Lecture Data Motivation for Data Mining and Learning Idea of Learning Decision Table: Cases and Attributes Supervised and Unsupervised Learning Classication and Regression Examples Data:

More information

Fuzzy Systems (1/2) Francesco Masulli

Fuzzy Systems (1/2) Francesco Masulli (1/2) Francesco Masulli DIBRIS - University of Genova, ITALY & S.H.R.O. - Sbarro Institute for Cancer Research and Molecular Medicine Temple University, Philadelphia, PA, USA email: francesco.masulli@unige.it

More information

Fuzzy Logic Controller

Fuzzy Logic Controller Fuzzy Logic Controller Debasis Samanta IIT Kharagpur dsamanta@iitkgp.ac.in 23.01.2016 Debasis Samanta (IIT Kharagpur) Soft Computing Applications 23.01.2016 1 / 34 Applications of Fuzzy Logic Debasis Samanta

More information

Neural Networks Laboratory EE 329 A

Neural Networks Laboratory EE 329 A Neural Networks Laboratory EE 329 A Introduction: Artificial Neural Networks (ANN) are widely used to approximate complex systems that are difficult to model using conventional modeling techniques such

More information

Fuzzy Expert Systems Lecture 8 (Fuzzy Systems)

Fuzzy Expert Systems Lecture 8 (Fuzzy Systems) Fuzzy Expert Systems Lecture 8 (Fuzzy Systems) Soft Computing is an emerging approach to computing which parallels the remarkable ability of the human mind to reason and learn in an environment of uncertainty

More information

Data Mining: Exploring Data. Lecture Notes for Chapter 3

Data Mining: Exploring Data. Lecture Notes for Chapter 3 Data Mining: Exploring Data Lecture Notes for Chapter 3 Slides by Tan, Steinbach, Kumar adapted by Michael Hahsler Look for accompanying R code on the course web site. Topics Exploratory Data Analysis

More information

ANN exercise session

ANN exercise session ANN exercise session In this exercise session, you will read an external file with Iris flowers and create an internal database in Java as it was done in previous exercise session. A new file contains

More information

Machine Learning for. Artem Lind & Aleskandr Tkachenko

Machine Learning for. Artem Lind & Aleskandr Tkachenko Machine Learning for Object Recognition Artem Lind & Aleskandr Tkachenko Outline Problem overview Classification demo Examples of learning algorithms Probabilistic modeling Bayes classifier Maximum margin

More information

COMPARISON OF DENSITY-BASED CLUSTERING ALGORITHMS

COMPARISON OF DENSITY-BASED CLUSTERING ALGORITHMS COMPARISON OF DENSITY-BASED CLUSTERING ALGORITHMS Mariam Rehman Lahore College for Women University Lahore, Pakistan mariam.rehman321@gmail.com Syed Atif Mehdi University of Management and Technology Lahore,

More information

A New Approach for Handling the Iris Data Classification Problem

A New Approach for Handling the Iris Data Classification Problem International Journal of Applied Science and Engineering 2005. 3, : 37-49 A New Approach for Handling the Iris Data Classification Problem Shyi-Ming Chen a and Yao-De Fang b a Department of Computer Science

More information

COSC 6339 Big Data Analytics. Fuzzy Clustering. Some slides based on a lecture by Prof. Shishir Shah. Edgar Gabriel Spring 2017.

COSC 6339 Big Data Analytics. Fuzzy Clustering. Some slides based on a lecture by Prof. Shishir Shah. Edgar Gabriel Spring 2017. COSC 6339 Big Data Analytics Fuzzy Clustering Some slides based on a lecture by Prof. Shishir Shah Edgar Gabriel Spring 217 Clustering Clustering is a technique for finding similarity groups in data, called

More information

Data Mining: Exploring Data. Lecture Notes for Chapter 3

Data Mining: Exploring Data. Lecture Notes for Chapter 3 Data Mining: Exploring Data Lecture Notes for Chapter 3 1 What is data exploration? A preliminary exploration of the data to better understand its characteristics. Key motivations of data exploration include

More information

EFFECTIVENESS PREDICTION OF MEMORY BASED CLASSIFIERS FOR THE CLASSIFICATION OF MULTIVARIATE DATA SET

EFFECTIVENESS PREDICTION OF MEMORY BASED CLASSIFIERS FOR THE CLASSIFICATION OF MULTIVARIATE DATA SET EFFECTIVENESS PREDICTION OF MEMORY BASED CLASSIFIERS FOR THE CLASSIFICATION OF MULTIVARIATE DATA SET C. Lakshmi Devasena 1 1 Department of Computer Science and Engineering, Sphoorthy Engineering College,

More information

FUZZY SYSTEMS: Basics using MATLAB Fuzzy Toolbox. Heikki N. Koivo

FUZZY SYSTEMS: Basics using MATLAB Fuzzy Toolbox. Heikki N. Koivo FUZZY SYSTEMS: Basics using MATLAB Fuzzy Toolbox By Heikki N. Koivo 200 2.. Fuzzy sets Membership functions Fuzzy set Universal discourse U set of elements, {u}. Fuzzy set F in universal discourse U: Membership

More information

Support Vector Machines - Supplement

Support Vector Machines - Supplement Support Vector Machines - Supplement Prof. Dan A. Simovici UMB 1 / 1 Outline 2 / 1 Building an SVM Classifier for the Iris data set Data Set Description Attribute Information: sepal length in cm sepal

More information

Fuzzy Systems. Fuzzy Clustering 2

Fuzzy Systems. Fuzzy Clustering 2 Fuzzy Systems Fuzzy Clustering 2 Prof. Dr. Rudolf Kruse Christoph Doell {kruse,doell}@iws.cs.uni-magdeburg.de Otto-von-Guericke University of Magdeburg Faculty of Computer Science Department of Knowledge

More information

Machine Learning Chapter 2. Input

Machine Learning Chapter 2. Input Machine Learning Chapter 2. Input 2 Input: Concepts, instances, attributes Terminology What s a concept? Classification, association, clustering, numeric prediction What s in an example? Relations, flat

More information

Data Mining: Exploring Data. Lecture Notes for Chapter 3. Introduction to Data Mining

Data Mining: Exploring Data. Lecture Notes for Chapter 3. Introduction to Data Mining Data Mining: Exploring Data Lecture Notes for Chapter 3 Introduction to Data Mining by Tan, Steinbach, Kumar What is data exploration? A preliminary exploration of the data to better understand its characteristics.

More information

Data Mining: Exploring Data. Lecture Notes for Data Exploration Chapter. Introduction to Data Mining

Data Mining: Exploring Data. Lecture Notes for Data Exploration Chapter. Introduction to Data Mining Data Mining: Exploring Data Lecture Notes for Data Exploration Chapter Introduction to Data Mining by Tan, Steinbach, Karpatne, Kumar 02/03/2018 Introduction to Data Mining 1 What is data exploration?

More information

Computational Intelligence Lecture 10:Fuzzy Sets

Computational Intelligence Lecture 10:Fuzzy Sets Computational Intelligence Lecture 10:Fuzzy Sets Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Fall 2011 arzaneh Abdollahi Computational Intelligence Lecture

More information

Fuzzy Sets and Fuzzy Logic

Fuzzy Sets and Fuzzy Logic Fuzzy Sets and Fuzzy Logic KR Chowdhary, Professor, Department of Computer Science & Engineering, MBM Engineering College, JNV University, Jodhpur, Email: Outline traditional logic : {true,false} Crisp

More information

Computational Statistics The basics of maximum likelihood estimation, Bayesian estimation, object recognitions

Computational Statistics The basics of maximum likelihood estimation, Bayesian estimation, object recognitions Computational Statistics The basics of maximum likelihood estimation, Bayesian estimation, object recognitions Thomas Giraud Simon Chabot October 12, 2013 Contents 1 Discriminant analysis 3 1.1 Main idea................................

More information

Ordering attributes for missing values prediction and data classification

Ordering attributes for missing values prediction and data classification Ordering attributes for missing values prediction and data classification E. R. Hruschka Jr., N. F. F. Ebecken COPPE /Federal University of Rio de Janeiro, Brazil. Abstract This work shows the application

More information

Fuzzy Sets and Fuzzy Logic. KR Chowdhary, Professor, Department of Computer Science & Engineering, MBM Engineering College, JNV University, Jodhpur,

Fuzzy Sets and Fuzzy Logic. KR Chowdhary, Professor, Department of Computer Science & Engineering, MBM Engineering College, JNV University, Jodhpur, Fuzzy Sets and Fuzzy Logic KR Chowdhary, Professor, Department of Computer Science & Engineering, MBM Engineering College, JNV University, Jodhpur, Outline traditional logic : {true,false} Crisp Logic

More information

Data Mining - Data. Dr. Jean-Michel RICHER Dr. Jean-Michel RICHER Data Mining - Data 1 / 47

Data Mining - Data. Dr. Jean-Michel RICHER Dr. Jean-Michel RICHER Data Mining - Data 1 / 47 Data Mining - Data Dr. Jean-Michel RICHER 2018 jean-michel.richer@univ-angers.fr Dr. Jean-Michel RICHER Data Mining - Data 1 / 47 Outline 1. Introduction 2. Data preprocessing 3. CPA with R 4. Exercise

More information

Rule extraction from support vector machines

Rule extraction from support vector machines Rule extraction from support vector machines Haydemar Núñez 1,3 Cecilio Angulo 1,2 Andreu Català 1,2 1 Dept. of Systems Engineering, Polytechnical University of Catalonia Avda. Victor Balaguer s/n E-08800

More information

Machine Learning: Algorithms and Applications Mockup Examination

Machine Learning: Algorithms and Applications Mockup Examination Machine Learning: Algorithms and Applications Mockup Examination 14 May 2012 FIRST NAME STUDENT NUMBER LAST NAME SIGNATURE Instructions for students Write First Name, Last Name, Student Number and Signature

More information

CHAPTER 3 FUZZY INFERENCE SYSTEM

CHAPTER 3 FUZZY INFERENCE SYSTEM CHAPTER 3 FUZZY INFERENCE SYSTEM Fuzzy inference is the process of formulating the mapping from a given input to an output using fuzzy logic. There are three types of fuzzy inference system that can be

More information

Image processing & Computer vision Xử lí ảnh và thị giác máy tính

Image processing & Computer vision Xử lí ảnh và thị giác máy tính Image processing & Computer vision Xử lí ảnh và thị giác máy tính Detection and Recognition 2D et 3D Alain Boucher - IFI Introduction In this chapter, we introduce some techniques for pattern detection

More information

Unsupervised learning

Unsupervised learning Unsupervised learning Enrique Muñoz Ballester Dipartimento di Informatica via Bramante 65, 26013 Crema (CR), Italy enrique.munoz@unimi.it Enrique Muñoz Ballester 2017 1 Download slides data and scripts:

More information

FINDING PATTERN BEHAVIOR IN TEMPORAL DATA USING FUZZY CLUSTERING

FINDING PATTERN BEHAVIOR IN TEMPORAL DATA USING FUZZY CLUSTERING 1 FINDING PATTERN BEHAVIOR IN TEMPORAL DATA USING FUZZY CLUSTERING RICHARD E. HASKELL Oaland University PING LI Oaland University DARRIN M. HANNA Oaland University KA C. CHEOK Oaland University GREG HUDAS

More information

Statistical Methods in AI

Statistical Methods in AI Statistical Methods in AI Distance Based and Linear Classifiers Shrenik Lad, 200901097 INTRODUCTION : The aim of the project was to understand different types of classification algorithms by implementing

More information

10-701/15-781, Fall 2006, Final

10-701/15-781, Fall 2006, Final -7/-78, Fall 6, Final Dec, :pm-8:pm There are 9 questions in this exam ( pages including this cover sheet). If you need more room to work out your answer to a question, use the back of the page and clearly

More information

Introduction to Machine Learning Prof. Anirban Santara Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur

Introduction to Machine Learning Prof. Anirban Santara Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur Introduction to Machine Learning Prof. Anirban Santara Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur Lecture 14 Python Exercise on knn and PCA Hello everyone,

More information

EPL451: Data Mining on the Web Lab 5

EPL451: Data Mining on the Web Lab 5 EPL451: Data Mining on the Web Lab 5 Παύλος Αντωνίου Γραφείο: B109, ΘΕΕ01 University of Cyprus Department of Computer Science Predictive modeling techniques IBM reported in June 2012 that 90% of data available

More information

Introduction to Machine Learning

Introduction to Machine Learning Introduction to Machine Learning Eric Medvet 16/3/2017 1/77 Outline Machine Learning: what and why? Motivating example Tree-based methods Regression trees Trees aggregation 2/77 Teachers Eric Medvet Dipartimento

More information

Representing structural patterns: Reading Material: Chapter 3 of the textbook by Witten

Representing structural patterns: Reading Material: Chapter 3 of the textbook by Witten Representing structural patterns: Plain Classification rules Decision Tree Rules with exceptions Relational solution Tree for Numerical Prediction Instance-based presentation Reading Material: Chapter

More information

What is all the Fuzz about?

What is all the Fuzz about? What is all the Fuzz about? Fuzzy Systems: Introduction CPSC 533 Christian Jacob Dept. of Computer Science Dept. of Biochemistry & Molecular Biology University of Calgary Fuzzy Systems in Knowledge Engineering

More information

bigml-java Documentation Release latest

bigml-java Documentation Release latest bigml-java Documentation Release latest May 02, 2017 Contents 1 Support 3 2 Requirements 5 3 Installation 7 4 Authentication 9 5 Quick Start 11 6 Fields 13 7 Dataset 15 8 Model 17 9 Evaluation 19 10 Cluster

More information

Hsiaochun Hsu Date: 12/12/15. Support Vector Machine With Data Reduction

Hsiaochun Hsu Date: 12/12/15. Support Vector Machine With Data Reduction Support Vector Machine With Data Reduction 1 Table of Contents Summary... 3 1. Introduction of Support Vector Machines... 3 1.1 Brief Introduction of Support Vector Machines... 3 1.2 SVM Simple Experiment...

More information

Simulation of Back Propagation Neural Network for Iris Flower Classification

Simulation of Back Propagation Neural Network for Iris Flower Classification American Journal of Engineering Research (AJER) e-issn: 2320-0847 p-issn : 2320-0936 Volume-6, Issue-1, pp-200-205 www.ajer.org Research Paper Open Access Simulation of Back Propagation Neural Network

More information

Argha Roy* Dept. of CSE Netaji Subhash Engg. College West Bengal, India.

Argha Roy* Dept. of CSE Netaji Subhash Engg. College West Bengal, India. Volume 3, Issue 3, March 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Training Artificial

More information

Classification with Diffuse or Incomplete Information

Classification with Diffuse or Incomplete Information Classification with Diffuse or Incomplete Information AMAURY CABALLERO, KANG YEN, YECHANG FANG Department of Electrical & Computer Engineering Florida International University 10555 W. Flagler Street,

More information

Homework #4 Programming Assignment Due: 11:59 pm, November 4, 2018

Homework #4 Programming Assignment Due: 11:59 pm, November 4, 2018 CSCI 567, Fall 18 Haipeng Luo Homework #4 Programming Assignment Due: 11:59 pm, ovember 4, 2018 General instructions Your repository will have now a directory P4/. Please do not change the name of this

More information

Computational Intelligence Lecture 12:Linguistic Variables and Fuzzy Rules

Computational Intelligence Lecture 12:Linguistic Variables and Fuzzy Rules Computational Intelligence Lecture 12:Linguistic Variables and Fuzzy Rules Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Fall 2011 Farzaneh Abdollahi Computational

More information

Data Mining: Exploring Data

Data Mining: Exploring Data Data Mining: Exploring Data Lecture Notes for Chapter 3 Introduction to Data Mining by Tan, Steinbach, Kumar But we start with a brief discussion of the Friedman article and the relationship between Data

More information

Ripple Down Rule learner (RIDOR) Classifier for IRIS Dataset

Ripple Down Rule learner (RIDOR) Classifier for IRIS Dataset Ripple Down Rule learner (RIDOR) Classifier for IRIS Dataset V.Veeralakshmi Department of Computer Science Bharathiar University, Coimbatore, Tamilnadu veeralakshmi13@gmail.com Dr.D.Ramyachitra Department

More information

Background Fuzzy control enables noncontrol-specialists. A fuzzy controller works with verbal rules rather than mathematical relationships.

Background Fuzzy control enables noncontrol-specialists. A fuzzy controller works with verbal rules rather than mathematical relationships. Introduction to Fuzzy Control Background Fuzzy control enables noncontrol-specialists to design control system. A fuzzy controller works with verbal rules rather than mathematical relationships. knowledge

More information

ESSENTIALLY, system modeling is the task of building

ESSENTIALLY, system modeling is the task of building IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, VOL. 53, NO. 4, AUGUST 2006 1269 An Algorithm for Extracting Fuzzy Rules Based on RBF Neural Network Wen Li and Yoichi Hori, Fellow, IEEE Abstract A four-layer

More information

Data Mining. Practical Machine Learning Tools and Techniques. Slides for Chapter 3 of Data Mining by I. H. Witten, E. Frank and M. A.

Data Mining. Practical Machine Learning Tools and Techniques. Slides for Chapter 3 of Data Mining by I. H. Witten, E. Frank and M. A. Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter 3 of Data Mining by I. H. Witten, E. Frank and M. A. Hall Input: Concepts, instances, attributes Terminology What s a concept?

More information

Performance Measure of Hard c-means,fuzzy c-means and Alternative c-means Algorithms

Performance Measure of Hard c-means,fuzzy c-means and Alternative c-means Algorithms Performance Measure of Hard c-means,fuzzy c-means and Alternative c-means Algorithms Binoda Nand Prasad*, Mohit Rathore**, Geeta Gupta***, Tarandeep Singh**** *Guru Gobind Singh Indraprastha University,

More information

Fuzzy Reasoning. Outline

Fuzzy Reasoning. Outline Fuzzy Reasoning Outline Introduction Bivalent & Multivalent Logics Fundamental fuzzy concepts Fuzzification Defuzzification Fuzzy Expert System Neuro-fuzzy System Introduction Fuzzy concept first introduced

More information

Fuzzy logic controllers

Fuzzy logic controllers Fuzzy logic controllers Digital fuzzy logic controllers Doru Todinca Department of Computers and Information Technology UPT Outline Hardware implementation of fuzzy inference The general scheme of the

More information

DATA MINING INTRODUCTION TO CLASSIFICATION USING LINEAR CLASSIFIERS

DATA MINING INTRODUCTION TO CLASSIFICATION USING LINEAR CLASSIFIERS DATA MINING INTRODUCTION TO CLASSIFICATION USING LINEAR CLASSIFIERS 1 Classification: Definition Given a collection of records (training set ) Each record contains a set of attributes and a class attribute

More information

Chapter 7 Fuzzy Logic Controller

Chapter 7 Fuzzy Logic Controller Chapter 7 Fuzzy Logic Controller 7.1 Objective The objective of this section is to present the output of the system considered with a fuzzy logic controller to tune the firing angle of the SCRs present

More information

CHAPTER 4 FUZZY LOGIC, K-MEANS, FUZZY C-MEANS AND BAYESIAN METHODS

CHAPTER 4 FUZZY LOGIC, K-MEANS, FUZZY C-MEANS AND BAYESIAN METHODS CHAPTER 4 FUZZY LOGIC, K-MEANS, FUZZY C-MEANS AND BAYESIAN METHODS 4.1. INTRODUCTION This chapter includes implementation and testing of the student s academic performance evaluation to achieve the objective(s)

More information

fuzzylite a fuzzy logic control library in C++

fuzzylite a fuzzy logic control library in C++ fuzzylite a fuzzy logic control library in C++ Juan Rada-Vilela jcrada@fuzzylite.com Abstract Fuzzy Logic Controllers (FLCs) are software components found nowadays within well-known home appliances such

More information

Nearest neighbors classifiers

Nearest neighbors classifiers Nearest neighbors classifiers James McInerney Adapted from slides by Daniel Hsu Sept 11, 2017 1 / 25 Housekeeping We received 167 HW0 submissions on Gradescope before midnight Sept 10th. From a random

More information

Data Mining and Analysis: Fundamental Concepts and Algorithms

Data Mining and Analysis: Fundamental Concepts and Algorithms Data Mining and Analysis: Fundamental Concepts and Algorithms dataminingbook.info Mohammed J. Zaki Wagner Meira Jr. Department of Computer Science Rensselaer Polytechnic Institute, Troy, NY, USA Department

More information

Linear discriminant analysis and logistic

Linear discriminant analysis and logistic Practical 6: classifiers Linear discriminant analysis and logistic This practical looks at two different methods of fitting linear classifiers. The linear discriminant analysis is implemented in the MASS

More information

FUZZY KERNEL K-MEDOIDS ALGORITHM FOR MULTICLASS MULTIDIMENSIONAL DATA CLASSIFICATION

FUZZY KERNEL K-MEDOIDS ALGORITHM FOR MULTICLASS MULTIDIMENSIONAL DATA CLASSIFICATION FUZZY KERNEL K-MEDOIDS ALGORITHM FOR MULTICLASS MULTIDIMENSIONAL DATA CLASSIFICATION 1 ZUHERMAN RUSTAM, 2 AINI SURI TALITA 1 Senior Lecturer, Department of Mathematics, Faculty of Mathematics and Natural

More information

A new evidential c-means clustering method

A new evidential c-means clustering method A new evidential c-means clustering method Zhun-ga Liu, Jean Dezert, Quan Pan, Yong-mei Cheng. School of Automation, Northwestern Polytechnical University, Xi an, China. Email: liuzhunga@gmail.com. ONERA

More information