A Comparison of Leading Data Mining Tools
|
|
|
- Kristopher Lewis
- 5 years ago
- Views:
Transcription
1 A Comparison of Leading Data Mining Tools John F. Elder IV & Dean W. Abbott Elder Research Fourth International Conference on Knowledge Discovery & Data Mining Friday, August 28, 1998 New York, New York
2 Copyright 1998, John F. Elder IV and Dean W. Abbott All rights reserved Manufactured in the United States of America 1998 Elder Research T8-2
3 Contacting Elder Research Dr. John F. Elder IV 1006 Wildmere Place Charlottesville, VA Dean W. Abbott 3443 Villanova Avenue San Diego, CA Fax: Elder Research T8-3
4 Tutorial Goals Compare and Summarize Data Mining Tools which: Offer multiple modeling and classification algorithms Support project stages surrounding model construction Stand alone Are general-purpose Cost a lot We could get our hands on Include some (focused) Desktop Tools Other Reports: Two Crows, Aberdeen Group, Elder Research (forthcoming ), Data Mining Journal 1998 Elder Research T8-4
5 Topics Products covered Review of algorithms Comparative tables of properties Screen shots exemplifying qualities Summary of distinctives 1998 Elder Research T8-5
6 Caveats We don t know every tool well (and are sure to have missed some!) Level of exposure noted for each tool Our background (biasing our perspective) Very technical, early adopters Emphasize solving real-world applications More classification than estimation Field of tools is quite dynamic New versions appear regularly 1998 Elder Research T8-6
7 Data Mining Products PRW Model Elder Research T8-7
8 Tools Evaluated Product Company URL Version Tested Our Experience Clementine luintegral Solutions, Ltd. 4 Moderate Darwin TThinking Machines, Corp Moderate DataCruncher DDataMind High Enterprise Miner SSAS Institute Beta Moderate GainSmarts UUrban Science Low Intelligent Miner IIBM 2 Low MineSet SSilicon Graphics, Inc Low Model 1 GGroup 1/Unica Technologies Moderate ModelQuest AAbTech Corp. 1 Moderate PRW UUnica Technologies, Inc High CART Salford Systems Moderate NeuroShell Ward Systems Group, Inc. 3 Moderate OLPARS PAR Government Systems mailto://olpars@partech.com 8.1 High Scenario Cognos 2 Moderate See5 RuleQuest Research Moderate S-Plus MathSoft 4 High WizWhy WizSoft Moderate 1998 Elder Research T8-8
9 Categories for Comparisons Platforms Supported Algorithms Included Decision Trees Neural Networks Other Data Input and Model Output Options Usability Ratings Visualization Capabilities Modeling Automation Methods 1998 Elder Research T8-9
10 Platforms PC Standalone (95/NT) Unix Standalone Unix Server / PC Client 1998 Elder Research T8-10 NT Server / PC Client Database Connectivity Clementine + Darwin DataCruncher Enterprise Miner + GainSmarts Intelligent Miner MineSet Model 1 ModelQuest PRW CART + Scenario NeuroShell OLPARS See5 + S-Plus WizWhy Key blank no capability some capability good capability + excellent capability
11 Tool Groupings Desktop PC (standalone) Flat Files One or Two Algorithms High End Multiple Platforms, Client- Server Flat Files or Direct Database Access Multiple Algorithm Types Data Fits into RAM Large Databases 1998 Elder Research T8-11
12 End User Perspectives Business Intuitive Interface Clear steps in data mining process Non-technical terminology Familiar environment Descriptive Reporting Domain terminology Graphical representations Technical Algorithm Options Knobs to enhance model performance Model Automation Simplify model design cycle Documentation of steps used in generating models (repeatability) 1998 Elder Research T8-12
13 Data Input & Model Output Automatic Header Save Data Format ODBC Native Database Drivers Summary Reports Output Source Code Clementine Darwin DataCruncher Enterprise Miner GainSmarts Intelligent Miner MineSet Model 1 ModelQuest PRW CART Scenario NeuroShell OLPARS See5 S-Plus WizWhy 1998 Elder Research T8-13
14 Decision Trees n a > 4 y n b>3.5 y n b > 2 y n a > 1 y Elder Research T8-14
15 Polynomial Networks Z 17 = a -.15b bc abc + 0.5c 3 Layer 0 (Normalizers) Layer 1 a N1 z1 z9 Double 16 k N9 z6 Single 14 f N6 d N4 z4 Triple 17 z16 z14 z17 Layer 2 Multi- Linear 15 z15 Layer 3 Triple 21 z21 Unitizers U2 Y1 h N8 z8 Double 20 z20 Double 19 z19 U7 Y2 e N5 z Elder Research T8-15
16 Consensus Models Parametrically Summarize Data Points orders, terms Regression Polynomial Networks (e.g. GMDH, ASPN) Decision Trees (e.g., CART, CHAID, C5) Logistic or Sigmoidal Networks (ANNs) Hinging Hyperplanes, MARS 1998 Elder Research T8-16
17 Consensus Models (continued) orientation, bin width Histogram function Radial Basis Function family, order Wavelets 1998 Elder Research T8-17
18 Contributory Models retain data points; each potentially affects estimate at new point shape, spread Kernels k, distance metric k-nearest Neighbor Goal, iterations Delaunay Planes Spread, index Projection Pursuit Regression 1998 Elder Research T8-18
19 Properties of Algorithms Algorithm Accurate Scalable Interpretable Useable Robust Versatile Fast Hot Classical (LR, LDA) Neural Networks Visualization Decision Trees Polynomial Networks K-Nearest Neighbors Kernels Key good neutral bad 1998 Elder Research T8-19
20 Algorithms Decision Trees Linear/Statistical Multi-layer Perceptrons Nearest Neighbor Radial Basis Functions Bayes Rule Induction Polynomial Networks Generalized Linear Models Time Series Sequential Discovery K Means Association Rules Kohonen Clementine Darwin Datamind Enterprise Miner GainSmarts + Intelligent Miner + MineSet Model 1 + ModelQuest PRW + CART Cognos NeuroShell + OLPARS See5 SPlus + WizWhy 1998 Elder Research T8-20
21 Multi-Layer Perceptrons Learning Rate Learning Rate Decay Momentum Multiple Activation Functions Multiple Stop Criteria Cross-Validation Normalize Inputs Advanced Learning Alg. Other Cost functions Automatic Model Selection Network Visual Parameter Summary Clementine Darwin Enterprise Miner Intelligent Miner Model 1 PRW NeuroShell OLPARS 1998 Elder Research T8-21
22 Decision Trees "CART" C5 or C4.5 CHAID Other Priors Classification Costs Missing Data Pruning Severity Visual Trees Clementine Darwin Enterprise Miner + GainSmarts Intelligent Miner MineSet Model 1 ModelQuest CART + Scenario S-Plus See Elder Research T8-22
23 Regression / Stats Linear Logistic Clementine Complexity Penalty Cross- Validation Input Selection Factor Analysis Clementine Y Enterprise Miner + + GainSmarts + + Intelligent Miner MineSet Model 1 + ModelQuest Enterprise PRW S-Plus + + S-Plus + + Scenario 1998 Elder Research T8-23
24 Usability Data Loading and Manipulation Model Building Model Understanding Technical Support Overall Clementine Darwin + DataCruncher + + Enterprise Miner GainSmarts + Intelligent Miner MineSet Model ModelQuest Enterprise PRW CART Scenario NeuroShell OLPARS See5 S-Plus + WizWhy Elder Research T8-24
25 Visualization Histograms Pie Charts Scatter/ Line Plots Rotating Scatter Conditional Plots Classification Decision Regions Correlation Plots Clementine Darwin DataCruncher Enterprise Miner GainSmarts Intelligent Miner MineSet Model 1 ModelQuest Enterprise PRW CART Scenario NeuroShell OLPARS See5 S-Plus WizWhy 1998 Elder Research T8-25
26 Automation Method of Automation Free Text Annotation of Steps Clementine Visual Programming, Programming Language Darwin Programming Language DataCruncher (Task manager) Enterprise Miner Visual Programming, Programming Language GainSmarts Macro Language, Wizards Intelligent Miner (Wizards) MineSet Data History, Log Model 1 Model Wizard ModelQuest Batch Agenda PRW Experiement Manager; Macros CART Scenario NeuroShell OLPARS See5 S-Plus WizWhy Built-in Basic Scripting Scripting (S); C/C Elder Research T8-26
27 A Recent Breakthrough: Bundling 1) Construct varied models, and 2) Combine their estimates Generate component models by varying: Case Weights Data Values Guiding Parameters Variable Subsets Combine estimates using: Estimator Weights Voting Advisor Perceptrons Partitions of Design Space 1998 Elder Research T8-27
28 Example Bundling Techniques Bayes: sum estimates of possible models, weighted by priors GMDH (Ivakhenko 68) -- multiple layers of quadratic polynomials, using two inputs each, fit by LR Stacking (Wolpert 92) -- train a 2nd-level (LR) model using leave-1-out estimates of 1st-level (neural net) models Bagging (Breiman 96) (bootstrap aggregating) -- bootstrap data (to build trees mostly); take majority vote or average Bumping (Tibshirani 97) -- bootstrap, select single best Boosting (Freund & Shapire 96) -- weight error cases by βτ = (1-e(t))/e(t), iteratively re-model; weight model t by ln(βτ) Crumpling (Anderson & Elder 98) -- average cross-validations Born-Again (Breiman 98) -- invent new X data Elder Research T8-28
29 Distinctives Strengths Weaknesses Clementine visual interface; algorithm breadth scalability Darwin efficient client-server; intuitive interface options no unsupervised; limited visualization DataCruncher ease of use single algorithm Enterprise Miner depth of algorithms; visual interface harder to use; new product issues GainSmarts data transformations, built on SAS; algorithm option depth no unsupervised; limited visualization Intelligent Miner algorithm breadth; graphical tree/cluster output few algorithm options; no automation MineSet data visualization few algorithms; no model export Model 1 ease of use; automated model discovery really a vertical tool ModelQuest breadth of algorithms some non-intuitive interface options PRW extensive algorithms; automated model selection limited visualization CART depth of tree options difficult file I/O; limited visualization Scenario ease of use narrow analysis path NeuroShell multiple neural network architectures unorthodox interface; only neural networks OLPARS multiple statistical algorithms; class-based visualization dated interface; difficult file I/O See5 depth of tree options limited visualization; few data options S-Plus depth of algorithms; visualization; programable/extendable limited inductive methods; steep learning curve WizWhy ease of use; ease of model understanding limited visualization 1998 Elder Research T8-29
30 Closing Observations Data Mining Tools Can: Enhance inference process Speed up design cycle Data Mining Tools Can Not: Substitute for statistical and domain expertise Users are advised to: Get training on tools Be alert for product upgrades 1998 Elder Research T8-30
31 Forthcoming Report Report provides detailed comparison of high-end data mining tools, including capabilities, ease of use, and practical tips. Available for $695 from Elder Research ( Q Purchasers receive brief free consulting session to explore report findings in more detail, if desired. Note: The analyses and reviews were performed completely independently, and were made possible by the cooperation of the vendors, for which Elder Research is very grateful. The companies, however, provided no financial support, and had no influence on its editorial content Elder Research T8-31
INTRODUCTION... 2 FEATURES OF DARWIN... 4 SPECIAL FEATURES OF DARWIN LATEST FEATURES OF DARWIN STRENGTHS & LIMITATIONS OF DARWIN...
INTRODUCTION... 2 WHAT IS DATA MINING?... 2 HOW TO ACHIEVE DATA MINING... 2 THE ROLE OF DARWIN... 3 FEATURES OF DARWIN... 4 USER FRIENDLY... 4 SCALABILITY... 6 VISUALIZATION... 8 FUNCTIONALITY... 10 Data
Now, Data Mining Is Within Your Reach
Clementine Desktop Specifications Now, Data Mining Is Within Your Reach Data mining delivers significant, measurable value. By uncovering previously unknown patterns and connections in data, data mining
Combining Models to Improve Classifier Accuracy and Robustness 1
Combining Models to Improve Classifier Accuracy and Robustness 1 Dean W. Abbott Abbott Consulting P.O. Box 22536 San Diego, CA 92192-2536 USA Email: dean@abbott-consulting.com Abstract Recent years have
Enterprise Miner Version 4.0. Changes and Enhancements
Enterprise Miner Version 4.0 Changes and Enhancements Table of Contents General Information.................................................................. 1 Upgrading Previous Version Enterprise Miner
Combining Models to Improve Classifier Accuracy and Robustness
Combining Models to Improve Classifier Accuracy and Robustness Dean W. Abbott Abbott Consulting P.O. Box 22536 San Diego, CA 92192-2536 USA Email: dean@abbott-consulting.com Abstract Recent years have
> Data Mining Overview with Clementine
> Data Mining Overview with Clementine This two-day course introduces you to the major steps of the data mining process. The course goal is for you to be able to begin planning or evaluate your firm s
Preface to the Second Edition. Preface to the First Edition. 1 Introduction 1
Preface to the Second Edition Preface to the First Edition vii xi 1 Introduction 1 2 Overview of Supervised Learning 9 2.1 Introduction... 9 2.2 Variable Types and Terminology... 9 2.3 Two Simple Approaches
Gain Greater Productivity in Enterprise Data Mining
Clementine 9.0 Specifications Gain Greater Productivity in Enterprise Data Mining Discover patterns and associations in your organization s data and make decisions that lead to significant, measurable
Predictive Analytics: Demystifying Current and Emerging Methodologies. Tom Kolde, FCAS, MAAA Linda Brobeck, FCAS, MAAA
Predictive Analytics: Demystifying Current and Emerging Methodologies Tom Kolde, FCAS, MAAA Linda Brobeck, FCAS, MAAA May 18, 2017 About the Presenters Tom Kolde, FCAS, MAAA Consulting Actuary Chicago,
Ensemble Learning. Another approach is to leverage the algorithms we have via ensemble methods
Ensemble Learning Ensemble Learning So far we have seen learning algorithms that take a training set and output a classifier What if we want more accuracy than current algorithms afford? Develop new learning
Contents. Preface to the Second Edition
Preface to the Second Edition v 1 Introduction 1 1.1 What Is Data Mining?....................... 4 1.2 Motivating Challenges....................... 5 1.3 The Origins of Data Mining....................
DATA SCIENCE INTRODUCTION QSHORE TECHNOLOGIES. About the Course:
DATA SCIENCE About the Course: In this course you will get an introduction to the main tools and ideas which are required for Data Scientist/Business Analyst/Data Analyst/Analytics Manager/Actuarial Scientist/Business
Naïve Bayes for text classification
Road Map Basic concepts Decision tree induction Evaluation of classifiers Rule induction Classification using association rules Naïve Bayesian classification Naïve Bayes for text classification Support
Tree-based methods for classification and regression
Tree-based methods for classification and regression Ryan Tibshirani Data Mining: 36-462/36-662 April 11 2013 Optional reading: ISL 8.1, ESL 9.2 1 Tree-based methods Tree-based based methods for predicting
Classification Algorithms in Data Mining
August 9th, 2016 Suhas Mallesh Yash Thakkar Ashok Choudhary CIS660 Data Mining and Big Data Processing -Dr. Sunnie S. Chung Classification Algorithms in Data Mining Deciding on the classification algorithms
Random Forest A. Fornaser
Random Forest A. Fornaser alberto.fornaser@unitn.it Sources Lecture 15: decision trees, information theory and random forests, Dr. Richard E. Turner Trees and Random Forests, Adele Cutler, Utah State University
Homework. Gaussian, Bishop 2.3 Non-parametric, Bishop 2.5 Linear regression Pod-cast lecture on-line. Next lectures:
Homework Gaussian, Bishop 2.3 Non-parametric, Bishop 2.5 Linear regression 3.0-3.2 Pod-cast lecture on-line Next lectures: I posted a rough plan. It is flexible though so please come with suggestions Bayes
Machine Learning Techniques for Data Mining
Machine Learning Techniques for Data Mining Eibe Frank University of Waikato New Zealand 10/25/2000 1 PART VII Moving on: Engineering the input and output 10/25/2000 2 Applying a learner is not all Already
Data Mining Lecture 8: Decision Trees
Data Mining Lecture 8: Decision Trees Jo Houghton ECS Southampton March 8, 2019 1 / 30 Decision Trees - Introduction A decision tree is like a flow chart. E. g. I need to buy a new car Can I afford it?
AN OVERVIEW AND EXPLORATION OF JMP A DATA DISCOVERY SYSTEM IN DAIRY SCIENCE
AN OVERVIEW AND EXPLORATION OF JMP A DATA DISCOVERY SYSTEM IN DAIRY SCIENCE A.P. Ruhil and Tara Chand National Dairy Research Institute, Karnal-132001 JMP commonly pronounced as Jump is a statistical software
Classification using Weka (Brain, Computation, and Neural Learning)
LOGO Classification using Weka (Brain, Computation, and Neural Learning) Jung-Woo Ha Agenda Classification General Concept Terminology Introduction to Weka Classification practice with Weka Problems: Pima
Outlier Ensembles. Charu C. Aggarwal IBM T J Watson Research Center Yorktown, NY Keynote, Outlier Detection and Description Workshop, 2013
Charu C. Aggarwal IBM T J Watson Research Center Yorktown, NY 10598 Outlier Ensembles Keynote, Outlier Detection and Description Workshop, 2013 Based on the ACM SIGKDD Explorations Position Paper: Outlier
ADVANCED ANALYTICS USING SAS ENTERPRISE MINER RENS FEENSTRA
INSIGHTS@SAS: ADVANCED ANALYTICS USING SAS ENTERPRISE MINER RENS FEENSTRA AGENDA 09.00 09.15 Intro 09.15 10.30 Analytics using SAS Enterprise Guide Ellen Lokollo 10.45 12.00 Advanced Analytics using SAS
Gain Insight and Improve Performance with Data Mining
Clementine 11.0 Specifications Gain Insight and Improve Performance with Data Mining Data mining provides organizations with a clearer view of current conditions and deeper insight into future events.
Slides for Data Mining by I. H. Witten and E. Frank
Slides for Data Mining by I. H. Witten and E. Frank 7 Engineering the input and output Attribute selection Scheme-independent, scheme-specific Attribute discretization Unsupervised, supervised, error-
A Comparative Study of Data Mining Process Models (KDD, CRISP-DM and SEMMA)
International Journal of Innovation and Scientific Research ISSN 2351-8014 Vol. 12 No. 1 Nov. 2014, pp. 217-222 2014 Innovative Space of Scientific Research Journals http://www.ijisr.issr-journals.org/
Overview. Non-Parametrics Models Definitions KNN. Ensemble Methods Definitions, Examples Random Forests. Clustering. k-means Clustering 2 / 8
Tutorial 3 1 / 8 Overview Non-Parametrics Models Definitions KNN Ensemble Methods Definitions, Examples Random Forests Clustering Definitions, Examples k-means Clustering 2 / 8 Non-Parametrics Models Definitions
Data Science. Data Analyst. Data Scientist. Data Architect
Data Science Data Analyst Data Analysis in Excel Programming in R Introduction to Python/SQL/Tableau Data Visualization in R / Tableau Exploratory Data Analysis Data Scientist Inferential Statistics &
Statistical Good Practice Guidelines. 1. Introduction. Contents. SSC home Using Excel for Statistics - Tips and Warnings
Statistical Good Practice Guidelines SSC home Using Excel for Statistics - Tips and Warnings On-line version 2 - March 2001 This is one in a series of guides for research and support staff involved in
SUPERVISED LEARNING METHODS. Stanley Liang, PhD Candidate, Lassonde School of Engineering, York University Helix Science Engagement Programs 2018
SUPERVISED LEARNING METHODS Stanley Liang, PhD Candidate, Lassonde School of Engineering, York University Helix Science Engagement Programs 2018 2 CHOICE OF ML You cannot know which algorithm will work
Analytical model A structure and process for analyzing a dataset. For example, a decision tree is a model for the classification of a dataset.
Glossary of data mining terms: Accuracy Accuracy is an important factor in assessing the success of data mining. When applied to data, accuracy refers to the rate of correct values in the data. When applied
CPSC 340: Machine Learning and Data Mining. Principal Component Analysis Fall 2017
CPSC 340: Machine Learning and Data Mining Principal Component Analysis Fall 2017 Assignment 3: 2 late days to hand in tonight. Admin Assignment 4: Due Friday of next week. Last Time: MAP Estimation MAP
Knowledge Discovery and Data Mining. Neural Nets. A simple NN as a Mathematical Formula. Notes. Lecture 13 - Neural Nets. Tom Kelsey.
Knowledge Discovery and Data Mining Lecture 13 - Neural Nets Tom Kelsey School of Computer Science University of St Andrews http://tom.home.cs.st-andrews.ac.uk twk@st-andrews.ac.uk Tom Kelsey ID5059-13-NN
Computer Vision Group Prof. Daniel Cremers. 8. Boosting and Bagging
Prof. Daniel Cremers 8. Boosting and Bagging Repetition: Regression We start with a set of basis functions (x) =( 0 (x), 1(x),..., M 1(x)) x 2 í d The goal is to fit a model into the data y(x, w) =w T
Knowledge Discovery and Data Mining
Knowledge Discovery and Data Mining Lecture 13 - Neural Nets Tom Kelsey School of Computer Science University of St Andrews http://tom.home.cs.st-andrews.ac.uk twk@st-andrews.ac.uk Tom Kelsey ID5059-13-NN
Network Traffic Measurements and Analysis
DEIB - Politecnico di Milano Fall, 2017 Sources Hastie, Tibshirani, Friedman: The Elements of Statistical Learning James, Witten, Hastie, Tibshirani: An Introduction to Statistical Learning Andrew Ng:
ECG782: Multidimensional Digital Signal Processing
ECG782: Multidimensional Digital Signal Processing Object Recognition http://www.ee.unlv.edu/~b1morris/ecg782/ 2 Outline Knowledge Representation Statistical Pattern Recognition Neural Networks Boosting
Installation Guide. Tivoli Decision Support 2.0
Installation Guide Tivoli Decision Support 2.0 Tivoli Decision Support 2.0 Installation Guide (August, 1998) Copyright 1998 by Tivoli Systems, an IBM Company, including this documentation and all software.
GETTING STARTED WITH DATA MINING
GETTING STARTED WITH DATA MINING Nora Galambos, PhD Senior Data Scientist Office of Institutional Research, Planning & Effectiveness Stony Brook University AIR Forum 2017 Washington, D.C. 1 Using Data
A study of classification algorithms using Rapidminer
Volume 119 No. 12 2018, 15977-15988 ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu A study of classification algorithms using Rapidminer Dr.J.Arunadevi 1, S.Ramya 2, M.Ramesh Raja
Machine Learning in Action
Machine Learning in Action PETER HARRINGTON Ill MANNING Shelter Island brief contents PART l (~tj\ssification...,... 1 1 Machine learning basics 3 2 Classifying with k-nearest Neighbors 18 3 Splitting
VERSION EIGHT PRODUCT PROFILE. Be a better auditor. You have the knowledge. We have the tools.
VERSION EIGHT PRODUCT PROFILE Be a better auditor. You have the knowledge. We have the tools. Improve your audit results and extend your capabilities with IDEA's powerful functionality. With IDEA, you
Data Mining. Lab Exercises
Data Mining Lab Exercises Predictive Modelling Purpose The purpose of this study is to learn how data mining methods / tools (SAS System/ SAS Enterprise Miner) can be used to solve predictive modeling
Overview and Practical Application of Machine Learning in Pricing
Overview and Practical Application of Machine Learning in Pricing 2017 CAS Spring Meeting May 23, 2017 Duncan Anderson and Claudine Modlin (Willis Towers Watson) Mark Richards (Allstate Insurance Company)
Programme Outcome COURSE OUTCOMES MCA
Programme Outcome PO1: To provide trained human resource for the IT industry. COURSE OUTCOMES MCA MCA 101 : Object Oriented Programming CO1 The students develops a sound approach to problem solving using
8. MINITAB COMMANDS WEEK-BY-WEEK
8. MINITAB COMMANDS WEEK-BY-WEEK In this section of the Study Guide, we give brief information about the Minitab commands that are needed to apply the statistical methods in each week s study. They are
Table Of Contents: xix Foreword to Second Edition
Data Mining : Concepts and Techniques Table Of Contents: Foreword xix Foreword to Second Edition xxi Preface xxiii Acknowledgments xxxi About the Authors xxxv Chapter 1 Introduction 1 (38) 1.1 Why Data
FINANCIAL ANALYSIS MADE EASY (FAME) Workbook
FINANCIAL ANALYSIS MADE EASY (FAME) Workbook Finding a specific company report... 2 Finding companies matching two or more criteria (location & industry)... 3 Company lists : selecting order of results
Semi-supervised learning and active learning
Semi-supervised learning and active learning Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Combining classifiers Ensemble learning: a machine learning paradigm where multiple learners
Nonparametric Classification Methods
Nonparametric Classification Methods We now examine some modern, computationally intensive methods for regression and classification. Recall that the LDA approach constructs a line (or plane or hyperplane)
Interpretation and evaluation
Interpretation and evaluation 1. Descriptive tasks Evaluation based on novelty, interestingness, usefulness and understandability Qualitative evaluation: obvious (common sense) knowledge knowledge that
Information Management course
Università degli Studi di Milano Master Degree in Computer Science Information Management course Teacher: Alberto Ceselli Lecture 20: 10/12/2015 Data Mining: Concepts and Techniques (3 rd ed.) Chapter
CS 8520: Artificial Intelligence. Machine Learning 2. Paula Matuszek Fall, CSC 8520 Fall Paula Matuszek
CS 8520: Artificial Intelligence Machine Learning 2 Paula Matuszek Fall, 2015!1 Regression Classifiers We said earlier that the task of a supervised learning system can be viewed as learning a function
6.034 Quiz 2, Spring 2005
6.034 Quiz 2, Spring 2005 Open Book, Open Notes Name: Problem 1 (13 pts) 2 (8 pts) 3 (7 pts) 4 (9 pts) 5 (8 pts) 6 (16 pts) 7 (15 pts) 8 (12 pts) 9 (12 pts) Total (100 pts) Score 1 1 Decision Trees (13
SAS (Statistical Analysis Software/System)
SAS (Statistical Analysis Software/System) SAS Adv. Analytics or Predictive Modelling:- Class Room: Training Fee & Duration : 30K & 3 Months Online Training Fee & Duration : 33K & 3 Months Learning SAS:
BIOINF 585: Machine Learning for Systems Biology & Clinical Informatics
BIOINF 585: Machine Learning for Systems Biology & Clinical Informatics Lecture 12: Ensemble Learning I Jie Wang Department of Computational Medicine & Bioinformatics University of Michigan 1 Outline Bias
1 Dulcian, Inc., 2001 All rights reserved. Oracle9i Data Warehouse Review. Agenda
Agenda Oracle9i Warehouse Review Dulcian, Inc. Oracle9i Server OLAP Server Analytical SQL Mining ETL Infrastructure 9i Warehouse Builder Oracle 9i Server Overview E-Business Intelligence Platform 9i Server:
STA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 12 Combining
The Curse of Dimensionality
The Curse of Dimensionality ACAS 2002 p1/66 Curse of Dimensionality The basic idea of the curse of dimensionality is that high dimensional data is difficult to work with for several reasons: Adding more
Neural Networks and Deep Learning
Neural Networks and Deep Learning Example Learning Problem Example Learning Problem Celebrity Faces in the Wild Machine Learning Pipeline Raw data Feature extract. Feature computation Inference: prediction,
Data Mining: Exploring Data
Data Mining: Exploring Data Lecture Notes for Chapter 3 Introduction to Data Mining by Tan, Steinbach, Kumar But we start with a brief discussion of the Friedman article and the relationship between Data
Recitation Supplement: Creating a Neural Network for Classification SAS EM December 2, 2002
Recitation Supplement: Creating a Neural Network for Classification SAS EM December 2, 2002 Introduction Neural networks are flexible nonlinear models that can be used for regression and classification
MSA220 - Statistical Learning for Big Data
MSA220 - Statistical Learning for Big Data Lecture 13 Rebecka Jörnsten Mathematical Sciences University of Gothenburg and Chalmers University of Technology Clustering Explorative analysis - finding groups
Assignment 1: CS Machine Learning
Assignment 1: CS7641 - Machine Learning Saad Khan September 18, 2015 1 Introduction I intend to apply supervised learning algorithms to classify the quality of wine samples as being of high or low quality
Introduction to Support Vector Machines
Introduction to Support Vector Machines CS 536: Machine Learning Littman (Wu, TA) Administration Slides borrowed from Martin Law (from the web). 1 Outline History of support vector machines (SVM) Two classes,
Support Vector Machines
Support Vector Machines RBF-networks Support Vector Machines Good Decision Boundary Optimization Problem Soft margin Hyperplane Non-linear Decision Boundary Kernel-Trick Approximation Accurancy Overtraining
Data Mining Overview. CHAPTER 1 Introduction to SAS Enterprise Miner Software
1 CHAPTER 1 Introduction to SAS Enterprise Miner Software Data Mining Overview 1 Layout of the SAS Enterprise Miner Window 2 Using the Application Main Menus 3 Using the Toolbox 8 Using the Pop-Up Menus
Introduction to ANSYS DesignXplorer
Lecture 4 14. 5 Release Introduction to ANSYS DesignXplorer 1 2013 ANSYS, Inc. September 27, 2013 s are functions of different nature where the output parameters are described in terms of the input parameters
Introduction to Data Science. Introduction to Data Science with Python. Python Basics: Basic Syntax, Data Structures. Python Concepts (Core)
Introduction to Data Science What is Analytics and Data Science? Overview of Data Science and Analytics Why Analytics is is becoming popular now? Application of Analytics in business Analytics Vs Data
COMPUTATIONAL INTELLIGENCE SEW (INTRODUCTION TO MACHINE LEARNING) SS18. Lecture 6: k-nn Cross-validation Regularization
COMPUTATIONAL INTELLIGENCE SEW (INTRODUCTION TO MACHINE LEARNING) SS18 Lecture 6: k-nn Cross-validation Regularization LEARNING METHODS Lazy vs eager learning Eager learning generalizes training data before
What is Data Mining? Data Mining. Data Mining Architecture. Illustrative Applications. Pharmaceutical Industry. Pharmaceutical Industry
Data Mining Andrew Kusiak Intelligent Systems Laboratory 2139 Seamans Center The University of Iowa Iowa City, IA 52242-1527 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak Tel. 319-335 5934
Data Mining. Lesson 9 Support Vector Machines. MSc in Computer Science University of New York Tirana Assoc. Prof. Dr.
Data Mining Lesson 9 Support Vector Machines MSc in Computer Science University of New York Tirana Assoc. Prof. Dr. Marenglen Biba Data Mining: Content Introduction to data mining and machine learning
Instance-based Learning
Instance-based Learning Machine Learning 10701/15781 Carlos Guestrin Carnegie Mellon University October 15 th, 2007 2005-2007 Carlos Guestrin 1 1-Nearest Neighbor Four things make a memory based learner:
SAP InfiniteInsight 7.0 Modeler - Association Rules Getting Started Guide
End User Documentation Document Version: 1.0 2014-11 CUSTOMER SAP InfiniteInsight 7.0 Modeler - Association Rules Getting Started Guide Table of Contents Table of Contents About this Document... 4 Who
CS 8520: Artificial Intelligence
CS 8520: Artificial Intelligence Machine Learning 2 Paula Matuszek Spring, 2013 1 Regression Classifiers We said earlier that the task of a supervised learning system can be viewed as learning a function
Classification Lecture Notes cse352. Neural Networks. Professor Anita Wasilewska
Classification Lecture Notes cse352 Neural Networks Professor Anita Wasilewska Neural Networks Classification Introduction INPUT: classification data, i.e. it contains an classification (class) attribute
DM6 Support Vector Machines
DM6 Support Vector Machines Outline Large margin linear classifier Linear separable Nonlinear separable Creating nonlinear classifiers: kernel trick Discussion on SVM Conclusion SVM: LARGE MARGIN LINEAR
Feature Selection Technique to Improve Performance Prediction in a Wafer Fabrication Process
Feature Selection Technique to Improve Performance Prediction in a Wafer Fabrication Process KITTISAK KERDPRASOP and NITTAYA KERDPRASOP Data Engineering Research Unit, School of Computer Engineering, Suranaree
Event: PASS SQL Saturday - DC 2018 Presenter: Jon Tupitza, CTO Architect
Event: PASS SQL Saturday - DC 2018 Presenter: Jon Tupitza, CTO Architect BEOP.CTO.TP4 Owner: OCTO Revision: 0001 Approved by: JAT Effective: 08/30/2018 Buchanan & Edwards Proprietary: Printed copies of
Logical Rhythm - Class 3. August 27, 2018
Logical Rhythm - Class 3 August 27, 2018 In this Class Neural Networks (Intro To Deep Learning) Decision Trees Ensemble Methods(Random Forest) Hyperparameter Optimisation and Bias Variance Tradeoff Biological
Part I: Data Mining Foundations
Table of Contents 1. Introduction 1 1.1. What is the World Wide Web? 1 1.2. A Brief History of the Web and the Internet 2 1.3. Web Data Mining 4 1.3.1. What is Data Mining? 6 1.3.2. What is Web Mining?
Machine Learning Duncan Anderson Managing Director, Willis Towers Watson
Machine Learning Duncan Anderson Managing Director, Willis Towers Watson 21 March 2018 GIRO 2016, Dublin - Response to machine learning Don t panic! We re doomed! 2 This is not all new Actuaries adopt
EZY Intellect Pte. Ltd., #1 Changi North Street 1, Singapore
Tableau in Business Intelligence Duration: 6 Days Tableau Desktop Tableau Introduction Tableau Introduction. Overview of Tableau workbook, worksheets. Dimension & Measures Discrete and Continuous Install
CSC411 Fall 2014 Machine Learning & Data Mining. Ensemble Methods. Slides by Rich Zemel
CSC411 Fall 2014 Machine Learning & Data Mining Ensemble Methods Slides by Rich Zemel Ensemble methods Typical application: classi.ication Ensemble of classi.iers is a set of classi.iers whose individual
SAS IT Resource Management 3.8: Reporting Guide
SAS IT Resource Management 3.8: Reporting Guide SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2017. SAS IT Resource Management 3.8: Reporting Guide.
Object recognition (part 1)
Recognition Object recognition (part 1) CSE P 576 Larry Zitnick (larryz@microsoft.com) The Margaret Thatcher Illusion, by Peter Thompson Readings Szeliski Chapter 14 Recognition What do we mean by object
Cyber attack detection using decision tree approach
Cyber attack detection using decision tree approach Amit Shinde Department of Industrial Engineering, Arizona State University,Tempe, AZ, USA {amit.shinde@asu.edu} In this information age, information
Lecture 7: Decision Trees
Lecture 7: Decision Trees Instructor: Outline 1 Geometric Perspective of Classification 2 Decision Trees Geometric Perspective of Classification Perspective of Classification Algorithmic Geometric Probabilistic...
An Empirical Comparison of Ensemble Methods Based on Classification Trees. Mounir Hamza and Denis Larocque. Department of Quantitative Methods
An Empirical Comparison of Ensemble Methods Based on Classification Trees Mounir Hamza and Denis Larocque Department of Quantitative Methods HEC Montreal Canada Mounir Hamza and Denis Larocque 1 June 2005
Enterprise Data Catalog for Microsoft Azure Tutorial
Enterprise Data Catalog for Microsoft Azure Tutorial VERSION 10.2 JANUARY 2018 Page 1 of 45 Contents Tutorial Objectives... 4 Enterprise Data Catalog Overview... 5 Overview... 5 Objectives... 5 Enterprise
JMP Book Descriptions
JMP Book Descriptions The collection of JMP documentation is available in the JMP Help > Books menu. This document describes each title to help you decide which book to explore. Each book title is linked
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models DB Tsai Steven Hillion Outline Introduction Linear / Nonlinear Classification Feature Engineering - Polynomial Expansion Big-data
Statistical graphics in analysis Multivariable data in PCP & scatter plot matrix. Paula Ahonen-Rainio Maa Visual Analysis in GIS
Statistical graphics in analysis Multivariable data in PCP & scatter plot matrix Paula Ahonen-Rainio Maa-123.3530 Visual Analysis in GIS 11.11.2015 Topics today YOUR REPORTS OF A-2 Thematic maps with charts
Introduction p. 1 What is the World Wide Web? p. 1 A Brief History of the Web and the Internet p. 2 Web Data Mining p. 4 What is Data Mining? p.
Introduction p. 1 What is the World Wide Web? p. 1 A Brief History of the Web and the Internet p. 2 Web Data Mining p. 4 What is Data Mining? p. 6 What is Web Mining? p. 6 Summary of Chapters p. 8 How
SAS ODBC Driver. Overview: SAS ODBC Driver. What Is ODBC? CHAPTER 1
1 CHAPTER 1 SAS ODBC Driver Overview: SAS ODBC Driver 1 What Is ODBC? 1 What Is the SAS ODBC Driver? 2 Types of Data Accessed with the SAS ODBC Driver 3 Understanding SAS 4 SAS Data Sets 4 Unicode UTF-8
Optimizing Completion Techniques with Data Mining
Optimizing Completion Techniques with Data Mining Robert Balch Martha Cather Tom Engler New Mexico Tech Data Storage capacity is growing at ~ 60% per year -- up from 30% per year in 2002. Stored data estimated
Evaluation Report on PolyAnalyst 4.6
1. INTRODUCTION CMPUT695: Assignment#2 Evaluation Report on PolyAnalyst 4.6 Hongqin Fan and Yunping Wang PolyAnalyst 4.6 professional edition (PA) is a commercial data mining tool developed by Megaputer
Feature Descriptors. CS 510 Lecture #21 April 29 th, 2013
Feature Descriptors CS 510 Lecture #21 April 29 th, 2013 Programming Assignment #4 Due two weeks from today Any questions? How is it going? Where are we? We have two umbrella schemes for object recognition
IT DATA WAREHOUSING AND DATA MINING UNIT-2 BUSINESS ANALYSIS
PART A 1. What are production reporting tools? Give examples. (May/June 2013) Production reporting tools will let companies generate regular operational reports or support high-volume batch jobs. Such
Contents. Foreword to Second Edition. Acknowledgments About the Authors
Contents Foreword xix Foreword to Second Edition xxi Preface xxiii Acknowledgments About the Authors xxxi xxxv Chapter 1 Introduction 1 1.1 Why Data Mining? 1 1.1.1 Moving toward the Information Age 1