USING QUALITY CONTROL CHARTS TO SEGMENT ROAD SURFACE CONDITION DATA

Size: px
Start display at page:

Download "USING QUALITY CONTROL CHARTS TO SEGMENT ROAD SURFACE CONDITION DATA"

Transcription

1 USING QUALITY CONTROL CHARTS TO SEGMENT ROAD SURFACE CONDITION DATA Amin El Gendy Doctoral Candidate Ahmed Shalaby Associate Professor Department of Civil Engineering University of Manitoba Winnipeg, i Manitoba, Canada

2 Outline Segmentation as a classification tool Current strategies for segmenting road surface condition pavement condition data Limitations of the current segmentation methods Fundamental concepts of quality control charts and application as a segmentation method Compare results of c-chart segmentation with previous segmentation methods

3 Introduction Many elements of road condition data are collected periodically at the network-level, for example IRI, friction, FWD, rut depth. This data drives the selection of maintenance and rehabilitation strategies and the extent of each treatment With the growth in stored data, there is a need to identify homogeneous and consistent condition-based subsections A network could be segmented dynamically into homogeneous subsections which have statistically-uniform properties using one or several condition data elements

4 Segmentation strategies Several approaches exist for classifying condition data. Four methods will be discussed: 1. Cumulative Difference Approach (CDA) 2. Absolute Difference Approach (ADA) 3. Classification and Regression Trees (CART) 4. Quality Control Charts (C-Chart) Important to note that there is no unique or final solution. Solutions are recursive and adaptable. Additional criteria are required to terminate the process.

5 The cumulative difference approach (CDA) Pavement Re esponse, r i r 1 r 2 r 3 X (a) Response Cumula ative Area, A x Z x Cumulativ ve Difference, Z A _ x A x X 1 X 2 X 3 (a) Z _ x X 1 XX 2 X 3 (b) (+) x = Ax A + Border - (-) X 1 Border (c) X 2 (-) X3 X X (b) Cumulative Area (c) Cumulative Differences

6 The absolute difference approach (ADA) Response range Average response Segment length r d Z i = r i r d r i x i x d X The absolute difference approach

7 Classification and regression trees (CART) Each data set is divided into two homogeneous subsections by locating the position where the sum of the squared differences between the data in each segment and the corresponding mean of each segment is minimized. r Segmenting location Exhaustive search for dividing the data set into two homogeneous subsections X

8 Classification and regression trees (CART) The procedure is applied recursively to each segment until a maximum number of segments or a minimum i segment length is reached. Step 1 r Step 2 Step 3 Regression tree for eight delineated sections X

9 Control chart approach (C-Chart) Response Upper control limit, UCL Upper warning limit, UWL Response Lower warning limit, LWL Lower control limit, LCL +kσ = +3σ +2σ µ -2σ -kσ =- 3σ ibution bability Distri Normal Pro 95.4% % Observation number Typical control chart showing warning limits (±2σ) and control limits (±3σ)

10 General model for control chart The centreline CL, the upper control limit UCL, and the lower control limit LCL are: UCL = µ + kσ CL = µ LCL = µ kσ where k is the distance of the control limit from the centreline expressed in standard deviation unit. The outer limits are usually at 3σ and the inner limits The outer limits are usually at 3σ and the inner limits, usually at 2σ

11 Estimating mean and standard deviation from segment data Mean and st. deviation are estimated from segment data Must be recalculated with the addition of each data point to the segment Estimate of mean µˆ = r µˆ r = estimate of mean for current segment = average of responses in current segment Estimate of variance n 2 i= 1 ˆ σ r i = response value ˆ r 2 i nr = = n 1 2 σ = estimate of variance for current segment n = number of response points (i) in current segment 2

12 Modifying c-chart control limits using response range St. deviation of a segment can be too large for practical applications Control limits can be assigned to not exceed a desired (practical) target range: UCL = µˆ µ + c LCL = µ ˆµ c c is the minimum of the 3 σˆ in the segment and 0.5 r range

13 C-chart delineation algorithm 1. Proceed from the fifth data sample from the start of the segment to allow for a reasonable initial estimate of the statistical parameters 2. On adding each new data sample, the estimated mean and variance of the segment are calculated based on data from start of segment up to the tested sample. 3. The lower of 3 σˆ and 0.5 r range are used to establish and update the control limits. 4. A new segment is started when the tested data sample falls outside the control limits. 5. The process continues until all profile data is segmented

14 Segmentation using c-chart approach Segment border r i Response, r Pavement UCL 2 UCL 1 µ 2 +c 1 µ -c 2 1 LCL 2 -c LCL1 1 Segment 1 Segment 2 +c 2 Identification of homogeneous segments using c-chart approach Km -post

15 Comparison of segmentation methods Segmentation Method Characteristic Segmentation Criterion Minimum number of segments Final number of segments Segment range CDA Diversion from Two Unlimited Not specified mean of entire profile ADA Target range One Unlimited Predetermined CART Minimum sum of Two Predetermined Unlimited squared error C-Chart Standard One Unlimited Optional deviation

16 The AASHTO Example FN(40) km-post Segment borders 2σ C-Chart 20 3σ C-Chart 15 CDA 10 CART Highway km-post Delineating a Friction Number profile using various methods

17 The sum of squared errors (SSE) Comparison of sum of squared errors (SSE) using three segmentation methods Segmentation Method SSE [FN(40)] Number of subsections CDA CART σ C-Chart σ C-Chart

18 Joining of adjacent segments If two adjacent segments have similar statistical properties, joining should be examined. Joining is performed if the resulting (joined) segment is considered uniform. r Similar statistical properties Minimum segment length r Original segmentation X Joining adjacent segments X

19 Joining of adjacent segments Profile FN(40) km-post Segment borders 2σ C-Chart Response Range % Highway km-post Joining of adjacent segments generated by 2σ c-chart method using various response ranges

20 Joining of adjacent segments SSE Number of Segments SSE [F FN(40)] Response Range % Segments Number of Relationship of sum of squared errors (SSE) and number of joined segments to response range

21 Limitations No clear winner. Selection of a segmentation method should be based on the type of data and the quality of information to be extracted. No unique or perfect answer. The lowest SEE is when each segment contains exactly one sample and the mean of the entire section is not affected by segmentation. Process can be nearsighted if it cannot recognize brief disturbances It is important to strike a balance between approximation It is important to strike a balance between approximation of a condition in a uniform subsection and the details provided by higher resolution data.

22 Conclusions and recommendations Segmentation allows for the extraction of uniform homogeneous sections. Several available methods for segmenting road condition data are presented. C-chart can be employed as a segmentation ti tool and selecting a practical target range provides additional control over the solution. The AASHTO example was used to demonstrate the various methods.

23 Conclusions and recommendations The main advantage of the c-chart approach is that it is an autonomous process that does not require prior knowledge of the statistical characteristics of the data. If the characteristics of data are known, additional criteria such as target range can be incorporated to improve the segmentation Segmentation tools and criteria should be tuned to achieve g the desired solution

24 Thank You

Canadian Journal of Civil Engineering. Another Look at Delineation of Uniform Pavement Sections Based on FWD Deflections Data

Canadian Journal of Civil Engineering. Another Look at Delineation of Uniform Pavement Sections Based on FWD Deflections Data Another Look at Delineation of Uniform Pavement Sections Based on FWD Deflections Data Journal: Manuscript ID cjce-2015-0281.r1 Manuscript Type: Article Date Submitted by the Author: 18-Sep-2015 Complete

More information

An Approach To ANOM Chart. Muhammad Riaz

An Approach To ANOM Chart. Muhammad Riaz An Approach To ANOM Chart Muhammad Riaz Department of tatistics, Quaid-i-Azam University, Islamabad, Pakistan E-mail: riaz76qau@yahoo.com Abstract The study proposes a scheme for the structure of Analysis

More information

Decision Trees Dr. G. Bharadwaja Kumar VIT Chennai

Decision Trees Dr. G. Bharadwaja Kumar VIT Chennai Decision Trees Decision Tree Decision Trees (DTs) are a nonparametric supervised learning method used for classification and regression. The goal is to create a model that predicts the value of a target

More information

REGION BASED SEGEMENTATION

REGION BASED SEGEMENTATION REGION BASED SEGEMENTATION The objective of Segmentation is to partition an image into regions. The region-based segmentation techniques find the regions directly. Extract those regions in the image whose

More information

Introduction Texture/Friction Measurement at Winnipeg International Airport Data Analysis Conclusions

Introduction Texture/Friction Measurement at Winnipeg International Airport Data Analysis Conclusions Texture/Friction Measurements and Analysis at Runway 13-31 of James Armstrong Richardson International Airport in Winnipeg Qingfan Liu, EIT, PhD candidate, University of Manitoba Ahmed Shalaby, PhD, P.

More information

NCSS Statistical Software

NCSS Statistical Software Chapter 245 Introduction This procedure generates R control charts for variables. The format of the control charts is fully customizable. The data for the subgroups can be in a single column or in multiple

More information

SD 372 Pattern Recognition

SD 372 Pattern Recognition SD 372 Pattern Recognition Lab 2: Model Estimation and Discriminant Functions 1 Purpose This lab examines the areas of statistical model estimation and classifier aggregation. Model estimation will be

More information

AC : DETERMINING PROCESS CAPABILITY OF AN INDUSTRIAL PROCESS IN LABORATORY USING COMPUTER AIDED HARDWARE AND SOFTWARE TOOLS

AC : DETERMINING PROCESS CAPABILITY OF AN INDUSTRIAL PROCESS IN LABORATORY USING COMPUTER AIDED HARDWARE AND SOFTWARE TOOLS AC 007-150: DETERMINING PROCESS CAPABILITY OF AN INDUSTRIAL PROCESS IN LABORATORY USING COMPUTER AIDED HARDWARE AND SOFTWARE TOOLS Akram Hossain, Purdue University-Calumet Akram Hossain is a professor

More information

Multi-Speed Deflectometer. An innovative tool for local authority network asset management

Multi-Speed Deflectometer. An innovative tool for local authority network asset management Multi-Speed Deflectometer An innovative tool for local authority network asset management What is the MSD? Falling Weight Deflectometer The Multi-Speed Deflectometer (MSD) is a new, innovative technique

More information

1.4.3 OPERATING SPEED CONSISTENCY

1.4.3 OPERATING SPEED CONSISTENCY Geometric Design Guide for Canadian oads 1.4.3 OPEATING SPEED CONSISTENCY The safety of a road is closely linked to variations in the speed of vehicles travelling on it. These variations are of two kinds:

More information

DESIGN OF EXPERIMENTS and ROBUST DESIGN

DESIGN OF EXPERIMENTS and ROBUST DESIGN DESIGN OF EXPERIMENTS and ROBUST DESIGN Problems in design and production environments often require experiments to find a solution. Design of experiments are a collection of statistical methods that,

More information

Exercise: Graphing and Least Squares Fitting in Quattro Pro

Exercise: Graphing and Least Squares Fitting in Quattro Pro Chapter 5 Exercise: Graphing and Least Squares Fitting in Quattro Pro 5.1 Purpose The purpose of this experiment is to become familiar with using Quattro Pro to produce graphs and analyze graphical data.

More information

Quality Control-2 The ASTA team

Quality Control-2 The ASTA team Quality Control-2 The ASTA team Contents 0.1 OC curves............................................... 1 0.2 OC curves - example......................................... 2 0.3 CUSUM chart.............................................

More information

Processing and Others. Xiaojun Qi -- REU Site Program in CVMA

Processing and Others. Xiaojun Qi -- REU Site Program in CVMA Advanced Digital Image Processing and Others Xiaojun Qi -- REU Site Program in CVMA (0 Summer) Segmentation Outline Strategies and Data Structures Overview of Algorithms Region Splitting Region Merging

More information

Measures of Dispersion

Measures of Dispersion Measures of Dispersion 6-3 I Will... Find measures of dispersion of sets of data. Find standard deviation and analyze normal distribution. Day 1: Dispersion Vocabulary Measures of Variation (Dispersion

More information

Before You Dig Partners

Before You Dig Partners Before You Dig Partners Sign Up for Our Webinar Series One Call Mapping System Western Canada s One-Call partners are switching to a new one-call system on January 11, 2019. This new software simplifies

More information

Object-Based Classification & ecognition. Zutao Ouyang 11/17/2015

Object-Based Classification & ecognition. Zutao Ouyang 11/17/2015 Object-Based Classification & ecognition Zutao Ouyang 11/17/2015 What is Object-Based Classification The object based image analysis approach delineates segments of homogeneous image areas (i.e., objects)

More information

CS 229 Midterm Review

CS 229 Midterm Review CS 229 Midterm Review Course Staff Fall 2018 11/2/2018 Outline Today: SVMs Kernels Tree Ensembles EM Algorithm / Mixture Models [ Focus on building intuition, less so on solving specific problems. Ask

More information

A Method for Comparing Multiple Regression Models

A Method for Comparing Multiple Regression Models CSIS Discussion Paper No. 141 A Method for Comparing Multiple Regression Models Yuki Hiruta Yasushi Asami Department of Urban Engineering, the University of Tokyo e-mail: hiruta@ua.t.u-tokyo.ac.jp asami@csis.u-tokyo.ac.jp

More information

Equivalence Tests for Two Means in a 2x2 Cross-Over Design using Differences

Equivalence Tests for Two Means in a 2x2 Cross-Over Design using Differences Chapter 520 Equivalence Tests for Two Means in a 2x2 Cross-Over Design using Differences Introduction This procedure calculates power and sample size of statistical tests of equivalence of the means of

More information

Math 227 EXCEL / MEGASTAT Guide

Math 227 EXCEL / MEGASTAT Guide Math 227 EXCEL / MEGASTAT Guide Introduction Introduction: Ch2: Frequency Distributions and Graphs Construct Frequency Distributions and various types of graphs: Histograms, Polygons, Pie Charts, Stem-and-Leaf

More information

Packet Sampling for Flow Accounting: Challenges and Limitations

Packet Sampling for Flow Accounting: Challenges and Limitations Packet Sampling for Flow Accounting: Challenges and Limitations Tanja Zseby (Fraunhofer FOKUS) Thomas Hirsch (Fraunhofer FOKUS) Benoit Claise (Cisco Systems) April 29, 2008 This work was funded by Cisco

More information

DI TRANSFORM. The regressive analyses. identify relationships

DI TRANSFORM. The regressive analyses. identify relationships July 2, 2015 DI TRANSFORM MVstats TM Algorithm Overview Summary The DI Transform Multivariate Statistics (MVstats TM ) package includes five algorithm options that operate on most types of geologic, geophysical,

More information

Data Mining. Part 2. Data Understanding and Preparation. 2.4 Data Transformation. Spring Instructor: Dr. Masoud Yaghini. Data Transformation

Data Mining. Part 2. Data Understanding and Preparation. 2.4 Data Transformation. Spring Instructor: Dr. Masoud Yaghini. Data Transformation Data Mining Part 2. Data Understanding and Preparation 2.4 Spring 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Normalization Attribute Construction Aggregation Attribute Subset Selection Discretization

More information

DIGITAL IMAGE ANALYSIS. Image Classification: Object-based Classification

DIGITAL IMAGE ANALYSIS. Image Classification: Object-based Classification DIGITAL IMAGE ANALYSIS Image Classification: Object-based Classification Image classification Quantitative analysis used to automate the identification of features Spectral pattern recognition Unsupervised

More information

Classification and Regression Trees

Classification and Regression Trees Classification and Regression Trees Matthew S. Shotwell, Ph.D. Department of Biostatistics Vanderbilt University School of Medicine Nashville, TN, USA March 16, 2018 Introduction trees partition feature

More information

Assignment 4/5 Statistics Due: Nov. 29

Assignment 4/5 Statistics Due: Nov. 29 Assignment 4/5 Statistics 5.301 Due: Nov. 29 1. Two decision rules are given here. Assume they apply to a normally distributed quality characteristic, the control chart has three-sigma control limits,

More information

Aggregate Blending Model for Hot Mix Asphalt Using Linear Optimization. Khaled A. Kandil and Al-Sayed A. Al-Sobky

Aggregate Blending Model for Hot Mix Asphalt Using Linear Optimization. Khaled A. Kandil and Al-Sayed A. Al-Sobky Aggregate Blending Model for Hot Mix Asphalt Using Linear Optimization Khaled A. Kandil and Al-Sayed A. Al-Sobky Public Works Department, Faculty of Engineering, Ain Shams University, Cairo, Egypt k_kandil@hotmail.com

More information

Outline. The History of Histograms. Yannis Ioannidis University of Athens, Hellas

Outline. The History of Histograms. Yannis Ioannidis University of Athens, Hellas The History of Histograms Yannis Ioannidis University of Athens, Hellas Outline Prehistory Definitions and Framework The Early Past 10 Years Ago The Recent Past Industry Competitors The Future Prehistory

More information

DEVELOPMENT OF A PROCEDURE FOR ROUTE SEGMENTATION USING PREDICTED LAYER THICKNESSES FROM RADAR MEASUREMENTS

DEVELOPMENT OF A PROCEDURE FOR ROUTE SEGMENTATION USING PREDICTED LAYER THICKNESSES FROM RADAR MEASUREMENTS DEVELOPMENT OF A PROCEDURE FOR ROUTE SEGMENTATION USING PREDICTED LAYER THICKNESSES FROM RADAR MEASUREMENTS FLORIDA DOT STATE PROJECT 99700-7550, PHASE 2A FINAL REPORT PREPARED BY: EMMANUEL G. FERNANDO,

More information

Cpk: What is its Capability? By: Rick Haynes, Master Black Belt Smarter Solutions, Inc.

Cpk: What is its Capability? By: Rick Haynes, Master Black Belt Smarter Solutions, Inc. C: What is its Capability? By: Rick Haynes, Master Black Belt Smarter Solutions, Inc. C is one of many capability metrics that are available. When capability metrics are used, organizations typically provide

More information

Will Monroe July 21, with materials by Mehran Sahami and Chris Piech. Joint Distributions

Will Monroe July 21, with materials by Mehran Sahami and Chris Piech. Joint Distributions Will Monroe July 1, 017 with materials by Mehran Sahami and Chris Piech Joint Distributions Review: Normal random variable An normal (= Gaussian) random variable is a good approximation to many other distributions.

More information

14.2 The Regression Equation

14.2 The Regression Equation 14.2 The Regression Equation Tom Lewis Fall Term 2009 Tom Lewis () 14.2 The Regression Equation Fall Term 2009 1 / 12 Outline 1 Exact and inexact linear relationships 2 Fitting lines to data 3 Formulas

More information

Statistical Detection of QoS Violations Based on CUSUM Control Charts

Statistical Detection of QoS Violations Based on CUSUM Control Charts Statistical Detection of QoS Violations Based on CUSUM Control Charts Ayman Amin Faculty of Information and Communication Technologies Swinburne University of Technology Hawthorn, VIC 3122, Australia aabdellah@swin.edu.au

More information

Motion estimation for video compression

Motion estimation for video compression Motion estimation for video compression Blockmatching Search strategies for block matching Block comparison speedups Hierarchical blockmatching Sub-pixel accuracy Motion estimation no. 1 Block-matching

More information

ECG782: Multidimensional Digital Signal Processing

ECG782: Multidimensional Digital Signal Processing Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu ECG782: Multidimensional Digital Signal Processing Spring 2014 TTh 14:30-15:45 CBC C313 Lecture 10 Segmentation 14/02/27 http://www.ee.unlv.edu/~b1morris/ecg782/

More information

Lazy Decision Trees Ronny Kohavi

Lazy Decision Trees Ronny Kohavi Lazy Decision Trees Ronny Kohavi Data Mining and Visualization Group Silicon Graphics, Inc. Joint work with Jerry Friedman and Yeogirl Yun Stanford University Motivation: Average Impurity = / interesting

More information

The problem we have now is called variable selection or perhaps model selection. There are several objectives.

The problem we have now is called variable selection or perhaps model selection. There are several objectives. STAT-UB.0103 NOTES for Wednesday 01.APR.04 One of the clues on the library data comes through the VIF values. These VIFs tell you to what extent a predictor is linearly dependent on other predictors. We

More information

Machine Learning. Supervised Learning. Manfred Huber

Machine Learning. Supervised Learning. Manfred Huber Machine Learning Supervised Learning Manfred Huber 2015 1 Supervised Learning Supervised learning is learning where the training data contains the target output of the learning system. Training data D

More information

ALTERNATIVE METHODS FOR CLUSTERING

ALTERNATIVE METHODS FOR CLUSTERING ALTERNATIVE METHODS FOR CLUSTERING K-Means Algorithm Termination conditions Several possibilities, e.g., A fixed number of iterations Objects partition unchanged Centroid positions don t change Convergence

More information

Informed/Heuristic Search

Informed/Heuristic Search Informed/Heuristic Search Outline Limitations of uninformed search methods Informed (or heuristic) search uses problem-specific heuristics to improve efficiency Best-first A* Techniques for generating

More information

Lecture 18 Representation and description I. 2. Boundary descriptors

Lecture 18 Representation and description I. 2. Boundary descriptors Lecture 18 Representation and description I 1. Boundary representation 2. Boundary descriptors What is representation What is representation After segmentation, we obtain binary image with interested regions

More information

Part One of this article (1) introduced the concept

Part One of this article (1) introduced the concept Establishing Acceptance Limits for Uniformity of Dosage Units: Part Two Pramote Cholayudth The concept of sampling distribution of acceptance value (AV) was introduced in Part One of this article series.

More information

STATS PAD USER MANUAL

STATS PAD USER MANUAL STATS PAD USER MANUAL For Version 2.0 Manual Version 2.0 1 Table of Contents Basic Navigation! 3 Settings! 7 Entering Data! 7 Sharing Data! 8 Managing Files! 10 Running Tests! 11 Interpreting Output! 11

More information

I211: Information infrastructure II

I211: Information infrastructure II Data Mining: Classifier Evaluation I211: Information infrastructure II 3-nearest neighbor labeled data find class labels for the 4 data points 1 0 0 6 0 0 0 5 17 1.7 1 1 4 1 7.1 1 1 1 0.4 1 2 1 3.0 0 0.1

More information

2.3. Quality Assurance: The activities that have to do with making sure that the quality of a product is what it should be.

2.3. Quality Assurance: The activities that have to do with making sure that the quality of a product is what it should be. 5.2. QUALITY CONTROL /QUALITY ASSURANCE 5.2.1. STATISTICS 1. ACKNOWLEDGEMENT This paper has been copied directly from the HMA Manual with a few modifications from the original version. The original version

More information

A Systematic Overview of Data Mining Algorithms

A Systematic Overview of Data Mining Algorithms A Systematic Overview of Data Mining Algorithms 1 Data Mining Algorithm A well-defined procedure that takes data as input and produces output as models or patterns well-defined: precisely encoded as a

More information

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition Pattern Recognition Kjell Elenius Speech, Music and Hearing KTH March 29, 2007 Speech recognition 2007 1 Ch 4. Pattern Recognition 1(3) Bayes Decision Theory Minimum-Error-Rate Decision Rules Discriminant

More information

Cluster Evaluation and Expectation Maximization! adapted from: Doug Downey and Bryan Pardo, Northwestern University

Cluster Evaluation and Expectation Maximization! adapted from: Doug Downey and Bryan Pardo, Northwestern University Cluster Evaluation and Expectation Maximization! adapted from: Doug Downey and Bryan Pardo, Northwestern University Kinds of Clustering Sequential Fast Cost Optimization Fixed number of clusters Hierarchical

More information

INF 4300 Classification III Anne Solberg The agenda today:

INF 4300 Classification III Anne Solberg The agenda today: INF 4300 Classification III Anne Solberg 28.10.15 The agenda today: More on estimating classifier accuracy Curse of dimensionality and simple feature selection knn-classification K-means clustering 28.10.15

More information

CSE 252B: Computer Vision II

CSE 252B: Computer Vision II CSE 252B: Computer Vision II Lecturer: Serge Belongie Scribes: Jeremy Pollock and Neil Alldrin LECTURE 14 Robust Feature Matching 14.1. Introduction Last lecture we learned how to find interest points

More information

Outline. CS 6776 Evolutionary Computation. Numerical Optimization. Fitness Function. ,x 2. ) = x 2 1. , x , 5.0 x 1.

Outline. CS 6776 Evolutionary Computation. Numerical Optimization. Fitness Function. ,x 2. ) = x 2 1. , x , 5.0 x 1. Outline CS 6776 Evolutionary Computation January 21, 2014 Problem modeling includes representation design and Fitness Function definition. Fitness function: Unconstrained optimization/modeling Constrained

More information

Lecture 4: Informed/Heuristic Search

Lecture 4: Informed/Heuristic Search Lecture 4: Informed/Heuristic Search Outline Limitations of uninformed search methods Informed (or heuristic) search uses problem-specific heuristics to improve efficiency Best-first A* RBFS SMA* Techniques

More information

Lecture on Modeling Tools for Clustering & Regression

Lecture on Modeling Tools for Clustering & Regression Lecture on Modeling Tools for Clustering & Regression CS 590.21 Analysis and Modeling of Brain Networks Department of Computer Science University of Crete Data Clustering Overview Organizing data into

More information

Tree-based methods for classification and regression

Tree-based methods for classification and regression Tree-based methods for classification and regression Ryan Tibshirani Data Mining: 36-462/36-662 April 11 2013 Optional reading: ISL 8.1, ESL 9.2 1 Tree-based methods Tree-based based methods for predicting

More information

5 Classifications of Accuracy and Standards

5 Classifications of Accuracy and Standards 5 Classifications of Accuracy and Standards 5.1 Classifications of Accuracy All surveys performed by Caltrans or others on all Caltrans-involved transportation improvement projects shall be classified

More information

CSE Data Mining Concepts and Techniques STATISTICAL METHODS (REGRESSION) Professor- Anita Wasilewska. Team 13

CSE Data Mining Concepts and Techniques STATISTICAL METHODS (REGRESSION) Professor- Anita Wasilewska. Team 13 CSE 634 - Data Mining Concepts and Techniques STATISTICAL METHODS Professor- Anita Wasilewska (REGRESSION) Team 13 Contents Linear Regression Logistic Regression Bias and Variance in Regression Model Fit

More information

Image Segmentation. GV12/3072 Image Processing.

Image Segmentation. GV12/3072 Image Processing. Image Segmentation 1 Recap from last time Samples not squares Sensors are not perfect Quantization hurts Questions? 2 Overview What is image segmentation? Thresholding and thresholding algorithms Performance

More information

USING IMAGES PATTERN RECOGNITION AND NEURAL NETWORKS FOR COATING QUALITY ASSESSMENT Image processing for quality assessment

USING IMAGES PATTERN RECOGNITION AND NEURAL NETWORKS FOR COATING QUALITY ASSESSMENT Image processing for quality assessment USING IMAGES PATTERN RECOGNITION AND NEURAL NETWORKS FOR COATING QUALITY ASSESSMENT Image processing for quality assessment L.-M. CHANG and Y.A. ABDELRAZIG School of Civil Engineering, Purdue University,

More information

Surface Simplification Using Quadric Error Metrics

Surface Simplification Using Quadric Error Metrics Surface Simplification Using Quadric Error Metrics Authors: Michael Garland & Paul Heckbert Presented by: Niu Xiaozhen Disclaimer: Some slides are modified from original slides, which were designed by

More information

Stat 342 Exam 3 Fall 2014

Stat 342 Exam 3 Fall 2014 Stat 34 Exam 3 Fall 04 I have neither given nor received unauthorized assistance on this exam. Name Signed Date Name Printed There are questions on the following 6 pages. Do as many of them as you can

More information

Hyperspectral Image Segmentation using Homogeneous Area Limiting and Shortest Path Algorithm

Hyperspectral Image Segmentation using Homogeneous Area Limiting and Shortest Path Algorithm Hyperspectral Image Segmentation using Homogeneous Area Limiting and Shortest Path Algorithm Fatemeh Hajiani Department of Electrical Engineering, College of Engineering, Khormuj Branch, Islamic Azad University,

More information

Traffic Sign Recognition Senior Project Proposal

Traffic Sign Recognition Senior Project Proposal Traffic Sign Recognition Senior Project Proposal Jacob Carlson and Sean St. Onge Advisor Dr. Thomas Stewart December 5 th, 2007 Abstract The Traffic Sign Recognition project aims to create a system using

More information

ASSESSMENT OF AIRFIELD RUNWAY MACROTEXTURE AND FRICTION USING THREE- DIMENSIONAL LASER-BASED MEASUREMENTS

ASSESSMENT OF AIRFIELD RUNWAY MACROTEXTURE AND FRICTION USING THREE- DIMENSIONAL LASER-BASED MEASUREMENTS 0 0 0 0 ASSESSMENT OF AIRFIELD RUNWAY MACROTEXTURE AND FRICTION USING THREE- DIMENSIONAL LASER-BASED MEASUREMENTS Qingfan Liu*, PhD, P. Eng. Research Associate Centre for Pavement and Transportation Technology

More information

Decision Tree (Continued) and K-Nearest Neighbour. Dr. Xiaowei Huang

Decision Tree (Continued) and K-Nearest Neighbour. Dr. Xiaowei Huang Decision Tree (Continued) and K-Nearest Neighbour Dr. Xiaowei Huang https://cgi.csc.liv.ac.uk/~xiaowei/ Up to now, Recap basic knowledge Decision tree learning How to split Identify the best feature to

More information

CSC 8301 Design and Analysis of Algorithms: Exhaustive Search

CSC 8301 Design and Analysis of Algorithms: Exhaustive Search CSC 8301 Design and Analysis of Algorithms: Exhaustive Search Professor Henry Carter Fall 2016 Recap Brute force is the use of iterative checking or solving a problem by its definition The straightforward

More information

D-Optimal Designs. Chapter 888. Introduction. D-Optimal Design Overview

D-Optimal Designs. Chapter 888. Introduction. D-Optimal Design Overview Chapter 888 Introduction This procedure generates D-optimal designs for multi-factor experiments with both quantitative and qualitative factors. The factors can have a mixed number of levels. For example,

More information

Estimation of Suitable Grade Value for Stopping Sight Distance Computation on Vertical Curves

Estimation of Suitable Grade Value for Stopping Sight Distance Computation on Vertical Curves Estimation of Suitable Grade Value for Stopping Sight Distance Computation on Vertical Curves Ahmed H. Farhan Assist. ecturer / Civil Eng. Dept. / Anbar University Abstract The purpose of highway geometric

More information

Chpt 3. Data Description. 3-2 Measures of Central Tendency /40

Chpt 3. Data Description. 3-2 Measures of Central Tendency /40 Chpt 3 Data Description 3-2 Measures of Central Tendency 1 /40 Chpt 3 Homework 3-2 Read pages 96-109 p109 Applying the Concepts p110 1, 8, 11, 15, 27, 33 2 /40 Chpt 3 3.2 Objectives l Summarize data using

More information

6. Tabu Search. 6.3 Minimum k-tree Problem. Fall 2010 Instructor: Dr. Masoud Yaghini

6. Tabu Search. 6.3 Minimum k-tree Problem. Fall 2010 Instructor: Dr. Masoud Yaghini 6. Tabu Search 6.3 Minimum k-tree Problem Fall 2010 Instructor: Dr. Masoud Yaghini Outline Definition Initial Solution Neighborhood Structure and Move Mechanism Tabu Structure Illustrative Tabu Structure

More information

ABSTRACT I. INTRODUCTION. Department of Computer Science, OPJS University, Churu, Rajasthan, India

ABSTRACT I. INTRODUCTION. Department of Computer Science, OPJS University, Churu, Rajasthan, India 217 IJSRST Volume 3 Issue 3 Print ISSN: 2395-611 Online ISSN: 2395-62X Themed Section: Science and Technology Testing Domain based Software Reliability Growth Models using Stochastic Differential Equation

More information

Data: a collection of numbers or facts that require further processing before they are meaningful

Data: a collection of numbers or facts that require further processing before they are meaningful Digital Image Classification Data vs. Information Data: a collection of numbers or facts that require further processing before they are meaningful Information: Derived knowledge from raw data. Something

More information

Non-Bayesian Classifiers Part I: k-nearest Neighbor Classifier and Distance Functions

Non-Bayesian Classifiers Part I: k-nearest Neighbor Classifier and Distance Functions Non-Bayesian Classifiers Part I: k-nearest Neighbor Classifier and Distance Functions Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Fall 2017 CS 551,

More information

Figure 1: Workflow of object-based classification

Figure 1: Workflow of object-based classification Technical Specifications Object Analyst Object Analyst is an add-on package for Geomatica that provides tools for segmentation, classification, and feature extraction. Object Analyst includes an all-in-one

More information

QUALITATIVE MODELING FOR MAGNETIZATION CURVE

QUALITATIVE MODELING FOR MAGNETIZATION CURVE Journal of Marine Science and Technology, Vol. 8, No. 2, pp. 65-70 (2000) 65 QUALITATIVE MODELING FOR MAGNETIZATION CURVE Pei-Hwa Huang and Yu-Shuo Chang Keywords: Magnetization curve, Qualitative modeling,

More information

Data Analysis and Solver Plugins for KSpread USER S MANUAL. Tomasz Maliszewski

Data Analysis and Solver Plugins for KSpread USER S MANUAL. Tomasz Maliszewski Data Analysis and Solver Plugins for KSpread USER S MANUAL Tomasz Maliszewski tmaliszewski@wp.pl Table of Content CHAPTER 1: INTRODUCTION... 3 1.1. ABOUT DATA ANALYSIS PLUGIN... 3 1.3. ABOUT SOLVER PLUGIN...

More information

REGION-BASED SUPER-RESOLUTION FOR COMPRESSION

REGION-BASED SUPER-RESOLUTION FOR COMPRESSION REGION-BASED SUPER-RESOLUTION FOR COMPRESSION D. Barreto 1, L.D. Alvarez 2, R. Molina 2, A.K. Katsaggelos 3 and G.M. Callicó 1 INTERNATIONAL CONFERENCE ON SUPERRESOLUTION IMAGING Theory, Algorithms and

More information

Feature Selection. Department Biosysteme Karsten Borgwardt Data Mining Course Basel Fall Semester / 262

Feature Selection. Department Biosysteme Karsten Borgwardt Data Mining Course Basel Fall Semester / 262 Feature Selection Department Biosysteme Karsten Borgwardt Data Mining Course Basel Fall Semester 2016 239 / 262 What is Feature Selection? Department Biosysteme Karsten Borgwardt Data Mining Course Basel

More information

Predicting Percentage of Intramuscular Fat Using Two Types of Real-Time Ultrasound Equipment

Predicting Percentage of Intramuscular Fat Using Two Types of Real-Time Ultrasound Equipment Predicting Percentage of Intramuscular Fat Using Two Types of Real-Time Ultrasound Equipment A. S. Leaflet R1732 Abebe Hassen, assistant scientist Doyle Wilson, professor of animal science Viren Amin,

More information

Updated Sections 3.5 and 3.6

Updated Sections 3.5 and 3.6 Addendum The authors recommend the replacement of Sections 3.5 3.6 and Table 3.15 with the content of this addendum. Consequently, the recommendation is to replace the 13 models and their weights with

More information

CS229 Lecture notes. Raphael John Lamarre Townshend

CS229 Lecture notes. Raphael John Lamarre Townshend CS229 Lecture notes Raphael John Lamarre Townshend Decision Trees We now turn our attention to decision trees, a simple yet flexible class of algorithms. We will first consider the non-linear, region-based

More information

Segmentation and Modeling of the Spinal Cord for Reality-based Surgical Simulator

Segmentation and Modeling of the Spinal Cord for Reality-based Surgical Simulator Segmentation and Modeling of the Spinal Cord for Reality-based Surgical Simulator Li X.C.,, Chui C. K.,, and Ong S. H.,* Dept. of Electrical and Computer Engineering Dept. of Mechanical Engineering, National

More information

Using Machine Learning to Optimize Storage Systems

Using Machine Learning to Optimize Storage Systems Using Machine Learning to Optimize Storage Systems Dr. Kiran Gunnam 1 Outline 1. Overview 2. Building Flash Models using Logistic Regression. 3. Storage Object classification 4. Storage Allocation recommendation

More information

a. divided by the. 1) Always round!! a) Even if class width comes out to a, go up one.

a. divided by the. 1) Always round!! a) Even if class width comes out to a, go up one. Probability and Statistics Chapter 2 Notes I Section 2-1 A Steps to Constructing Frequency Distributions 1 Determine number of (may be given to you) a Should be between and classes 2 Find the Range a The

More information

Intelligent Robotics

Intelligent Robotics 64-424 Intelligent Robotics 64-424 Intelligent Robotics http://tams.informatik.uni-hamburg.de/ lectures/2013ws/vorlesung/ir Jianwei Zhang / Eugen Richter Faculty of Mathematics, Informatics and Natural

More information

STA121: Applied Regression Analysis

STA121: Applied Regression Analysis STA121: Applied Regression Analysis Variable Selection - Chapters 8 in Dielman Artin Department of Statistical Science October 23, 2009 Outline Introduction 1 Introduction 2 3 4 Variable Selection Model

More information

ELEN E4830 Digital Image Processing. Homework 6 Solution

ELEN E4830 Digital Image Processing. Homework 6 Solution ELEN E4830 Digital Image Processing Homework 6 Solution Chuxiang Li cxli@ee.columbia.edu Department of Electrical Engineering, Columbia University April 10, 2006 1 Edge Detection 1.1 Sobel Operator The

More information

FWD Data Analysis. version Office of Materials Pavement Engineering Section Pavement Design Unit 1400 Gervais Ave Maplewood, MN

FWD Data Analysis. version Office of Materials Pavement Engineering Section Pavement Design Unit 1400 Gervais Ave Maplewood, MN FWD Data Analysis version 2.2.5 Office of Materials Pavement Engineering Section Pavement Design Unit 1400 Gervais Ave Maplewood, MN 55109-2044 FWD Data Analysis First of all, this program is a work in

More information

Chapter 12: Statistics

Chapter 12: Statistics Chapter 12: Statistics Once you have imported your data or created a geospatial model, you may wish to calculate some simple statistics, run some simple tests, or see some traditional plots. On the main

More information

MultiDimensional Signal Processing Master Degree in Ingegneria delle Telecomunicazioni A.A

MultiDimensional Signal Processing Master Degree in Ingegneria delle Telecomunicazioni A.A MultiDimensional Signal Processing Master Degree in Ingegneria delle Telecomunicazioni A.A. 205-206 Pietro Guccione, PhD DEI - DIPARTIMENTO DI INGEGNERIA ELETTRICA E DELL INFORMAZIONE POLITECNICO DI BARI

More information

Detecting and Reading Text in Natural Scenes

Detecting and Reading Text in Natural Scenes October 19, 2004 X. Chen, A. L. Yuille Outline Outline Goals Example Main Ideas Results Goals Outline Goals Example Main Ideas Results Given an image of an outdoor scene, goals are to: Identify regions

More information

Chapter 2: Complexity Analysis

Chapter 2: Complexity Analysis Chapter 2: Complexity Analysis Objectives Looking ahead in this chapter, we ll consider: Computational and Asymptotic Complexity Big-O Notation Properties of the Big-O Notation Ω and Θ Notations Possible

More information

CHAPTER 1. Introduction. Statistics: Statistics is the science of collecting, organizing, analyzing, presenting and interpreting data.

CHAPTER 1. Introduction. Statistics: Statistics is the science of collecting, organizing, analyzing, presenting and interpreting data. 1 CHAPTER 1 Introduction Statistics: Statistics is the science of collecting, organizing, analyzing, presenting and interpreting data. Variable: Any characteristic of a person or thing that can be expressed

More information

3D laser road profiling for the automated measurement of road surface conditions and geometry.

3D laser road profiling for the automated measurement of road surface conditions and geometry. 3D laser road profiling for the automated measurement of road surface conditions and geometry. John Laurent 1, Jean François Hébert 1, Daniel Lefebvre 2, Yves Savard 3 1 Pavemetrics Systems inc., Canada

More information

In this computer exercise we will work with the analysis of variance in R. We ll take a look at the following topics:

In this computer exercise we will work with the analysis of variance in R. We ll take a look at the following topics: UPPSALA UNIVERSITY Department of Mathematics Måns Thulin, thulin@math.uu.se Analysis of regression and variance Fall 2011 COMPUTER EXERCISE 2: One-way ANOVA In this computer exercise we will work with

More information

PEER Report Addendum.

PEER Report Addendum. PEER Report 2017-03 Addendum. The authors recommend the replacement of Section 3.5.1 and Table 3.15 with the content of this Addendum. Consequently, the recommendation is to replace the 13 models and their

More information

Hot-Mix Asphalt and Flexible Pavement Design: the MEPDG

Hot-Mix Asphalt and Flexible Pavement Design: the MEPDG Hot-Mix Asphalt and Flexible Pavement Design: the MEPDG Kevin D. Hall, Ph.D., P.E. Professor and Head, Dept. of Civil Engineering University of Arkansas Flexible Pavement Research Symposium Denver, Colorado

More information

Lab 5 - Risk Analysis, Robustness, and Power

Lab 5 - Risk Analysis, Robustness, and Power Type equation here.biology 458 Biometry Lab 5 - Risk Analysis, Robustness, and Power I. Risk Analysis The process of statistical hypothesis testing involves estimating the probability of making errors

More information

Smoothness of Pavement in Weighin-Motion

Smoothness of Pavement in Weighin-Motion Standard Specification for Smoothness of Pavement in Weighin-Motion (WIM) Systems AASHTO Designation: MP 14-05 American Association of State Highway and Transportation Officials 444 North Capitol Street

More information

Predicting Percentage of Intramuscular Fat Using Two Types of Real-Time Ultrasound Equipment

Predicting Percentage of Intramuscular Fat Using Two Types of Real-Time Ultrasound Equipment Beef Research Report, 2000 Animal Science Research Reports 2001 Predicting Percentage of Intramuscular Fat Using Two Types of Real-Time Ultrasound Equipment Abebe Hassen Doyle Wilson Viren Amin Gene Rouse

More information