Multi-Phase Analysis Framework for Handling Batch Process Data

Size: px
Start display at page:

Download "Multi-Phase Analysis Framework for Handling Batch Process Data"

Transcription

1 Multi-Phase Analysis for Handling Batch Process Data J. Camacho, J. Picó Department of Systems Engineering and Control. A. Ferrer Department of Applied Statistics, Operations Research and Quality. Technical University of Valencia Cno. de Vera s/n, 46022, Valencia, Spain

2 ntroduction to Batch Processing Model Structures Aim of the work Multi-Phase End-quality Other Applications Conclusions

3 1. ntroduction to Batch ntroduction to Batch Processing Repetitive nature: charge, processing and discharge. Three-way data: a set of variables are measured at different sampling times during the processing of a batch, and this is repeated for a number of batches. The duration of the processing of a batch may be variable in some processes Aligment methods. After the alignment, data matrix X ( J K) contains the values of J variables at K sampling times in batches.

4 Model Structures Convert into two-way data and apply PCA, PLS, Apply three-way methods: PARAFAC, Tucker-3, Trilinear Nature???

5 Model Structures Convert into two-way data and apply PCA, PLS, Apply three-way methods: PARAFAC, Tucker-3,

6 Model Structures Convert into two-way data and apply PCA, PLS, Unfold the three-way matrix. Divide in K local matrices. Use an adaptive approach. Apply three-way methods: PARAFAC, Tucker-3,

7 Model Structures Unfold the three-way matrix. Batch-wise unfolding Thousands of variables!!!

8 Model Structures Unfold the three-way matrix. Batch-wise unfolding Dynamics are built in the model More than a half is noise!!! 2 variables x 116 sampling times Variables close in time are more related

9 Model Structures Unfold the three-way matrix. Variable-wise unfolding Low number of parameters More samples/parameter dynamics are not built in the model Constant Correlation mposed!!!

10 Model Structures Unfold the three-way matrix. Variable-wise unfolding Constant Correlation mposed!!! V-W scores

11 Model Structures Unfold the three-way matrix. Batch dynamic unfolding = VW + LMVs 1 LMV LMVs VW LMVs BW Adjust the amount of dynamic information Dynamics are imposed to be constant

12 Model Structures Divide in K matrices Local Moving Average Evolving LMVs locally Adjustable High number of models

13 Aim of the work Context: a) A large number of possible Model Strutures, each of them with advantages and drawbacks. b) Very different batch processes, (constant or varying dynamics, dynamics of different order, etc ) NO MODELLNG STRUCTURE S THE BEST ALWAYS!!! WHY DON T WE DENTFY THE MODEL STRUCTURE FOR THE CURRENT CASE STUDY???

14 ntroduction to Batch Processing Model Structures Aim of the work Multi-Phase End-quality Other Applications Conclusions

15 J X 2 X 1 J X K ndex Multi-Phase - Three-steps Analysis: a) Multi-phase Algorithm. Camacho J, Picó J, Multi-phase principal component analysis for batch processes modelling. Chemometrics and ntelligent Laboratory Systems. 2006; 81: Camacho J, Picó J. Online Monitoring of Batch Processes using Multi-Phase Principal Component Analysis. Journal of Process Control. 2006;10: Parameters X K X K-1 PCA Multi-Phase Algorithm X J K J PCA PCA PCA J J Greedy Optimization + Pattern Recognition

16 X J X 2 X n1+1 X k1-n1 X k1-1 X k1-n1+1 X k1 K X J X 1 X 2 X n1+1 X k1-n1-1 X k1-n1 X k1-1 X k1-n1 X k1-n1+1 X k1 X k1-n2+2 X k1+1 X k2-n2 X k2-1 X k2-n2+1 X k2 K X k2-n3+1 X k2-n3+2 X K-n3-1 X K-n3 X K-n3 X K-n3+1 X k1-n2+1 X k1-n2+2 X k1+1 X k2-n2-1 X k2-n2 X k2-1 X k2-n2 X k2-n2+1 X k2 X J X k2-n3+1 X k2-n3+2 X k2+1 X K-n3-1 X K-n3 X K-1 X K-n3 X K-n3+1 X K J K J J X J K ndex Multi-Phase - Three-steps Analysis: a) Multi-phase Algorithm. Camacho J, Picó J, Multi-phase principal component analysis for batch processes modelling. Chemometrics and ntelligent Laboratory Systems. 2006; 81: Camacho J, Picó J. Online Monitoring of Batch Processes using Multi-Phase Principal Component Analysis. Journal of Process Control. 2006;10: b) Merging Algorithm: T m, Criterium PCA PCA PCA Merging Algorithm PCA X 1 X 2 X n1+1 X k1-n1-1 X k1-n1 X k1-1 X k1-n1 X k1-n1+1 X k1 PCA PCA X k2-n3+1 X k2-n3+2 X K-n3-1 X K-n3 X K-n3 X K-n3+1 X k1-n2+2 X k2-n2 X k2-n2+1

17 Multi-Phase - Three-steps Analysis: a) Multi-phase Algorithm. Camacho J, Picó J, Multi-phase principal component analysis for batch processes modelling. Chemometrics and ntelligent Laboratory Systems. 2006; 81: Camacho J, Picó J. Online Monitoring of Batch Processes using Multi-Phase Principal Component Analysis. Journal of Process Control. 2006;10: b) Merging Algorithm: Why merge? Greedy Optimization Sub-optimal solution To allow obtaining sub-models with different unfolding methods c) Compromise Performance - Complexity Anova + LSD

18 Multi-Phase - Three-steps Analysis: c) Compromise Performance - Complexity Anova + LSD 5 LVs 5 LVs 15 LMVs BW 3 LVs 1 LMV

19 Multi-Phase - Three-steps Analysis: c) Compromise Performance - Complexity Anova + LSD 1 LVs VW 5 LVs 2 LVs 5 LVs BW 3 LVs 15 LMVs 1 LMV 1 LMV

20 ntroduction to Batch Processing Model Structures Aim of the work Multi-Phase End-quality Other Applications Conclusions

21 End-Quality - On-line prediction

22 End-Quality - performance: Saccha. Cerev. Waste-water treat. Anaerobic stage

23 End-Quality - Process understanding: MPPLS = VW-PLS (Anaerobic Stage) BW-PLS 1 PC = 5 parameters (5 variables) 1 PC = 1250 parameters (5 var x 250 sam. tim.)

24 Q statistic Other Applications Off-line Monitoring: Batch-Wise PCA a) The Charts of MP are more informative Phases Var Abnormality in batches #1, #2, #4 and # Sampling time Abnormality in batch #3.

25 Other Applications Off-line Monitoring: Batch-Wise PCA a) The Charts of MP are more informative. On-line Monitoring: PCA a) MP avoids problems found in some modelling structures: BW models have low detection capabilities in the D- statistic and high Overall Type Risk in the SPE. VW models have high OT Risk in the D-statistic. Local models have high OT Risk in the SPE. b) MP yields monitoring systems of fast response to faults. Estimation of trayectories (Soft-sensors): PLS a) MP yields accurate estimations, outperforming BW, VW, Local, Evolving and Adaptive approaches.

26 ntroduction to Batch Processing Model Structures Aim of the work Multi-Phase End-quality Other Applications Conclusions

27 Conclusions The Multi-phase (MP) framework, with application to off-line and on-line monitoring, final quality prediction and estimation of trajectories of variables in batch processes, has been presented. The MP approach is based on the data-driven identification of the (PCA or PLS) model structure, using pattern recognition and optimization techniques. Flexibility to adjust the structure to the case: Number of sub-models, dynamics, This approach has several general advantages: The identification of the structure of the models and the convenient use of the tools within the MP framework helps to improve the process understanding. The MP approach allows to obtain a compromise solution between complexity and performance. The MP approach yields good performance in several applications.

28 Multi-Phase Analysis for Handling Batch Process Data J. Camacho, J. Picó Department of Systems Engineering and Control. A. Ferrer Department of Applied Statistics, Operations Research and Quality. Technical University of Valencia Cno. de Vera s/n, 46022, Valencia, Spain

29 2. Aim of the work 3. Multi-Phase Algorithm 4. Merging Algorithm 5. Multi-Phase 6. On-line Monitoring 7. End-quality 8. Conclusions On-line Monitoring - Monitoring Charts: D-statistic and SPE Batch under NOC

30 2. Aim of the work 3. Multi-Phase Algorithm 4. Merging Algorithm 5. Multi-Phase 6. On-line Monitoring 7. End-quality 8. Conclusions On-line Monitoring - Monitoring Charts: D-statistic and SPE Abnormal Batch

31 2. Aim of the work 3. Multi-Phase Algorithm 4. Merging Algorithm 5. Multi-Phase 6. On-line Monitoring 7. End-quality 8. Conclusions On-line Monitoring - Case Studies:

32 2. Aim of the work 3. Multi-Phase Algorithm 4. Merging Algorithm 5. Multi-Phase 6. On-line Monitoring 7. End-quality 8. Conclusions On-line Monitoring - Preliminary Study: Saccharomyces Cerevisiae Cultivation. Overall Type Risk computed from the NOC test set, mposed significance level 1% n f number of faults Conclusion: The structure of the model is important in the on-line monitoring.

33 2. Aim of the work 3. Multi-Phase Algorithm 4. Merging Algorithm 5. Multi-Phase 6. On-line Monitoring 7. End-quality 8. Conclusions Solutions: On-line Monitoring a) To readjust the control limits of the monitoring charts using a left-one-out approach. b) To identify the covenient model structure Multi- Phase Conclusion: The structure of the model is important in the on-line monitoring.

34 2. Aim of the work 3. Multi-Phase Algorithm 4. Merging Algorithm 5. Multi-Phase 6. On-line Monitoring 7. End-quality 8. Conclusions On-line Monitoring - Nylon 6 6 Polymerization:

35 2. Aim of the work 3. Multi-Phase Algorithm 4. Merging Algorithm 5. Multi-Phase 6. On-line Monitoring 7. End-quality 8. Conclusions On-line Monitoring - Saccharomyces Cerevisiae Cultivation: - Waste-water Treatment:

Document downloaded from:

Document downloaded from: Document downloaded from: http://hdl.handle.net/10251/53073 This paper must be cited as: González Martínez, JM.; Ferrer Riquelme, AJ.; Westerhuis, JA. (2011). Real-time synchronization of batch trajectories

More information

Hyperspectral Chemical Imaging: principles and Chemometrics.

Hyperspectral Chemical Imaging: principles and Chemometrics. Hyperspectral Chemical Imaging: principles and Chemometrics aoife.gowen@ucd.ie University College Dublin University College Dublin 1,596 PhD students 6,17 international students 8,54 graduate students

More information

Data Mining Approaches to Characterize Batch Process Operations

Data Mining Approaches to Characterize Batch Process Operations Data Mining Approaches to Characterize Batch Process Operations Rodolfo V. Tona V., Antonio Espuña and Luis Puigjaner * Universitat Politècnica de Catalunya, Chemical Engineering Department. Diagonal 647,

More information

FEA and Multivariate Statistical Data Analysis of Polypropylene Tube Forming Process

FEA and Multivariate Statistical Data Analysis of Polypropylene Tube Forming Process FEA and Multivariate Statistical Data Analysis of Polypropylene ube Forming Process Galini Gavrilidou, Mukesh Jain Department of Mechanical Engineering, McMaster University, Hamilton, On, LS L7, Canada

More information

Raman Images. Jeremy M. Shaver 1, Eunah Lee 2, Andrew Whitley 2, R. Scott Koch. 1. Eigenvector Research, Inc. 2. HORIBA Jobin Yvon, Inc.

Raman Images. Jeremy M. Shaver 1, Eunah Lee 2, Andrew Whitley 2, R. Scott Koch. 1. Eigenvector Research, Inc. 2. HORIBA Jobin Yvon, Inc. Analyzing and Visualizing Large Raman Images Jeremy M. Shaver 1, Eunah Lee 2, Andrew Whitley 2, R. Scott Koch 1 1. Eigenvector Research, Inc. 2. HORIBA Jobin Yvon, Inc. What is a Large Image? Gone from

More information

Design of Fault Diagnosis System of FPSO Production Process Based on MSPCA

Design of Fault Diagnosis System of FPSO Production Process Based on MSPCA 2009 Fifth International Conference on Information Assurance and Security Design of Fault Diagnosis System of FPSO Production Process Based on MSPCA GAO Qiang, HAN Miao, HU Shu-liang, DONG Hai-jie ianjin

More information

Real-time Monitoring of Multi-mode Industrial Processes using Feature-extraction Tools

Real-time Monitoring of Multi-mode Industrial Processes using Feature-extraction Tools Real-time Monitoring of Multi-mode Industrial Processes using Feature-extraction Tools Y. S. Manjili *, M. Niknamfar, M. Jamshidi Department of Electrical and Computer Engineering The University of Texas

More information

A Soft Computing-Based Method for the Identification of Best Practices, with Application in the Petroleum Industry

A Soft Computing-Based Method for the Identification of Best Practices, with Application in the Petroleum Industry CIMSA 2005 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications Giardini Naxos, Italy, 20-22 July 2005 A Soft Computing-Based Method for the Identification

More information

Basics of Multivariate Modelling and Data Analysis

Basics of Multivariate Modelling and Data Analysis Basics of Multivariate Modelling and Data Analysis Kurt-Erik Häggblom 9. Linear regression with latent variables 9.1 Principal component regression (PCR) 9.2 Partial least-squares regression (PLS) [ mostly

More information

COMPARATIVE STUDY OF IMAGE FUSION TECHNIQUES IN SPATIAL AND TRANSFORM DOMAIN

COMPARATIVE STUDY OF IMAGE FUSION TECHNIQUES IN SPATIAL AND TRANSFORM DOMAIN COMPARATIVE STUDY OF IMAGE FUSION TECHNIQUES IN SPATIAL AND TRANSFORM DOMAIN Bhuvaneswari Balachander and D. Dhanasekaran Department of Electronics and Communication Engineering, Saveetha School of Engineering,

More information

Development of Fault Diagnosis System Using Principal Component Analysis for Intelligent Operation Support System

Development of Fault Diagnosis System Using Principal Component Analysis for Intelligent Operation Support System 655 A publication of CHEMICAL ENGINEERING TRANSACTIONS VOL. 31, 2013 Guest Editors: Eddy De Rademaeker, Bruno Fabiano, Simberto Senni Buratti Copyright 2013, AIDIC Servizi S.r.l., ISBN 978-88-95608-22-8;

More information

Statistics for Engineering

Statistics for Engineering Statistics for Engineering Section 6: Latent variable modelling Kevin Dunn Copyright, and all rights reserved, Kevin Dunn, 2011 kevin.dunn@connectmv.com April 2011 1 What we will cover What is a latent

More information

Batch Analytics. Batch Analytics. Introduction. DeltaV Product Data Sheet. Predicts end-of-batch quality

Batch Analytics. Batch Analytics. Introduction. DeltaV Product Data Sheet. Predicts end-of-batch quality January 2013 Page 1 provides online decision support for batch operations Predicts end-of-batch quality Detects process faults and provides reason for deviation so operations can take action in real time

More information

Batch Analytics. Predicts end-of-batch quality. Detects process faults and provides reason for deviation so operations can take action in real time

Batch Analytics. Predicts end-of-batch quality. Detects process faults and provides reason for deviation so operations can take action in real time DeltaV Distributed Control System Product Data Sheet December 2016 Batch Analytics Predicts end-of-batch quality Detects process faults and provides reason for deviation so operations can take action in

More information

Regularized Tensor Factorizations & Higher-Order Principal Components Analysis

Regularized Tensor Factorizations & Higher-Order Principal Components Analysis Regularized Tensor Factorizations & Higher-Order Principal Components Analysis Genevera I. Allen Department of Statistics, Rice University, Department of Pediatrics-Neurology, Baylor College of Medicine,

More information

A new Window into Process data- Descriptive data analysis of multi-block data. Ing-Marie Lindström, PhD SIMCA Product manager Umetrics

A new Window into Process data- Descriptive data analysis of multi-block data. Ing-Marie Lindström, PhD SIMCA Product manager Umetrics A new Window into Process data- Descriptive data analysis of multi-block data Ing-Marie Lindström, PhD SIMCA Product manager Umetrics Founded 1987, Umeå Sweden Umetrics World s highest concentration of

More information

Sampling Approaches to Metrology in Semiconductor Manufacturing

Sampling Approaches to Metrology in Semiconductor Manufacturing Sampling Approaches to Metrology in Semiconductor Manufacturing Tyrone Vincent 1 and Broc Stirton 2, Kameshwar Poolla 3 1 Colorado School of Mines, Golden CO 2 GLOBALFOUNDRIES, Austin TX 3 University of

More information

Chemometrics. Description of Pirouette Algorithms. Technical Note. Abstract

Chemometrics. Description of Pirouette Algorithms. Technical Note. Abstract 19-1214 Chemometrics Technical Note Description of Pirouette Algorithms Abstract This discussion introduces the three analysis realms available in Pirouette and briefly describes each of the algorithms

More information

SYDE Winter 2011 Introduction to Pattern Recognition. Clustering

SYDE Winter 2011 Introduction to Pattern Recognition. Clustering SYDE 372 - Winter 2011 Introduction to Pattern Recognition Clustering Alexander Wong Department of Systems Design Engineering University of Waterloo Outline 1 2 3 4 5 All the approaches we have learned

More information

Pre-processing method minimizing the need for reference analyses

Pre-processing method minimizing the need for reference analyses JOURNAL OF CHEMOMETRICS J. Chemometrics 2001; 15: 123 131 Pre-processing method minimizing the need for reference analyses Per Waaben Hansen* Foss Electric A/S, Slangerupgade 69, DK-3400 Hillerød, Denmark

More information

Performance optimization of a rotary mower using Taguchi method

Performance optimization of a rotary mower using Taguchi method Agronomy Research Biosystem Engineering Special Issue, 49-54, 0 Performance optimization of a rotary mower using Taguchi method S. Saeid Hosseini and Mohsen Shamsi Department of mechanics of Agricultural

More information

Advanced optimizations of cache performance ( 2.2)

Advanced optimizations of cache performance ( 2.2) Advanced optimizations of cache performance ( 2.2) 30 1. Small and Simple Caches to reduce hit time Critical timing path: address tag memory, then compare tags, then select set Lower associativity Direct-mapped

More information

Linear Discriminant Analysis for 3D Face Recognition System

Linear Discriminant Analysis for 3D Face Recognition System Linear Discriminant Analysis for 3D Face Recognition System 3.1 Introduction Face recognition and verification have been at the top of the research agenda of the computer vision community in recent times.

More information

Data Mining Chapter 3: Visualizing and Exploring Data Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Data Mining Chapter 3: Visualizing and Exploring Data Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Data Mining Chapter 3: Visualizing and Exploring Data Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Exploratory data analysis tasks Examine the data, in search of structures

More information

How to Make APA Format Tables Using Microsoft Word

How to Make APA Format Tables Using Microsoft Word How to Make APA Format Tables Using Microsoft Word 1 I. Tables vs. Figures - See APA Publication Manual p. 147-175 for additional details - Tables consist of words and numbers where spatial relationships

More information

Mapping of Hierarchical Activation in the Visual Cortex Suman Chakravartula, Denise Jones, Guillaume Leseur CS229 Final Project Report. Autumn 2008.

Mapping of Hierarchical Activation in the Visual Cortex Suman Chakravartula, Denise Jones, Guillaume Leseur CS229 Final Project Report. Autumn 2008. Mapping of Hierarchical Activation in the Visual Cortex Suman Chakravartula, Denise Jones, Guillaume Leseur CS229 Final Project Report. Autumn 2008. Introduction There is much that is unknown regarding

More information

Development of a novel self-validating soft sensor

Development of a novel self-validating soft sensor Korean J. Chem. Eng., 29(9), 1135-1143 (2012) DOI: 10.1007/s11814-011-0289-9 INVIED REVIEW PAPER Development of a novel self-validating soft sensor Yiqi Liu, Daoping Huang, Yan Li, and Xuefeng Zhu School

More information

A NEW VARIABLES SELECTION AND DIMENSIONALITY REDUCTION TECHNIQUE COUPLED WITH SIMCA METHOD FOR THE CLASSIFICATION OF TEXT DOCUMENTS

A NEW VARIABLES SELECTION AND DIMENSIONALITY REDUCTION TECHNIQUE COUPLED WITH SIMCA METHOD FOR THE CLASSIFICATION OF TEXT DOCUMENTS A NEW VARIABLES SELECTION AND DIMENSIONALITY REDUCTION TECHNIQUE COUPLED WITH SIMCA METHOD FOR THE CLASSIFICATION OF TEXT DOCUMENTS Ahmed Abdelfattah Saleh University of Brasilia, Brasil ahmdsalh@yahoo.com

More information

Fault detection with principal component pursuit method

Fault detection with principal component pursuit method Journal of Physics: Conference Series PAPER OPEN ACCESS Fault detection with principal component pursuit method Recent citations - Robust Principal Component Pursuit for Fault Detection in a Blast Furnace

More information

Module 1 - Class Introduction

Module 1 - Class Introduction Module 1 Introduction to Class Training Module Overview Overview Duration and Schedule Prerequisites Goals Materials Structure and Methodology Module Overview Introduction to Class Slide 2 Module 1 Introduction

More information

Variable Selection 6.783, Biomedical Decision Support

Variable Selection 6.783, Biomedical Decision Support 6.783, Biomedical Decision Support (lrosasco@mit.edu) Department of Brain and Cognitive Science- MIT November 2, 2009 About this class Why selecting variables Approaches to variable selection Sparsity-based

More information

Fisher Discriminant Analysis for Semiconductor Batch Tool Matching

Fisher Discriminant Analysis for Semiconductor Batch Tool Matching Proceedings of the 7th World Congress The International Federation of Automatic Control Seoul, Korea, July 6-, 28 Fisher Discriminant Analysis for Semiconductor Batch Tool Matching Gregory Cherry and S.

More information

Resting state network estimation in individual subjects

Resting state network estimation in individual subjects Resting state network estimation in individual subjects Data 3T NIL(21,17,10), Havard-MGH(692) Young adult fmri BOLD Method Machine learning algorithm MLP DR LDA Network image Correlation Spatial Temporal

More information

Sage: Symmetry and Asymmetry in Geometric Data Version 1.21 (compiled 03/1114)

Sage: Symmetry and Asymmetry in Geometric Data Version 1.21 (compiled 03/1114) Sage: Symmetry and Asymmetry in Geometric Data Version 1.21 (compiled 03/1114) Eladio Marquez 2012-2014 Mammals Division University of Michigan Museum of Zoology http://www-personal.umich.edu/~emarquez/morph/

More information

RIB Spain SA Rodríguez San Pedro Madrid

RIB Spain SA Rodríguez San Pedro Madrid RIB Spain SA +34 914 483 800 Rodríguez San Pedro 10 info@rib-software.es 28015 Madrid www.rib-software.es Excel2Presto Manual Objective Excel2Presto is an Excel complement that allows you to convert any

More information

3. Data Preprocessing. 3.1 Introduction

3. Data Preprocessing. 3.1 Introduction 3. Data Preprocessing Contents of this Chapter 3.1 Introduction 3.2 Data cleaning 3.3 Data integration 3.4 Data transformation 3.5 Data reduction SFU, CMPT 740, 03-3, Martin Ester 84 3.1 Introduction Motivation

More information

2. Data Preprocessing

2. Data Preprocessing 2. Data Preprocessing Contents of this Chapter 2.1 Introduction 2.2 Data cleaning 2.3 Data integration 2.4 Data transformation 2.5 Data reduction Reference: [Han and Kamber 2006, Chapter 2] SFU, CMPT 459

More information

Genotype x Environmental Analysis with R for Windows

Genotype x Environmental Analysis with R for Windows Genotype x Environmental Analysis with R for Windows Biometrics and Statistics Unit Angela Pacheco CIMMYT,Int. 23-24 Junio 2015 About GEI In agricultural experimentation, a large number of genotypes are

More information

CSE 6242 A / CS 4803 DVA. Feb 12, Dimension Reduction. Guest Lecturer: Jaegul Choo

CSE 6242 A / CS 4803 DVA. Feb 12, Dimension Reduction. Guest Lecturer: Jaegul Choo CSE 6242 A / CS 4803 DVA Feb 12, 2013 Dimension Reduction Guest Lecturer: Jaegul Choo CSE 6242 A / CS 4803 DVA Feb 12, 2013 Dimension Reduction Guest Lecturer: Jaegul Choo Data is Too Big To Do Something..

More information

Building an Intelligent World. Zhexuan Song, Chief Strategy Officer, Huawei

Building an Intelligent World. Zhexuan Song, Chief Strategy Officer, Huawei Building an Intelligent World Zhexuan Song, Chief Strategy Officer, Huawei AI, as a general purpose technology, changed Huawei Manufacture Logistics Retail Yield increase Information driven Risk management

More information

Using Statistical Techniques to Improve the QC Process of Swell Noise Filtering

Using Statistical Techniques to Improve the QC Process of Swell Noise Filtering Using Statistical Techniques to Improve the QC Process of Swell Noise Filtering A. Spanos* (Petroleum Geo-Services) & M. Bekara (PGS - Petroleum Geo- Services) SUMMARY The current approach for the quality

More information

Data-driven modeling: A low-rank approximation problem

Data-driven modeling: A low-rank approximation problem 1 / 31 Data-driven modeling: A low-rank approximation problem Ivan Markovsky Vrije Universiteit Brussel 2 / 31 Outline Setup: data-driven modeling Problems: system identification, machine learning,...

More information

byneuron A BUILDING MANAGEMENT SYSTEM CONTROLS YOUR BUILDING BUT WHO CONTROLS YOUR MANAGEMENT SYSTEM?

byneuron A BUILDING MANAGEMENT SYSTEM CONTROLS YOUR BUILDING BUT WHO CONTROLS YOUR MANAGEMENT SYSTEM? A BUILDING MANAGEMENT SYSTEM CONTROLS YOUR BUILDING BUT WHO CONTROLS YOUR MANAGEMENT SYSTEM? byneuron MASTER BUILDING MANAGEMENT SYSTEM For advanced analytics and smarter building energy management Buildings

More information

REDCAP DATA DICTIONARY CLASS. November 9, 2017

REDCAP DATA DICTIONARY CLASS. November 9, 2017 REDCAP DATA DICTIONARY CLASS November 9, 2017 LEARNING OBJECTIVES Learn how to leverage the data dictionary Data dictionary basics Column descriptions Best practices Interplay with longitudinal features

More information

Nonlinear data driven techniques for process monitoring

Nonlinear data driven techniques for process monitoring Louisiana State University LSU Digital Commons LSU Master's Theses Graduate School 2014 Nonlinear data driven techniques for process monitoring Michael C. Thomas Louisiana State University and Agricultural

More information

Linear Methods for Regression and Shrinkage Methods

Linear Methods for Regression and Shrinkage Methods Linear Methods for Regression and Shrinkage Methods Reference: The Elements of Statistical Learning, by T. Hastie, R. Tibshirani, J. Friedman, Springer 1 Linear Regression Models Least Squares Input vectors

More information

Plumbing Product Certification WaterMark Level 2

Plumbing Product Certification WaterMark Level 2 NCSI Recognition Booklet Addendum Plumbing Product Certification WaterMark Level 2 1. General In Australia most of the plumbing and drainage products and materials are required to be certified under the

More information

DATA MINING OVERFITTING AND EVALUATION

DATA MINING OVERFITTING AND EVALUATION DATA MINING OVERFITTING AND EVALUATION 1 Overfitting Will cover mechanisms for preventing overfitting in decision trees But some of the mechanisms and concepts will apply to other algorithms 2 Occam s

More information

Event and anomaly detection using Tucker3 decomposition

Event and anomaly detection using Tucker3 decomposition Event and anomaly detection using Tucker3 decomposition Hadi Fanaee Tork 1, Márcia Oliveira 2, João Gama 3, Simon Malinowski 4 and Ricardo Morla 5 Abstract. 1 Failure detection in telecommunication networks

More information

Sampling PCA, enhancing recovered missing values in large scale matrices. Luis Gabriel De Alba Rivera 80555S

Sampling PCA, enhancing recovered missing values in large scale matrices. Luis Gabriel De Alba Rivera 80555S Sampling PCA, enhancing recovered missing values in large scale matrices. Luis Gabriel De Alba Rivera 80555S May 2, 2009 Introduction Human preferences (the quality tags we put on things) are language

More information

High-Throughput Real-Time Network Flow Visualization

High-Throughput Real-Time Network Flow Visualization High-Throughput Real-Time Network Flow Visualization Daniel Best Research Scientist Information Analytics daniel.best@pnl.gov Douglas Love, Shawn Bohn, William Pike 1 Tools and a Pipeline to Provide Defense

More information

Reviewer Profiling Using Sparse Matrix Regression

Reviewer Profiling Using Sparse Matrix Regression Reviewer Profiling Using Sparse Matrix Regression Evangelos E. Papalexakis, Nicholas D. Sidiropoulos, Minos N. Garofalakis Technical University of Crete, ECE department 14 December 2010, OEDM 2010, Sydney,

More information

Multidirectional 2DPCA Based Face Recognition System

Multidirectional 2DPCA Based Face Recognition System Multidirectional 2DPCA Based Face Recognition System Shilpi Soni 1, Raj Kumar Sahu 2 1 M.E. Scholar, Department of E&Tc Engg, CSIT, Durg 2 Associate Professor, Department of E&Tc Engg, CSIT, Durg Email:

More information

Evaluation of Model-Based Condition Monitoring Systems in Industrial Application Cases

Evaluation of Model-Based Condition Monitoring Systems in Industrial Application Cases Evaluation of Model-Based Condition Monitoring Systems in Industrial Application Cases S. Windmann 1, J. Eickmeyer 1, F. Jungbluth 1, J. Badinger 2, and O. Niggemann 1,2 1 Fraunhofer Application Center

More information

Latent variable transformation using monotonic B-splines in PLS Path Modeling

Latent variable transformation using monotonic B-splines in PLS Path Modeling Latent variable transformation using monotonic B-splines in PLS Path Modeling E. Jakobowicz CEDRIC, Conservatoire National des Arts et Métiers, 9 rue Saint Martin, 754 Paris Cedex 3, France EDF R&D, avenue

More information

Data-driven fault detection with process topology for fault identification

Data-driven fault detection with process topology for fault identification Preprints of the 19th World Congress The International Federation of Automatic Control Data-driven fault detection with process topology for fault identification Brian S. Lindner*. Lidia Auret** * Department

More information

Data Preprocessing. D.N. Rutledge, AgroParisTech

Data Preprocessing. D.N. Rutledge, AgroParisTech Data Preprocessing D.N. Rutledge, AgroParisTech 12 Rencontres Héliospir / 30 septembre 2011 Outline Zone selection Examining raw data The importance of pre-treatment of data Common pre-treatment methods

More information

On Real-time Control and Process Monitoring. of Wastewater Treatment Plants: Realtime

On Real-time Control and Process Monitoring. of Wastewater Treatment Plants: Realtime On Real-time Control and Process Monitoring of Wastewater Treatment Plants: Realtime Process Monitoring. M.J. Wade, R. Katebi and A. Sanchez Industrial Control Centre, University of Strathclyde, Glasgow

More information

Missing Data Estimation in Microarrays Using Multi-Organism Approach

Missing Data Estimation in Microarrays Using Multi-Organism Approach Missing Data Estimation in Microarrays Using Multi-Organism Approach Marcel Nassar and Hady Zeineddine Progress Report: Data Mining Course Project, Spring 2008 Prof. Inderjit S. Dhillon April 02, 2008

More information

Multi-Camera Calibration, Object Tracking and Query Generation

Multi-Camera Calibration, Object Tracking and Query Generation MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Multi-Camera Calibration, Object Tracking and Query Generation Porikli, F.; Divakaran, A. TR2003-100 August 2003 Abstract An automatic object

More information

Robust PARAFAC for incomplete data

Robust PARAFAC for incomplete data Robust PARAFAC for incomplete data Mia Hubert, Johan Van Kerckhoven, Tim Verdonck April 12, 2012 KU Leuven, Department of Mathematics - LStat, Celestijnenlaan 200B, BE-3001 Heverlee, Belgium KU Leuven,

More information

Homology Modeling Professional for HyperChem Release Notes

Homology Modeling Professional for HyperChem Release Notes Homology Modeling Professional for HyperChem Release Notes This document lists additional information about Homology Modeling Professional for HyperChem. Current Revision Revision H1 (Version 8.1.1) Current

More information

Clustering and Visualisation of Data

Clustering and Visualisation of Data Clustering and Visualisation of Data Hiroshi Shimodaira January-March 28 Cluster analysis aims to partition a data set into meaningful or useful groups, based on distances between data points. In some

More information

Learning a Manifold as an Atlas Supplementary Material

Learning a Manifold as an Atlas Supplementary Material Learning a Manifold as an Atlas Supplementary Material Nikolaos Pitelis Chris Russell School of EECS, Queen Mary, University of London [nikolaos.pitelis,chrisr,lourdes]@eecs.qmul.ac.uk Lourdes Agapito

More information

Lecture 28 Intro to Tracking

Lecture 28 Intro to Tracking Lecture 28 Intro to Tracking Some overlap with T&V Section 8.4.2 and Appendix A.8 Recall: Blob Merge/Split merge occlusion occlusion split When two objects pass close to each other, they are detected as

More information

Fault-tolerant control and data recovery in HVAC monitoring system

Fault-tolerant control and data recovery in HVAC monitoring system http://wwwpapereducn Energy and Buildings 37 (2005) 175 180 wwwelseviercom/locate/enbuild Fault-tolerant control and recovery in HVAC monitoring system Xiaoli Hao a,b, Guoqiang Zhang a, Youming Chen a,

More information

Recall: Blob Merge/Split Lecture 28

Recall: Blob Merge/Split Lecture 28 Recall: Blob Merge/Split Lecture 28 merge occlusion Intro to Tracking Some overlap with T&V Section 8.4.2 and Appendix A.8 occlusion split When two objects pass close to each other, they are detected as

More information

The use of NNPLS algorithm for on-line calibration monitoring

The use of NNPLS algorithm for on-line calibration monitoring he use of NNPLS algorithm for online calibration monitoring Andreas Kirschner Institutt for energiteknikk Halden Norway Andreas.Kirschner@hrp.no Abstract he paper presents a specialised Partial Least Squares

More information

Global Shape Matching

Global Shape Matching Global Shape Matching Section 3.2: Extrinsic Key Point Detection and Feature Descriptors 1 The story so far Problem statement Given pair of shapes/scans, find correspondences between the shapes Local shape

More information

Performance Degradation Assessment and Fault Diagnosis of Bearing Based on EMD and PCA-SOM

Performance Degradation Assessment and Fault Diagnosis of Bearing Based on EMD and PCA-SOM Performance Degradation Assessment and Fault Diagnosis of Bearing Based on EMD and PCA-SOM Lu Chen and Yuan Hang PERFORMANCE DEGRADATION ASSESSMENT AND FAULT DIAGNOSIS OF BEARING BASED ON EMD AND PCA-SOM.

More information

Extraction and Features of Tumour from MR brain images

Extraction and Features of Tumour from MR brain images IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 13, Issue 2, Ver. I (Mar. - Apr. 2018), PP 67-71 www.iosrjournals.org Sai Prasanna M 1,

More information

The Comparative Study of Machine Learning Algorithms in Text Data Classification*

The Comparative Study of Machine Learning Algorithms in Text Data Classification* The Comparative Study of Machine Learning Algorithms in Text Data Classification* Wang Xin School of Science, Beijing Information Science and Technology University Beijing, China Abstract Classification

More information

DIGIT.B4 Big Data PoC

DIGIT.B4 Big Data PoC DIGIT.B4 Big Data PoC RTD Health papers D02.02 Technological Architecture Table of contents 1 Introduction... 5 2 Methodological Approach... 6 2.1 Business understanding... 7 2.2 Data linguistic understanding...

More information

A Multi-Objective Evolutionary Approach to Pareto Optimal Model Trees. A preliminary study

A Multi-Objective Evolutionary Approach to Pareto Optimal Model Trees. A preliminary study A Multi-Objective Evolutionary Approach to Pareto Optimal Model Trees. A preliminary study Marcin Czajkowski and Marek Kretowski TPNC 2016 12-13.12.2016 Sendai, Japan Faculty of Computer Science Bialystok

More information

APC. Jan Zimpel Knut Voigtländer. Dirk Knobloch Infineon Technologies AG München. Advanced Data Processing GmbH. Oct Page 1

APC. Jan Zimpel Knut Voigtländer. Dirk Knobloch Infineon Technologies AG München. Advanced Data Processing GmbH. Oct Page 1 Processing Infineon Technologies AG München Oct. 21 Page 1 SEMATECH AEC/ Symposium XIII October 6-11, 2, Banff, Canada Outline Processing Introduction Comparison of common used endpoint detection methods

More information

SPE MS Multivariate Analysis Using Advanced Probabilistic Techniques for Completion Optimization

SPE MS Multivariate Analysis Using Advanced Probabilistic Techniques for Completion Optimization SPE-185077-MS Multivariate Analysis Using Advanced Probabilistic Techniques for Completion Optimization Bertrand Groulx, Verdazo Analytics; Jim Gouveia, Rose & Associates, LLP; Don Chenery, Verdazo Analytics

More information

Section 4 General Factorial Tutorials

Section 4 General Factorial Tutorials Section 4 General Factorial Tutorials General Factorial Part One: Categorical Introduction Design-Ease software version 6 offers a General Factorial option on the Factorial tab. If you completed the One

More information

Adaptive Multiresolution Denoising Filter for 3D MR Images

Adaptive Multiresolution Denoising Filter for 3D MR Images Adaptive Multiresolution Denoising Filter for 3D MR Images Pierrick Coupé 1, José V. Manjon 2, Montserrat Robles 2, D. Louis Collins 1. 1 McConnell Brain Imaging Centre, Montréal Neurological Institute,

More information

Data-driven modeling: A low-rank approximation problem

Data-driven modeling: A low-rank approximation problem 1 / 34 Data-driven modeling: A low-rank approximation problem Ivan Markovsky Vrije Universiteit Brussel 2 / 34 Outline Setup: data-driven modeling Problems: system identification, machine learning,...

More information

Distances, Clustering! Rafael Irizarry!

Distances, Clustering! Rafael Irizarry! Distances, Clustering! Rafael Irizarry! Heatmaps! Distance! Clustering organizes things that are close into groups! What does it mean for two genes to be close?! What does it mean for two samples to

More information

Anomaly Detection Solutions for Improved Equipment Availability

Anomaly Detection Solutions for Improved Equipment Availability Detection Solutions for Improved Equipment Availability Big Data is the enabler for Hitachi s Detection Technology Advances in ICT have made it easy to collect and store massive amounts of operational

More information

IoT Enabling Smart Facilities - an Owner Perspective. Arthur Chuang Senior Director, 300mm Facility Div., TSMC

IoT Enabling Smart Facilities - an Owner Perspective. Arthur Chuang Senior Director, 300mm Facility Div., TSMC IoT Enabling Smart Facilities - an Owner Perspective Arthur Chuang Senior Director, 300mm Facility Div., TSMC EDUCATION Arthur Chuang - Bio BS, Mechanical Engineering, National Taiwan University of Science

More information

Object and Action Detection from a Single Example

Object and Action Detection from a Single Example Object and Action Detection from a Single Example Peyman Milanfar* EE Department University of California, Santa Cruz *Joint work with Hae Jong Seo AFOSR Program Review, June 4-5, 29 Take a look at this:

More information

Neural Networks for unsupervised learning From Principal Components Analysis to Autoencoders to semantic hashing

Neural Networks for unsupervised learning From Principal Components Analysis to Autoencoders to semantic hashing Neural Networks for unsupervised learning From Principal Components Analysis to Autoencoders to semantic hashing feature 3 PC 3 Beate Sick Many slides are taken form Hinton s great lecture on NN: https://www.coursera.org/course/neuralnets

More information

Task analysis based on observing hands and objects by vision

Task analysis based on observing hands and objects by vision Task analysis based on observing hands and objects by vision Yoshihiro SATO Keni Bernardin Hiroshi KIMURA Katsushi IKEUCHI Univ. of Electro-Communications Univ. of Karlsruhe Univ. of Tokyo Abstract In

More information

ModelStructureSelection&TrainingAlgorithmsfor an HMMGesture Recognition System

ModelStructureSelection&TrainingAlgorithmsfor an HMMGesture Recognition System ModelStructureSelection&TrainingAlgorithmsfor an HMMGesture Recognition System Nianjun Liu, Brian C. Lovell, Peter J. Kootsookos, and Richard I.A. Davis Intelligent Real-Time Imaging and Sensing (IRIS)

More information

Feature Selection Technique to Improve Performance Prediction in a Wafer Fabrication Process

Feature Selection Technique to Improve Performance Prediction in a Wafer Fabrication Process Feature Selection Technique to Improve Performance Prediction in a Wafer Fabrication Process KITTISAK KERDPRASOP and NITTAYA KERDPRASOP Data Engineering Research Unit, School of Computer Engineering, Suranaree

More information

Nature Methods: doi: /nmeth Supplementary Figure 1

Nature Methods: doi: /nmeth Supplementary Figure 1 Supplementary Figure 1 Schematic representation of the Workflow window in Perseus All data matrices uploaded in the running session of Perseus and all processing steps are displayed in the order of execution.

More information

Improving Face Recognition by Exploring Local Features with Visual Attention

Improving Face Recognition by Exploring Local Features with Visual Attention Improving Face Recognition by Exploring Local Features with Visual Attention Yichun Shi and Anil K. Jain Michigan State University Difficulties of Face Recognition Large variations in unconstrained face

More information

Outlier Detection and Removal Algorithm in K-Means and Hierarchical Clustering

Outlier Detection and Removal Algorithm in K-Means and Hierarchical Clustering World Journal of Computer Application and Technology 5(2): 24-29, 2017 DOI: 10.13189/wjcat.2017.050202 http://www.hrpub.org Outlier Detection and Removal Algorithm in K-Means and Hierarchical Clustering

More information

EAR RECOGNITION AND OCCLUSION

EAR RECOGNITION AND OCCLUSION EAR RECOGNITION AND OCCLUSION B. S. El-Desouky 1, M. El-Kady 2, M. Z. Rashad 3, Mahmoud M. Eid 4 1 Mathematics Department, Faculty of Science, Mansoura University, Egypt b_desouky@yahoo.com 2 Mathematics

More information

Comprehensive analysis and evaluation of big data for main transformer equipment based on PCA and Apriority

Comprehensive analysis and evaluation of big data for main transformer equipment based on PCA and Apriority IOP Conference Series: Earth and Environmental Science PAPER OPEN ACCESS Comprehensive analysis and evaluation of big data for main transformer equipment based on PCA and Apriority To cite this article:

More information

Estimation of Automotive Pitch, Yaw, and Roll using Enhanced Phase Correlation on Multiple Far-field Windows

Estimation of Automotive Pitch, Yaw, and Roll using Enhanced Phase Correlation on Multiple Far-field Windows Estimation of Automotive Pitch, Yaw, and Roll using Enhanced Phase Correlation on Multiple Far-field Windows M. Barnada, C. Conrad, H. Bradler, M. Ochs and R. Mester Visual Sensorics and Information Processing

More information

Evaluation of Optimization Methods for Network Bottleneck Diagnosis. Alina Beygelzimer Jeff Kephart Irina Rish

Evaluation of Optimization Methods for Network Bottleneck Diagnosis. Alina Beygelzimer Jeff Kephart Irina Rish Evaluation of Optimization Methods for Network Bottleneck Diagnosis Alina Beygelzimer Jeff Kephart Irina Rish Real-time Network Performance Diagnosis Nodes in computer networks often experience performance

More information

2012 Grid of the Future Symposium. Grid Operational Data Management USA

2012 Grid of the Future Symposium. Grid Operational Data Management USA 21, rue d Artois, F-75008 PARIS CIGRE US National Committee http : //www.cigre.org 2012 Grid of the Future Symposium Grid Operational Data Management J. TAFT 1 Cisco Systems, Inc USA P. DE MARTINI Newport

More information

CHAPTER 4 MAINTENANCE STRATEGY SELECTION USING TOPSIS AND FUZZY TOPSIS

CHAPTER 4 MAINTENANCE STRATEGY SELECTION USING TOPSIS AND FUZZY TOPSIS 59 CHAPTER 4 MAINTENANCE STRATEGY SELECTION USING TOPSIS AND FUZZY TOPSIS 4.1 INTRODUCTION The development of FAHP-TOPSIS and fuzzy TOPSIS for selection of maintenance strategy is elaborated in this chapter.

More information

EXCEL XR. Metering Pump. You can rely on LMI. EXCEL XR Communications Model

EXCEL XR. Metering Pump. You can rely on LMI. EXCEL XR Communications Model EXCEL XR Metering Pump EXCEL XR Communications Model You can rely on LMI TRUSTED BY CHEMICAL TREATMENT PR EXCEL XR METERING PUMP Introducing EXCEL XR chemical metering pumps: engineered to meet today s

More information

University of Florida CISE department Gator Engineering. Clustering Part 2

University of Florida CISE department Gator Engineering. Clustering Part 2 Clustering Part 2 Dr. Sanjay Ranka Professor Computer and Information Science and Engineering University of Florida, Gainesville Partitional Clustering Original Points A Partitional Clustering Hierarchical

More information

Design and Performance Improvements for Fault Detection in Tightly-Coupled Multi-Robot Team Tasks

Design and Performance Improvements for Fault Detection in Tightly-Coupled Multi-Robot Team Tasks Design and Performance Improvements for Fault Detection in Tightly-Coupled Multi-Robot Team Tasks Xingyan Li and Lynne E. Parker Distributed Intelligence Laboratory, Department of Electrical Engineering

More information

Gait analysis for person recognition using principal component analysis and support vector machines

Gait analysis for person recognition using principal component analysis and support vector machines Gait analysis for person recognition using principal component analysis and support vector machines O V Strukova 1, LV Shiripova 1 and E V Myasnikov 1 1 Samara National Research University, Moskovskoe

More information