Network Intrusion Detection Based on PSO-SVM
|
|
- Mabel Nelson
- 5 years ago
- Views:
Transcription
1 TELKOMNIKA Indonesan Journal of Electrcal Engneerng Vol.1, No., February 014, pp. 150 ~ 1508 DOI: Network Intruson Detecton Based on PSO-SVM Changsheng Xang* 1, Yong Xao, Pexn Qu 3, Xlong Qu 1 1 Department of Computer and Communcaton, Hunan Insttute of Engneerng, Xangtan , Chna, Orent Scence & Technology College of Hunan Agrcultural Unversty, Changsha, 418, Chna, 3 School of Informaton and Engneerng, Henan Insttute of Scence and Technology, Xnxang, , Chna, *Correspondng author, e-mal: cx543879@sohu.com*, Qupexn@163.com, quxlong@16.com Abstract In order to mprove network ntruson detecton precson, ths paper proposed a network ntruson detecton model based on smultaneous selectng features and parameters of support vector machne (SVM) by partcle swarm optmzaton (PSO) algorthm. Frstly, the features and parameters of SVM are coded to partcle, and then the PSO s used to fnd the optmal features and SVM parameters by collaboraton among partcles, lastly, the performance of the model was tested by KDD Cup 99 data. Compared wth other network models, the proposed model has reduced nput features for SVM and has sgnfcantly mproved the detecton precson of network ntruson. Keywords: network ntruson detecton, features selecton, model parameters, PSO Copyrght 014 Insttute of Advanced Engneerng and Scence. All rghts reserved. 1.Introducton Wth the tremendous growth of network-based servces and users of the Internet, t s mportant to keep the data and transactons n the Internet more secure. Intruson Detecton System (IDS) can detect the ntrusons of someone who s not authorzed to the present computer system automatcally, so Intruson detecton system has emerged as an essental component and an mportant technque for network securty. Support vector machnes (SVM) s a machne learnng method, t has shown growng popularty and has been successfully appled to network ntruson detecton [1]. Feature selecton s used to dentfy a powerfully classfed subset of network ntruson detecton features and reduces the number of features presented to the mnng process. By extractng as much nformaton as possble from a gven data set whle usng the smallest number of features, we can save sgnfcant computaton tme and establsh network ntruson detecton model that generalzes better for data set wth all of the features []. The dmenson of network features are very hgh and contans redundant and useless features, only a part of features nfluence the ntruson results, so these redundant and useless features need to deleton [3]. When SVM s used to establsh network ntruson detecton model, the parameters that should be selected nclude penalty parameter C and the kernel functon parameters [4]. When SVM s used to establsh network ntruson detecton model, n addton to the feature selecton, proper parameters settng can mprove the network ntruson detecton precson. These two problems are crucal n network ntruson detecton modelng, because the feature subset choce nfluences the approprate kernel parameters and vce versa [5]. Therefore, obtanng the optmal network ntruson detecton feature subset and SVM parameters must be selected smultaneously [6]. In the lterature, the Grd algorthm s an alternatve to select the best parameters of SVM, however, ths method s tme consumng and does not perform well [7]. Moreover, the Grd algorthm can not perform the feature selecton task. And a few algorthms have been proposed for network feature selecton such as GA (genetc algorthm), PSO (partcle swarm selecton) algorthm, and other algorthms [8]. However, these feature selecton algorthms focused on feature selecton and dd not deal wth parameters selecton for the SVM classfer. In order to mprove ntruson detecton precson, ths paper proposed a network ntruson detecton model (PSO-SVM) based on smultaneous selecton features and SVM Receved July 4, 013; Revsed August 9, 013; Accepted September 30, 013
2 TELKOMNIKA ISSN: parameters by PSO algorthm, and the performance of the model was tested by KDD Cup 99 data.. Research Method.1. Prncple of SVM Let the gven tranng data sets be represented by(x, y ), =1,,n, where x R d s an nput vector, y R s ts correspondng desred output, and n s the number of tranng data. In SVM a lnear functon s constructed: f ( x) t g( x) b (1) Where, ω s a coeffcent vector and b s a threshold. SVM learnng can be obtaned by the mnmzaton of the emprcal rsk on the tranng data, and the ε-ntensve loss functon s used for the mnmzaton of emprcal rsk. The loss functon s defned as: L ( x, y, f ) y f ( x) max(0, y f ( x) () Where, ε s a postve parameter. The emprcal rsk s: 1 n 1 R emp ( ) L ( y f( x )) (3) n Other than the ε-ntensve loss, SVM tres to reduce the model complexty by mnmzng and. Ths can be descrbed by slack varables.. Subsequently, the SVM approxmaton s obtaned as the followng selecton problem [9]. n 1 mn C ( ) (4) 1 Where, C s a postve constant to be regulated. By usng the Lagrange multpler method, the mnmzaton of formula (4) causes the problem of maxmzng the followng dual selecton. n n n 1 max y ( ) y ( ) ( )( ) K ( x, x ) (5) j j j 1 1, j1 are Lagrange multplers, and kernel K( x, x ) s a symmetrc functon, Where, and here the Gaussan functon s used as kernel. j x y K( x, y) exp( ) (6) Then the approxmaton functon s represented by Lagrange multplers, namely: P j (7) 1 f ( x) ( ) k( x, x ) b.. PSO Algorthm Inspred by the socal behavors of brd flockng, PSO algorthm was developed by Kennedy and Eberhat [10]. The partcle s endowed wth two factors: velocty and poston whch Network Intruson Detecton Based on PSO-SVM (Changsheng Xang)
3 1504 ISSN: can be regarded as the potental soluton n the D dmenson problem space. In PSO algorthm, they can be updated by followng formulas: v ( t 1) v ( t) c r p ( t) v ( t) c r p ( t) x ( t) (8) d d 1 1d d d d gd d x ( t 1) x ( t) vx ( t 1) (9), j, j, j Where, w s the nerta weght factor. r 1d and r d are two random numbers. v d (t) and x d (t) are the velocty and poston of the current partcle. p s called "personal best", and ts dth-dmensonal part s p d. The "global best" p g s the best poston found n the whole partcles. c 1, c are the acceleraton constants..3. Partcle Desgn When the Gaussan functon s selected as kernel functon, (C, σ) and features are used as nput attrbutes. Therefore, the partcle comprses four parts: C, σ and the features mask. In Fgure1, C 1 ~C represents parameter C, σ 1 ~σ j represents the parameter σ, f 1 ~f m represents the feature mask. In the feature mask, the bt wth value 1 represents the feature s selected, and 0 ndcates feature s not selected. Fgure 1. Partcle Desgn.4. Ftness Functon Detecton precson and the number of features are used to desgn a ftness functon. Thus, for the partcle wth hgh detecton precson and a small number of features produce a hgh ftness value. We solve the multple crtera problem by creatng a sngle objectve ftness functon that combnes the two goals nto one. As defned by formula (11), the ftness has two predefned weghts: () w a for the detecton precson, () w f for the summaton of the selected feature. 1 N f f wa Accwf f (10) 1 Where, Acc s the network ntruson precson, f s defned as follow: f 1 0 feature s selected feature s not selected (11).5. Desgn of the Mult-classfer for Network Intruson Detecton Fgure. Mult-classfer for Network Intruson Detecton TELKOMNIKA Vol. 1, No., February 014:
4 TELKOMNIKA ISSN: SVM s for two classfer, but the network ntruson has a varety of nvason type, thus network ntruson detecton s mult-classfy problem, so mult-classfer for network ntruson detecton s constructed by "one" to "one" way n ths paper, and s as shown n Fgure..6. The Steps of Network Intruson Detecton Step1: The network data are collected and the ntal features set are extracted. Step: The ntal partcles are produced randomly, whch represented parameters of SVM and feature subset. Step 3: The partcles are decoded the parameters of SVM and feature subset, and then the network ntruson detecton model s establshed based on to the correspondng parameters and feature subset, and calculates the network ntruson detecton precson, the ftness value s obtaned accordng to formula (10). Step 4: each partcle s ftness value s compared wth the P, f better, and then the partcle takes place the poston of P. Step 5: For each partcle, ts ftness value s compared wth the P g, f better, and then the partcle takes place the poston of P g. Step 6: The veloctes and postons of the partcles are updated accordng to formula (8) and (9). Step 7: The teratve process doesn t stop proceedng untl the number of teratons acheves the maxmum number of teratons (N max ), and the optmal partcle s decoded nto the optmal parameters of SVM and features subset. Step 8: The tranng samples are dealt accordng to the optmal features subset and are nput nto SVM to establsh the optmal ntruson detecton model accordng to the optmal parameters of SVM. The work flow chart of network ntruson detecton model s as followng: Fgure 3. The Flow Chart of Intruson Detecton Model 3. Results and Dscusson 3.1. Experment Data The experment data are from DD Cup 99, whch contan about 5,000,000 connectng records. There are four categores of attacks: DOS, RL, UR, Probng. The parameters of PSO algorthm are set as: the numbers of partcle k=0, w=1, c 1 =c =, N max =00. Network Intruson Detecton Based on PSO-SVM (Changsheng Xang)
5 1506 ISSN: Comparson Models and Evaluaton Crteron In order to make the detecton results of PSO-SVM comparable and persuasve, three comparson models are chosen, SVM1: whch features are selected by PSO algorthm whle the parameters of SVM are selected randomly, SVM: whch all of the features are selected whle the parameters of SVM parameters are selected by PSO algorthm, SVM3: whch the features are selected by PSO algorthm frstly, and then the parameters of SVM are select by PSO algorthm. The performances of models are evaluaton by precson, recall, and tran tmes Results and Analyss The PSO algorthm s a heurstc algorthm, the experment results are random. The numbers of features are appeared n 5 tmes experments, and the results are shown n Table 1. Table 1. The Appeared Tmes of Each Feature appeared tmes The number of feature 1 11, 14, 17, 19, 38, 16, 39 5, 8, 10, 13, 15, 18, 19,, 1, 7, 8, 37, 41 3, 3, 7, 9, 1, 36, 3, 6, 3, , 6, 0, 5, 9, 33, 34, , 4, precson(%) the number of experment Probe DoS UR the number of experment Fgure 4. The Detecton Precson and Recall of PSO-SVM 105 Probe DoS UR Probe DoS UR precson(%) 1 the number 3of experment 4 5 the number of experment Fgure 5. The Detecton Precson and Recall of SVM1 TELKOMNIKA Vol. 1, No., February 014:
6 TELKOMNIKA ISSN: precson(%) 1 the number 3 of experment 4 5 the number of experment Fgure 6. The Detecton Precson and Recall of SVM 105 precson(%) 1 the number 3of experment 4 5 the number of experment Fgure 7. The Detecton Precson and Recall of SVM3 In order to determne tmes of the features appeared have dfferent nfluence on the result of classfcaton, we carred out testng experments on three groups of features, the frst group: they appear fve tmes plus four attrbutes: 1, 4, 6, 0, 1, 5, 9, 31, 33, 34, 40. The second group: features appear fve tmes, four tmes and three tmes: 1,, 3, 4, 6, 7, 9, 1, 0, 3, 5, 6, 9, 31, 3, 33, 34, 35, 40. The thrd group: all of the 41 features. The results show that the optmal features are, 4, 9, 0, 1, 4, 9, 31, 33, 34, 40 and the correspondng optmal SVM parameter C =107.1, σ=1.05, n terms of classfcaton precson and tran tme. The optmal features subset and the optmal parameters of SVM are used to establsh to the network ntruson detecton model, the detecton results are shown n Fgure 4. The detecton results of comparson models SVM, SVM, SVM3 are shown n Fgure 5~7. In Matlab 01, the tc and toc are used to count tran tmes(s) of the all models, the results are shown n Table. Table. The Tranng Tmes of Dfferent Models ntruson type SVM1 SVM SVM3 PSO-SVM Probe DoS UR RL Normal Network Intruson Detecton Based on PSO-SVM (Changsheng Xang)
7 1508 ISSN: We can see from Fgure 3 that the PSO-SVM can obtan hgh network ntruson detecton precson and recall, and t s an effectve network ntruson detecton model. The expermental results n table and fgure ~6 are analyzed and concluson can be obtaned as followng: (1) compared wth the SVM1, SVM, SVM3, the network ntruson detecton tmes of PSO-SVM sgnfcantly are shortened, and detecton effcent s mproved, the experment results show that the PSO-SVM can fnd the optmal features subset and the parameters of SVM, and elmnates the useless and redundancy of network ntruson detecton features, reduces the nput vectors of the SVM and computatonal complexty s deceased, t can more meet the real-tme requrement wth network ntruson detecton. () Compared wth the SVM1, SVM, SVM3, PSO-SVM has mproved detecton precson and recall of network ntruson, the results show that, there s relaton between the network feature and SVM parameters, and they are selected smultaneously by PSO whch can acheve the optmal network features and parameters of SVM smultaneously, so the performance of network ntruson detecton model can be greatly mproved and ensure the safe of the network. 4. Concluson Good parameters of SVM and features set are very crucal for ntruson detecton model, and the paper proposed a network ntruson detecton model based on smultaneous selecton features and SVM parameters by PSO algorthm. The results showed that PSO-SVM has obtaned better performance than other models, whch parameters and features subset are selecton separately, PSO-SVM can elmnate the useless and redundancy of features and reduces the nput vectors of the SVM, and has mproved detecton precson of network ntruson detecton and has wde applcaton prospect n the feld of network securty. Acknowledgements Ths research was supported by Hunan Pro Natural Scence Foundaton (13JJ)and Hunan Scence & Technology Foundaton (013GK309). References [1] Dennng D. An Intruson Detecton Model. IEEE Transacton on Software Engneerng. 010; 13(): -3. [] Zhang XF, Zhao Y. Applcaton of Support Vector Machne to Relablty Analyss of Engne Systems. Telkomnka. 013; 11(7): [3] Khan L, Awad M, Thurasngham B. A new ntruson detecton system usng support vector machnes and herarchcal clusterng. The VLDB Journal. 007; 16(): [4] Palomo EJ, Domnguez E, Luque RM, et al. A new GHSOM model appled to network securty. Lecture Notes n Computer Scence Sprnger. 008; 51(18): [5] Durga Prasad, Nkhl Pal, Jyotrmoy Das. Genetc programmng for smultaneous feature selecton and classfer desgn. IEEE Transactons on Systems. 009; 36(1): [6] Huang ChengLung, Wang ChehJen. A GA-based feature selecton and parameters optmzaton for support vector machnes. Expert Systems wth Applcatons. 009; 31(): [7] Natesan P, Balasubramane P, Gowrson G. Improvng attack detecton rate n network ntruson detecton usng adaboost algorthm wth multple weak classfers. Journal of Informaton and Computatonal Scence. 01; 8(8): [8] Saravanan C, Shvsankar M. An optmzed feature selecton for ntruson detecton usng layered condtonal random felds wth MAFS. Internatonal Journal of Moble Network Communcatons & Telematcs. 011; 1(3): 79-. [9] Han FQ, L HM, et al. A new ncremental support vector machne algorthm. TELKOMNIKA Indonesan Journal of Electrcal Engneerng. 01; 10(6): [10] Je He, Hu Guo. A Modfed Partcle Swarm Optmzaton Algorthm. TELKOMNIKA Indonesan Journal of Electrcal Engneerng. 013; 11(11): TELKOMNIKA Vol. 1, No., February 014:
Learning the Kernel Parameters in Kernel Minimum Distance Classifier
Learnng the Kernel Parameters n Kernel Mnmum Dstance Classfer Daoqang Zhang 1,, Songcan Chen and Zh-Hua Zhou 1* 1 Natonal Laboratory for Novel Software Technology Nanjng Unversty, Nanjng 193, Chna Department
More informationThe Research of Support Vector Machine in Agricultural Data Classification
The Research of Support Vector Machne n Agrcultural Data Classfcaton Le Sh, Qguo Duan, Xnmng Ma, Me Weng College of Informaton and Management Scence, HeNan Agrcultural Unversty, Zhengzhou 45000 Chna Zhengzhou
More informationNUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS
ARPN Journal of Engneerng and Appled Scences 006-017 Asan Research Publshng Network (ARPN). All rghts reserved. NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS Igor Grgoryev, Svetlana
More informationSupport Vector Machines
/9/207 MIST.6060 Busness Intellgence and Data Mnng What are Support Vector Machnes? Support Vector Machnes Support Vector Machnes (SVMs) are supervsed learnng technques that analyze data and recognze patterns.
More informationDetermining the Optimal Bandwidth Based on Multi-criterion Fusion
Proceedngs of 01 4th Internatonal Conference on Machne Learnng and Computng IPCSIT vol. 5 (01) (01) IACSIT Press, Sngapore Determnng the Optmal Bandwdth Based on Mult-crteron Fuson Ha-L Lang 1+, Xan-Mn
More informationCluster Analysis of Electrical Behavior
Journal of Computer and Communcatons, 205, 3, 88-93 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/cc http://dx.do.org/0.4236/cc.205.350 Cluster Analyss of Electrcal Behavor Ln Lu Ln Lu, School
More informationSupport Vector Machines
Support Vector Machnes Decson surface s a hyperplane (lne n 2D) n feature space (smlar to the Perceptron) Arguably, the most mportant recent dscovery n machne learnng In a nutshell: map the data to a predetermned
More informationAn Improved Particle Swarm Optimization for Feature Selection
Journal of Bonc Engneerng 8 (20)?????? An Improved Partcle Swarm Optmzaton for Feature Selecton Yuannng Lu,2, Gang Wang,2, Hulng Chen,2, Hao Dong,2, Xaodong Zhu,2, Sujng Wang,2 Abstract. College of Computer
More informationOptimal Design of Nonlinear Fuzzy Model by Means of Independent Fuzzy Scatter Partition
Optmal Desgn of onlnear Fuzzy Model by Means of Independent Fuzzy Scatter Partton Keon-Jun Park, Hyung-Kl Kang and Yong-Kab Km *, Department of Informaton and Communcaton Engneerng, Wonkwang Unversty,
More informationAn Optimal Algorithm for Prufer Codes *
J. Software Engneerng & Applcatons, 2009, 2: 111-115 do:10.4236/jsea.2009.22016 Publshed Onlne July 2009 (www.scrp.org/journal/jsea) An Optmal Algorthm for Prufer Codes * Xaodong Wang 1, 2, Le Wang 3,
More informationProblem Definitions and Evaluation Criteria for Computational Expensive Optimization
Problem efntons and Evaluaton Crtera for Computatonal Expensve Optmzaton B. Lu 1, Q. Chen and Q. Zhang 3, J. J. Lang 4, P. N. Suganthan, B. Y. Qu 6 1 epartment of Computng, Glyndwr Unversty, UK Faclty
More informationTerm Weighting Classification System Using the Chi-square Statistic for the Classification Subtask at NTCIR-6 Patent Retrieval Task
Proceedngs of NTCIR-6 Workshop Meetng, May 15-18, 2007, Tokyo, Japan Term Weghtng Classfcaton System Usng the Ch-square Statstc for the Classfcaton Subtask at NTCIR-6 Patent Retreval Task Kotaro Hashmoto
More informationClassifier Selection Based on Data Complexity Measures *
Classfer Selecton Based on Data Complexty Measures * Edth Hernández-Reyes, J.A. Carrasco-Ochoa, and J.Fco. Martínez-Trndad Natonal Insttute for Astrophyscs, Optcs and Electroncs, Lus Enrque Erro No.1 Sta.
More informationA mathematical programming approach to the analysis, design and scheduling of offshore oilfields
17 th European Symposum on Computer Aded Process Engneerng ESCAPE17 V. Plesu and P.S. Agach (Edtors) 2007 Elsever B.V. All rghts reserved. 1 A mathematcal programmng approach to the analyss, desgn and
More informationJournal of Chemical and Pharmaceutical Research, 2014, 6(6): Research Article. A selective ensemble classification method on microarray data
Avalable onlne www.ocpr.com Journal of Chemcal and Pharmaceutcal Research, 2014, 6(6):2860-2866 Research Artcle ISSN : 0975-7384 CODEN(USA) : JCPRC5 A selectve ensemble classfcaton method on mcroarray
More informationRecommended Items Rating Prediction based on RBF Neural Network Optimized by PSO Algorithm
Recommended Items Ratng Predcton based on RBF Neural Network Optmzed by PSO Algorthm Chengfang Tan, Cayn Wang, Yuln L and Xx Q Abstract In order to mtgate the data sparsty and cold-start problems of recommendaton
More informationParallelism for Nested Loops with Non-uniform and Flow Dependences
Parallelsm for Nested Loops wth Non-unform and Flow Dependences Sam-Jn Jeong Dept. of Informaton & Communcaton Engneerng, Cheonan Unversty, 5, Anseo-dong, Cheonan, Chungnam, 330-80, Korea. seong@cheonan.ac.kr
More informationSolving two-person zero-sum game by Matlab
Appled Mechancs and Materals Onlne: 2011-02-02 ISSN: 1662-7482, Vols. 50-51, pp 262-265 do:10.4028/www.scentfc.net/amm.50-51.262 2011 Trans Tech Publcatons, Swtzerland Solvng two-person zero-sum game by
More informationA Clustering Algorithm Solution to the Collaborative Filtering
Internatonal Journal of Scence Vol.4 No.8 017 ISSN: 1813-4890 A Clusterng Algorthm Soluton to the Collaboratve Flterng Yongl Yang 1, a, Fe Xue, b, Yongquan Ca 1, c Zhenhu Nng 1, d,* Hafeng Lu 3, e 1 Faculty
More informationLoad-Balanced Anycast Routing
Load-Balanced Anycast Routng Chng-Yu Ln, Jung-Hua Lo, and Sy-Yen Kuo Department of Electrcal Engneerng atonal Tawan Unversty, Tape, Tawan sykuo@cc.ee.ntu.edu.tw Abstract For fault-tolerance and load-balance
More informationClassification / Regression Support Vector Machines
Classfcaton / Regresson Support Vector Machnes Jeff Howbert Introducton to Machne Learnng Wnter 04 Topcs SVM classfers for lnearly separable classes SVM classfers for non-lnearly separable classes SVM
More informationClustering Algorithm Combining CPSO with K-Means Chunqin Gu 1, a, Qian Tao 2, b
Internatonal Conference on Advances n Mechancal Engneerng and Industral Informatcs (AMEII 05) Clusterng Algorthm Combnng CPSO wth K-Means Chunqn Gu, a, Qan Tao, b Department of Informaton Scence, Zhongka
More informationBOOSTING CLASSIFICATION ACCURACY WITH SAMPLES CHOSEN FROM A VALIDATION SET
1 BOOSTING CLASSIFICATION ACCURACY WITH SAMPLES CHOSEN FROM A VALIDATION SET TZU-CHENG CHUANG School of Electrcal and Computer Engneerng, Purdue Unversty, West Lafayette, Indana 47907 SAUL B. GELFAND School
More informationCHAPTER 2 PROPOSED IMPROVED PARTICLE SWARM OPTIMIZATION
24 CHAPTER 2 PROPOSED IMPROVED PARTICLE SWARM OPTIMIZATION The present chapter proposes an IPSO approach for multprocessor task schedulng problem wth two classfcatons, namely, statc ndependent tasks and
More informationSubspace clustering. Clustering. Fundamental to all clustering techniques is the choice of distance measure between data points;
Subspace clusterng Clusterng Fundamental to all clusterng technques s the choce of dstance measure between data ponts; D q ( ) ( ) 2 x x = x x, j k = 1 k jk Squared Eucldean dstance Assumpton: All features
More informationResearch of Neural Network Classifier Based on FCM and PSO for Breast Cancer Classification
Research of Neural Network Classfer Based on FCM and PSO for Breast Cancer Classfcaton Le Zhang 1, Ln Wang 1, Xujewen Wang 2, Keke Lu 2, and Ajth Abraham 3 1 Shandong Provncal Key Laboratory of Network
More informationThe Study of Remote Sensing Image Classification Based on Support Vector Machine
Sensors & Transducers 03 by IFSA http://www.sensorsportal.com The Study of Remote Sensng Image Classfcaton Based on Support Vector Machne, ZHANG Jan-Hua Key Research Insttute of Yellow Rver Cvlzaton and
More informationPositive Semi-definite Programming Localization in Wireless Sensor Networks
Postve Sem-defnte Programmng Localzaton n Wreless Sensor etworks Shengdong Xe 1,, Jn Wang, Aqun Hu 1, Yunl Gu, Jang Xu, 1 School of Informaton Scence and Engneerng, Southeast Unversty, 10096, anjng Computer
More informationComplexity Analysis of Problem-Dimension Using PSO
Proceedngs of the 7th WSEAS Internatonal Conference on Evolutonary Computng, Cavtat, Croata, June -4, 6 (pp45-5) Complexty Analyss of Problem-Dmenson Usng PSO BUTHAINAH S. AL-KAZEMI AND SAMI J. HABIB,
More informationHigh-Boost Mesh Filtering for 3-D Shape Enhancement
Hgh-Boost Mesh Flterng for 3-D Shape Enhancement Hrokazu Yagou Λ Alexander Belyaev y Damng We z Λ y z ; ; Shape Modelng Laboratory, Unversty of Azu, Azu-Wakamatsu 965-8580 Japan y Computer Graphcs Group,
More informationCHAPTER 3 SEQUENTIAL MINIMAL OPTIMIZATION TRAINED SUPPORT VECTOR CLASSIFIER FOR CANCER PREDICTION
48 CHAPTER 3 SEQUENTIAL MINIMAL OPTIMIZATION TRAINED SUPPORT VECTOR CLASSIFIER FOR CANCER PREDICTION 3.1 INTRODUCTION The raw mcroarray data s bascally an mage wth dfferent colors ndcatng hybrdzaton (Xue
More informationOptimizing SVR using Local Best PSO for Software Effort Estimation
Journal of Informaton Technology and Computer Scence Volume 1, Number 1, 2016, pp. 28 37 Journal Homepage: www.jtecs.ub.ac.d Optmzng SVR usng Local Best PSO for Software Effort Estmaton Dnda Novtasar 1,
More informationTsinghua University at TAC 2009: Summarizing Multi-documents by Information Distance
Tsnghua Unversty at TAC 2009: Summarzng Mult-documents by Informaton Dstance Chong Long, Mnle Huang, Xaoyan Zhu State Key Laboratory of Intellgent Technology and Systems, Tsnghua Natonal Laboratory for
More informationClassifier Swarms for Human Detection in Infrared Imagery
Classfer Swarms for Human Detecton n Infrared Imagery Yur Owechko, Swarup Medasan, and Narayan Srnvasa HRL Laboratores, LLC 3011 Malbu Canyon Road, Malbu, CA 90265 {owechko, smedasan, nsrnvasa}@hrl.com
More informationSmoothing Spline ANOVA for variable screening
Smoothng Splne ANOVA for varable screenng a useful tool for metamodels tranng and mult-objectve optmzaton L. Rcco, E. Rgon, A. Turco Outlne RSM Introducton Possble couplng Test case MOO MOO wth Game Theory
More informationFace Recognition Based on SVM and 2DPCA
Vol. 4, o. 3, September, 2011 Face Recognton Based on SVM and 2DPCA Tha Hoang Le, Len Bu Faculty of Informaton Technology, HCMC Unversty of Scence Faculty of Informaton Scences and Engneerng, Unversty
More informationMaximum Variance Combined with Adaptive Genetic Algorithm for Infrared Image Segmentation
Internatonal Conference on Logstcs Engneerng, Management and Computer Scence (LEMCS 5) Maxmum Varance Combned wth Adaptve Genetc Algorthm for Infrared Image Segmentaton Huxuan Fu College of Automaton Harbn
More informationCorrelative features for the classification of textural images
Correlatve features for the classfcaton of textural mages M A Turkova 1 and A V Gadel 1, 1 Samara Natonal Research Unversty, Moskovskoe Shosse 34, Samara, Russa, 443086 Image Processng Systems Insttute
More informationApplication of Clustering Algorithm in Big Data Sample Set Optimization
Applcaton of Clusterng Algorthm n Bg Data Sample Set Optmzaton Yutang Lu 1, Qn Zhang 2 1 Department of Basc Subjects, Henan Insttute of Technology, Xnxang 453002, Chna 2 School of Mathematcs and Informaton
More informationUsing Neural Networks and Support Vector Machines in Data Mining
Usng eural etworks and Support Vector Machnes n Data Mnng RICHARD A. WASIOWSKI Computer Scence Department Calforna State Unversty Domnguez Hlls Carson, CA 90747 USA Abstract: - Multvarate data analyss
More informationImage Feature Selection Based on Ant Colony Optimization
Image Feature Selecton Based on Ant Colony Optmzaton Lng Chen,2, Bolun Chen, Yxn Chen 3, Department of Computer Scence, Yangzhou Unversty,Yangzhou, Chna 2 State Key Lab of Novel Software Tech, Nanng Unversty,
More informationEVALUATION OF THE PERFORMANCES OF ARTIFICIAL BEE COLONY AND INVASIVE WEED OPTIMIZATION ALGORITHMS ON THE MODIFIED BENCHMARK FUNCTIONS
Academc Research Internatonal ISS-L: 3-9553, ISS: 3-9944 Vol., o. 3, May 0 EVALUATIO OF THE PERFORMACES OF ARTIFICIAL BEE COLOY AD IVASIVE WEED OPTIMIZATIO ALGORITHMS O THE MODIFIED BECHMARK FUCTIOS Dlay
More informationA Simple Methodology for Database Clustering. Hao Tang 12 Guangdong University of Technology, Guangdong, , China
for Database Clusterng Guangdong Unversty of Technology, Guangdong, 0503, Chna E-mal: 6085@qq.com Me Zhang Guangdong Unversty of Technology, Guangdong, 0503, Chna E-mal:64605455@qq.com Database clusterng
More informationCracking of the Merkle Hellman Cryptosystem Using Genetic Algorithm
Crackng of the Merkle Hellman Cryptosystem Usng Genetc Algorthm Zurab Kochladze 1 * & Lal Besela 2 1 Ivane Javakhshvl Tbls State Unversty, 1, I.Chavchavadze av 1, 0128, Tbls, Georga 2 Sokhum State Unversty,
More informationOutline. Discriminative classifiers for image recognition. Where in the World? A nearest neighbor recognition example 4/14/2011. CS 376 Lecture 22 1
4/14/011 Outlne Dscrmnatve classfers for mage recognton Wednesday, Aprl 13 Krsten Grauman UT-Austn Last tme: wndow-based generc obect detecton basc ppelne face detecton wth boostng as case study Today:
More informationIncremental Learning with Support Vector Machines and Fuzzy Set Theory
The 25th Workshop on Combnatoral Mathematcs and Computaton Theory Incremental Learnng wth Support Vector Machnes and Fuzzy Set Theory Yu-Mng Chuang 1 and Cha-Hwa Ln 2* 1 Department of Computer Scence and
More informationDesign of Structure Optimization with APDL
Desgn of Structure Optmzaton wth APDL Yanyun School of Cvl Engneerng and Archtecture, East Chna Jaotong Unversty Nanchang 330013 Chna Abstract In ths paper, the desgn process of structure optmzaton wth
More informationMeta-heuristics for Multidimensional Knapsack Problems
2012 4th Internatonal Conference on Computer Research and Development IPCSIT vol.39 (2012) (2012) IACSIT Press, Sngapore Meta-heurstcs for Multdmensonal Knapsack Problems Zhbao Man + Computer Scence Department,
More informationA Deflected Grid-based Algorithm for Clustering Analysis
A Deflected Grd-based Algorthm for Clusterng Analyss NANCY P. LIN, CHUNG-I CHANG, HAO-EN CHUEH, HUNG-JEN CHEN, WEI-HUA HAO Department of Computer Scence and Informaton Engneerng Tamkang Unversty 5 Yng-chuan
More informationAn Improved Image Segmentation Algorithm Based on the Otsu Method
3th ACIS Internatonal Conference on Software Engneerng, Artfcal Intellgence, Networkng arallel/dstrbuted Computng An Improved Image Segmentaton Algorthm Based on the Otsu Method Mengxng Huang, enjao Yu,
More informationImproving Classifier Fusion Using Particle Swarm Optimization
Proceedngs of the 7 IEEE Symposum on Computatonal Intellgence n Multcrtera Decson Makng (MCDM 7) Improvng Classfer Fuson Usng Partcle Swarm Optmzaton Kalyan Veeramachanen Dept. of EECS Syracuse Unversty
More informationSum of Linear and Fractional Multiobjective Programming Problem under Fuzzy Rules Constraints
Australan Journal of Basc and Appled Scences, 2(4): 1204-1208, 2008 ISSN 1991-8178 Sum of Lnear and Fractonal Multobjectve Programmng Problem under Fuzzy Rules Constrants 1 2 Sanjay Jan and Kalash Lachhwan
More informationK-means Optimization Clustering Algorithm Based on Hybrid PSO/GA Optimization and CS validity index
Orgnal Artcle Prnt ISSN: 3-6379 Onlne ISSN: 3-595X DOI: 0.7354/jss/07/33 K-means Optmzaton Clusterng Algorthm Based on Hybrd PSO/GA Optmzaton and CS valdty ndex K Jahanbn *, F Rahmanan, H Rezae 3, Y Farhang
More informationBAYESIAN MULTI-SOURCE DOMAIN ADAPTATION
BAYESIAN MULTI-SOURCE DOMAIN ADAPTATION SHI-LIANG SUN, HONG-LEI SHI Department of Computer Scence and Technology, East Chna Normal Unversty 500 Dongchuan Road, Shangha 200241, P. R. Chna E-MAIL: slsun@cs.ecnu.edu.cn,
More informationA Notable Swarm Approach to Evolve Neural Network for Classification in Data Mining
A Notable Swarm Approach to Evolve Neural Network for Classfcaton n Data Mnng Satchdananda Dehur 1, Bjan Bhar Mshra 2 and Sung-Bae Cho 1 1 Soft Computng Laboratory, Department of Computer Scence, Yonse
More informationEYE CENTER LOCALIZATION ON A FACIAL IMAGE BASED ON MULTI-BLOCK LOCAL BINARY PATTERNS
P.G. Demdov Yaroslavl State Unversty Anatoly Ntn, Vladmr Khryashchev, Olga Stepanova, Igor Kostern EYE CENTER LOCALIZATION ON A FACIAL IMAGE BASED ON MULTI-BLOCK LOCAL BINARY PATTERNS Yaroslavl, 2015 Eye
More informationComplex System Reliability Evaluation using Support Vector Machine for Incomplete Data-set
Internatonal Journal of Performablty Engneerng, Vol. 7, No. 1, January 2010, pp.32-42. RAMS Consultants Prnted n Inda Complex System Relablty Evaluaton usng Support Vector Machne for Incomplete Data-set
More informationSVM-based Learning for Multiple Model Estimation
SVM-based Learnng for Multple Model Estmaton Vladmr Cherkassky and Yunqan Ma Department of Electrcal and Computer Engneerng Unversty of Mnnesota Mnneapols, MN 55455 {cherkass,myq}@ece.umn.edu Abstract:
More informationSupport Vector Machines. CS534 - Machine Learning
Support Vector Machnes CS534 - Machne Learnng Perceptron Revsted: Lnear Separators Bnar classfcaton can be veed as the task of separatng classes n feature space: b > 0 b 0 b < 0 f() sgn( b) Lnear Separators
More informationAssociative Based Classification Algorithm For Diabetes Disease Prediction
Internatonal Journal of Engneerng Trends and Technology (IJETT) Volume-41 Number-3 - November 016 Assocatve Based Classfcaton Algorthm For Dabetes Dsease Predcton 1 N. Gnana Deepka, Y.surekha, 3 G.Laltha
More informationJapanese Dependency Analysis Based on Improved SVM and KNN
Proceedngs of the 7th WSEAS Internatonal Conference on Smulaton, Modellng and Optmzaton, Bejng, Chna, September 15-17, 2007 140 Japanese Dependency Analyss Based on Improved SVM and KNN ZHOU HUIWEI and
More informationContent Based Image Retrieval Using 2-D Discrete Wavelet with Texture Feature with Different Classifiers
IOSR Journal of Electroncs and Communcaton Engneerng (IOSR-JECE) e-issn: 78-834,p- ISSN: 78-8735.Volume 9, Issue, Ver. IV (Mar - Apr. 04), PP 0-07 Content Based Image Retreval Usng -D Dscrete Wavelet wth
More informationAn Image Fusion Approach Based on Segmentation Region
Rong Wang, L-Qun Gao, Shu Yang, Yu-Hua Cha, and Yan-Chun Lu An Image Fuson Approach Based On Segmentaton Regon An Image Fuson Approach Based on Segmentaton Regon Rong Wang, L-Qun Gao, Shu Yang 3, Yu-Hua
More informationProfessional competences training path for an e-commerce major, based on the ISM method
World Transactons on Engneerng and Technology Educaton Vol.14, No.4, 2016 2016 WIETE Professonal competences tranng path for an e-commerce maor, based on the ISM method Ru Wang, Pn Peng, L-gang Lu & Lng
More informationA hybrid sequential approach for data clustering using K-Means and particle swarm optimization algorithm
MultCraft Internatonal Journal of Engneerng, Scence and Technology Vol., No. 6, 00, pp. 67-76 INTERNATIONAL JOURNAL OF ENGINEERING, SCIENCE AND TECHNOLOGY www.jest-ng.com 00 MultCraft Lmted. All rghts
More informationAn Evolvable Clustering Based Algorithm to Learn Distance Function for Supervised Environment
IJCSI Internatonal Journal of Computer Scence Issues, Vol. 7, Issue 5, September 2010 ISSN (Onlne): 1694-0814 www.ijcsi.org 374 An Evolvable Clusterng Based Algorthm to Learn Dstance Functon for Supervsed
More informationSpam Filtering Based on Support Vector Machines with Taguchi Method for Parameter Selection
E-mal Spam Flterng Based on Support Vector Machnes wth Taguch Method for Parameter Selecton We-Chh Hsu, Tsan-Yng Yu E-mal Spam Flterng Based on Support Vector Machnes wth Taguch Method for Parameter Selecton
More informationVirtual Machine Migration based on Trust Measurement of Computer Node
Appled Mechancs and Materals Onlne: 2014-04-04 ISSN: 1662-7482, Vols. 536-537, pp 678-682 do:10.4028/www.scentfc.net/amm.536-537.678 2014 Trans Tech Publcatons, Swtzerland Vrtual Machne Mgraton based on
More informationFace Recognition Method Based on Within-class Clustering SVM
Face Recognton Method Based on Wthn-class Clusterng SVM Yan Wu, Xao Yao and Yng Xa Department of Computer Scence and Engneerng Tong Unversty Shangha, Chna Abstract - A face recognton method based on Wthn-class
More informationMULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION
MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION Paulo Quntlano 1 & Antono Santa-Rosa 1 Federal Polce Department, Brasla, Brazl. E-mals: quntlano.pqs@dpf.gov.br and
More informationFeature Reduction and Selection
Feature Reducton and Selecton Dr. Shuang LIANG School of Software Engneerng TongJ Unversty Fall, 2012 Today s Topcs Introducton Problems of Dmensonalty Feature Reducton Statstc methods Prncpal Components
More informationAn Iterative Solution Approach to Process Plant Layout using Mixed Integer Optimisation
17 th European Symposum on Computer Aded Process Engneerng ESCAPE17 V. Plesu and P.S. Agach (Edtors) 2007 Elsever B.V. All rghts reserved. 1 An Iteratve Soluton Approach to Process Plant Layout usng Mxed
More informationRelated-Mode Attacks on CTR Encryption Mode
Internatonal Journal of Network Securty, Vol.4, No.3, PP.282 287, May 2007 282 Related-Mode Attacks on CTR Encrypton Mode Dayn Wang, Dongda Ln, and Wenlng Wu (Correspondng author: Dayn Wang) Key Laboratory
More informationNatural Computing. Lecture 13: Particle swarm optimisation INFR /11/2010
Natural Computng Lecture 13: Partcle swarm optmsaton Mchael Herrmann mherrman@nf.ed.ac.uk phone: 0131 6 517177 Informatcs Forum 1.42 INFR09038 5/11/2010 Swarm ntellgence Collectve ntellgence: A super-organsm
More informationAn Influence of the Noise on the Imaging Algorithm in the Electrical Impedance Tomography *
Open Journal of Bophyscs, 3, 3, 7- http://dx.do.org/.436/ojbphy.3.347 Publshed Onlne October 3 (http://www.scrp.org/journal/ojbphy) An Influence of the Nose on the Imagng Algorthm n the Electrcal Impedance
More informationModule Management Tool in Software Development Organizations
Journal of Computer Scence (5): 8-, 7 ISSN 59-66 7 Scence Publcatons Management Tool n Software Development Organzatons Ahmad A. Al-Rababah and Mohammad A. Al-Rababah Faculty of IT, Al-Ahlyyah Amman Unversty,
More informationSLAM Summer School 2006 Practical 2: SLAM using Monocular Vision
SLAM Summer School 2006 Practcal 2: SLAM usng Monocular Vson Javer Cvera, Unversty of Zaragoza Andrew J. Davson, Imperal College London J.M.M Montel, Unversty of Zaragoza. josemar@unzar.es, jcvera@unzar.es,
More informationEdge Detection in Noisy Images Using the Support Vector Machines
Edge Detecton n Nosy Images Usng the Support Vector Machnes Hlaro Gómez-Moreno, Saturnno Maldonado-Bascón, Francsco López-Ferreras Sgnal Theory and Communcatons Department. Unversty of Alcalá Crta. Madrd-Barcelona
More informationA Two-Stage Algorithm for Data Clustering
A Two-Stage Algorthm for Data Clusterng Abdolreza Hatamlou 1 and Salwan Abdullah 2 1 Islamc Azad Unversty, Khoy Branch, Iran 2 Data Mnng and Optmsaton Research Group, Center for Artfcal Intellgence Technology,
More informationAvailable online at Available online at Advanced in Control Engineering and Information Science
Avalable onlne at wwwscencedrectcom Avalable onlne at wwwscencedrectcom Proceda Proceda Engneerng Engneerng 00 (2011) 15000 000 (2011) 1642 1646 Proceda Engneerng wwwelsevercom/locate/proceda Advanced
More informationEfficient Text Classification by Weighted Proximal SVM *
Effcent ext Classfcaton by Weghted Proxmal SVM * Dong Zhuang 1, Benyu Zhang, Qang Yang 3, Jun Yan 4, Zheng Chen, Yng Chen 1 1 Computer Scence and Engneerng, Bejng Insttute of echnology, Bejng 100081, Chna
More informationOptimizing Document Scoring for Query Retrieval
Optmzng Document Scorng for Query Retreval Brent Ellwen baellwe@cs.stanford.edu Abstract The goal of ths project was to automate the process of tunng a document query engne. Specfcally, I used machne learnng
More informationAPPLICATION OF MULTIVARIATE LOSS FUNCTION FOR ASSESSMENT OF THE QUALITY OF TECHNOLOGICAL PROCESS MANAGEMENT
3. - 5. 5., Brno, Czech Republc, EU APPLICATION OF MULTIVARIATE LOSS FUNCTION FOR ASSESSMENT OF THE QUALITY OF TECHNOLOGICAL PROCESS MANAGEMENT Abstract Josef TOŠENOVSKÝ ) Lenka MONSPORTOVÁ ) Flp TOŠENOVSKÝ
More informationEfficient Segmentation and Classification of Remote Sensing Image Using Local Self Similarity
ISSN(Onlne): 2320-9801 ISSN (Prnt): 2320-9798 Internatonal Journal of Innovatve Research n Computer and Communcaton Engneerng (An ISO 3297: 2007 Certfed Organzaton) Vol.2, Specal Issue 1, March 2014 Proceedngs
More informationA fast algorithm for color image segmentation
Unersty of Wollongong Research Onlne Faculty of Informatcs - Papers (Arche) Faculty of Engneerng and Informaton Scences 006 A fast algorthm for color mage segmentaton L. Dong Unersty of Wollongong, lju@uow.edu.au
More informationIntra-Parametric Analysis of a Fuzzy MOLP
Intra-Parametrc Analyss of a Fuzzy MOLP a MIAO-LING WANG a Department of Industral Engneerng and Management a Mnghsn Insttute of Technology and Hsnchu Tawan, ROC b HSIAO-FAN WANG b Insttute of Industral
More informationChinese Word Segmentation based on the Improved Particle Swarm Optimization Neural Networks
Chnese Word Segmentaton based on the Improved Partcle Swarm Optmzaton Neural Networks Ja He Computatonal Intellgence Laboratory School of Computer Scence and Engneerng, UESTC Chengdu, Chna Department of
More informationOutline. Type of Machine Learning. Examples of Application. Unsupervised Learning
Outlne Artfcal Intellgence and ts applcatons Lecture 8 Unsupervsed Learnng Professor Danel Yeung danyeung@eee.org Dr. Patrck Chan patrckchan@eee.org South Chna Unversty of Technology, Chna Introducton
More informationStudy of Data Stream Clustering Based on Bio-inspired Model
, pp.412-418 http://dx.do.org/10.14257/astl.2014.53.86 Study of Data Stream lusterng Based on Bo-nspred Model Yngme L, Mn L, Jngbo Shao, Gaoyang Wang ollege of omputer Scence and Informaton Engneerng,
More informationControl strategies for network efficiency and resilience with route choice
Control strateges for networ effcency and reslence wth route choce Andy Chow Ru Sha Centre for Transport Studes Unversty College London, UK Centralsed strateges UK 1 Centralsed strateges Some effectve
More informationFast Feature Value Searching for Face Detection
Vol., No. 2 Computer and Informaton Scence Fast Feature Value Searchng for Face Detecton Yunyang Yan Department of Computer Engneerng Huayn Insttute of Technology Hua an 22300, Chna E-mal: areyyyke@63.com
More informationFuzzy Modeling of the Complexity vs. Accuracy Trade-off in a Sequential Two-Stage Multi-Classifier System
Fuzzy Modelng of the Complexty vs. Accuracy Trade-off n a Sequental Two-Stage Mult-Classfer System MARK LAST 1 Department of Informaton Systems Engneerng Ben-Guron Unversty of the Negev Beer-Sheva 84105
More informationConcurrent Apriori Data Mining Algorithms
Concurrent Apror Data Mnng Algorthms Vassl Halatchev Department of Electrcal Engneerng and Computer Scence York Unversty, Toronto October 8, 2015 Outlne Why t s mportant Introducton to Assocaton Rule Mnng
More informationCourse Introduction. Algorithm 8/31/2017. COSC 320 Advanced Data Structures and Algorithms. COSC 320 Advanced Data Structures and Algorithms
Course Introducton Course Topcs Exams, abs, Proects A quc loo at a few algorthms 1 Advanced Data Structures and Algorthms Descrpton: We are gong to dscuss algorthm complexty analyss, algorthm desgn technques
More informationClassifying Acoustic Transient Signals Using Artificial Intelligence
Classfyng Acoustc Transent Sgnals Usng Artfcal Intellgence Steve Sutton, Unversty of North Carolna At Wlmngton (suttons@charter.net) Greg Huff, Unversty of North Carolna At Wlmngton (jgh7476@uncwl.edu)
More informationParameters Optimization of SVM Based on Improved FOA and Its Application in Fault Diagnosis
Parameters Optmzaton of SVM Based on Improved FOA and Its Applcaton n Fault Dagnoss Qantu Zhang1*, Lqng Fang1, Sca Su, Yan Lv1 1 Frst Department, Mechancal Engneerng College, Shjazhuang, Hebe Provnce,
More informationMulti-objective Virtual Machine Placement for Load Balancing
Mult-obectve Vrtual Machne Placement for Load Balancng Feng FANG and Bn-Bn Qu,a School of Computer Scence & Technology, Huazhong Unversty Of Scence And Technology, Wuhan, Chna Abstract. The vrtual machne
More informationUnsupervised Learning
Pattern Recognton Lecture 8 Outlne Introducton Unsupervsed Learnng Parametrc VS Non-Parametrc Approach Mxture of Denstes Maxmum-Lkelhood Estmates Clusterng Prof. Danel Yeung School of Computer Scence and
More informationMethod of Wireless Sensor Network Data Fusion
Method of Wreless Sensor Network Data Fuson https://do.org/10.3991/joe.v1309.7589 L-l Ma!! ", Jang-png Lu Inner Mongola Agrcultural Unversty, Hohhot, Inner Mongola, Chna lujangpng@mau.edu.cn J-dong Luo
More informationAn Anti-Noise Text Categorization Method based on Support Vector Machines *
An Ant-Nose Text ategorzaton Method based on Support Vector Machnes * hen Ln, Huang Je and Gong Zheng-Hu School of omputer Scence, Natonal Unversty of Defense Technology, hangsha, 410073, hna chenln@nudt.edu.cn,
More information