THE CONDENSED FUZZY K-NEAREST NEIGHBOR RULE BASED ON SAMPLE FUZZY ENTROPY
|
|
- Randall Barker
- 5 years ago
- Views:
Transcription
1 Proceedngs of the 20 Internatonal Conference on Machne Learnng and Cybernetcs, Guln, 0-3 July, 20 THE CONDENSED FUZZY K-NEAREST NEIGHBOR RULE BASED ON SAMPLE FUZZY ENTROPY JUN-HAI ZHAI, NA LI, MENG-YAO ZHAI Key Lab. of Machne Learnng and Comutatonal Intellgenceollege of Mathematcs and Comuter Scence, Hebe Unversty, Baodng 07002hna Abstract: The fuzzy k-nearest neghbor (F-KNN algorthm was orgnally develoed by Keller n 985, whch generalzed the k-nearest neghbor (KNN algorthm and could overcome the drawback of KNN n whch all of nstances were consdered equally mortant. However, the F-KNN algorthm stll suffers from the roblem of large memory requrement same as the KNN. In order to deal wth the roblem, ths aer rooses the condensed fuzzy k-nearest neghbor rule (CFKNN whch selects the mortant nstances based on samle fuzzy entroy. The exermental results show that our roosed method s feasble and effectve. Keywords: Nearest neghbor; Condensed nearest neghbor; Fuzzy nearest neghbor; Instance selecton; Samle fuzzy entroy. Introducton The nearest neghbor rule (NN was orgnally roosed by Cover and Hart[l]and s wdely used n many felds such as attern recognton[2], data mnng[3], and machne learnng[4-7]. The reasons for the use of ths rule are ts concetual smlcty and easy to understand. However, the nearest neghbor rule suffers from the followng three roblems: ( To classfy a test nstance x, t s requred to store all nstances n tranng set,.e. the comutatonal sace comlexty s O ( n, where n s the number of nstances n tranng set; (2 The dstances between x and all nstances n tranng set are needed to comute,.e. the comutatonal tme comlexty s also O ( n ; (3 Each of the tranng samles s gven equal mortance n classfyng an unseen samle, regardless of ther dfferent contrbuton to classfcaton. In order to deal wth the roblems mentoned above, many researchers dd a great deal of research works. Hart roosed the condensed nearest neghbor rule (CNN to deal wth the roblem ( and (2 [8]. Keller roosed F-KNN algorthm to deal wth the roblem (3 [9]. However, F-KNN algorthm stll suffers from the roblem ( and (2. In ths aer, we roose the method of the condensed fuzzy nearest neghbor rule (CFKNN based on samle fuzzy entroy. The exermental results show that the roosed method s feasble and effectve. The aer s organzed as follows. Prelmnares on our roosed method are gven n secton 2. In secton 3 the CFNN s resented and exermental results and analyss are rovded n Secton 4, Secton 5 concludes the aer. 2. Prelmnares In ths secton, we wll ntroduce several basc concets and algorthms related to our method, manly ncludng the concet of decson table, fuzzy entroy, the algorthm used for determnng the fuzzy membersh degree of nstances n tranng set, and the FNN algorthm. Defnton A decson table (DT n short s a 2-tule DT = ( U, A C where U = { x, x, 2, x N } s a non-emty fnte set of obects (nstances called tranng set and A s a set of real-valued condtonal attrbutes. C s the decson attrbute, wthout loss of generalty we suose that the nstances n U are classfed nto categores C 2,. Defnton 2 Gven a decson DT = ( U, A C, x U, C ( n;, let μ ( x be the fuzzy membersh degree of nstance x belong to class C, the fuzzy entroy of nstance x s defned as follows Entr ( x = ( x log 2 μ( x = μ ( //$ IEEE 282
2 Proceedngs of the 20 Internatonal Conference on Machne Learnng and Cybernetcs, Guln, 0-3 July, 20 where the ( x, μ C denotes the fuzzy membersh degree of nstances belong to class C. In ths aer, we use the followng algorthm to determne the fuzzy membersh degree of nstances n tranng set U [0]. Algorthm Inut: A DT wth real-valued condtonal attrbutes. Outut: the fuzzy membersh degree of nstances. STEP : For each class C, calculatng the center c of class C ; STEP 2: For each nstance x U ( n the dstance x and ( d between STEP 3: For each nstance membersh degree ( x 2 ( ( d x = 2 ( d =, calculatng x U C μ as follows, ;, calculatng the fuzzy μ (2 For the convenence, we lst the F-KNN algorthm as follows. Algorthm 2 Inut: A DT wth real-valued condtonal attrbutes, and a test nstance x. Outut: Fuzzy K-nearest neghbor rule. STEP : Intalze K=K 0 ; STEP 2: For each test x, found K-nearest neghbors of x n DT; STEP 2. Intalze =; STEP 2.2 Do STEP 2.3 Comute dstance from x to x ; STEP 2.4 IF ( K 0 THEN Include x n the set of K 0 -nearest neghbors; ELSE IF (x closer to x than any revous nearest neghbor THEN Delete the farthest of the k-nearest neghbors; Include x n the set of K 0 -nearest neghbors; STEP 3: For each test x, comute μ ( x,c usng formula (2 and (3; ( x C K0 μ( x =, = K 0 = x x x x 2 m 2 m μ (3 3. The Condensed Fuzzy K-Nearest Neghbor Rule Based on Samle Fuzzy Entroy In ths secton, we wll resent our method of the CFKNN, In KNN and F-KNN, the roblem of hgh comutatonal comlexty s encountered unavodably due to storng all nstances n tranng set. In fact, for a gven fuzzy nformaton system, dfferent nstance n tranng set has dfferent mortant degree, and has dfferent contrbuton to classfcaton. Some nstances may be more mortant than the others. In our method we select the set of the mortant samles based on the fuzzy entroy of the samle n tranng set. The bgger the fuzzy entroy s, the more mortant the samle, because the samle wth bgger fuzzy entroy can rovde more nformaton for classfcaton and they are closer to the boundares of class. So the set of the mortant samles usually contans the same nformaton wth orgnal dataset n classfcaton. If the mortant samle set s used as tranng set to classfy an unseen test samle, the effcency of classfcaton can be ncreased, and comutatonal comlexty degree can be decreased. In the followng, we rovde the CFKNN algorthm for our method roosed above. Algorthm 3 Inut: a DT, arameter K and α (suose DT =n, and the samles n T are classfed nto classes Outut: S DT STEP : For each nstance x DT, d determne the fuzzy membersh degree of x wth (2; STEP 2: Randomly select one nstance belongng to each class from tranng set, and ut the selected samles nto S. STEP 3: Reeat the followng rocess for each x remaned n DT. STEP 3.: Fnd K nearest neghbors n S; STEP 3.2: Determne the class membersh degree of x wth (3 ( μ( x, μ( x, C2,, μ( x, C ; STEP 3.3: Comute the fuzzy entroy of nstance x 283
3 Proceedngs of the 20 Internatonal Conference on Machne Learnng and Cybernetcs, Guln, 0-3 July, 20 wth ( Entr( x = μ ( x log 2 μ( x ; = STEP 3.4: If Entr( x > α dscard x; STEP 3: Return S. 4. Exermental results then S=S{x}; Else The effectveness of our roosed method s demonstrated through numercal exerments n the envronment of Matlab 7.0 on a Pentum 4 PC. In our exerments we totally select 9 datasets ncludng 7 UCI datasets [8] and 2 real world datasets []. The 7 UCI datasets are Irs Dataset, Breast Cancer Dataset-WDBC, Breast Cancer Dataset-WPBC, Glass Dataset, Image Segmentaton Dataset, Parknsons Dataset, Pma Dataset. The 2 real world datasets are CT Image Dataset and RenRu Dataset. The CT Dataset s obtaned by collectng 22 medcal CT mages from Baodng local hostal. All nstances wth 35 numercal attrbutes are classfed nto 2 classes (.e., normal class and abnormal class. The RenRu Dataset s created by the key laboratory of machne learnng and comutatonal ntellgence of Hebe Provncehna. The RenRu Dataset s obtaned by collectng 48 Chnese characters REN and RU wth dfferent tyeface, font and sze, n whch there are 92 Chnese characters REN and 56 Chnese characters RU. For each Chnese character, t s descrbed by 26 numercal features. The basc nformaton of the 0 datasets s lsted n table. In the exerment, we set K=5, and randomly select 70% data n each dataset as tranng set, other 30% data as testng set, For each dataset, we run 0-fold cross-valdaton ten tmes, the exermental results are the average of the 0 oututs and lsted n table 2. The exermental results demonstrate that the roosed method s effectve and effcent. In the exerment, we also exlore the relaton between the value of α and the testng accuracy n CFKNN. We change the arameterα from 0.5 to.0, and each tme adds Wth α set to dfferent values we record the classfcaton accuraces of the CFKNN, the changng curves are shown n fgure. From the curves, we can see that the value of α does affect the classfcaton result. For Irs dataset, t s arorate for α take values n the nterval [0.5, 0.75]. For WDBC and WDBC dataset, the arorate nterval s [0.5, 0.7] and [0.5, 0.85] resectvely. For the other datasets, t s arorate for α take values n the nterval [0.5, 0.95]. In addton, n the exerment, we study the relatonsh between the value of α and the number of nstances selected by CFKNN. The curves descrbng the relatonsh between α and the number of nstances selected are obtaned and shown n fgure 2. From the curves, we have observed that the value of α does affect the number of nstances selected by CFKNN, wth the ncrease of the value of α, the number of nstances selected by CFKNN s decreased contnually, when α > 0.5, most of curves become more and more smoothly excet WPBC. So the number of nstances selected by CFKNN wll have lttle change wth the ncrease of the value of α when α > Consderng the testng accuracy, t s reasonable that α takes dfferent value between 0.5 and 0.95 for dfferent dataset. Fgure. The average accuracy of CFNN on 9 datasets wth dfferent thresholds Fgure 2. The number of nstance selected by CFNN on 9 datasets wth dfferent thresholds 284
4 Proceedngs of the 20 Internatonal Conference on Machne Learnng and Cybernetcs, Guln, 0-3 July, Conclusons In ths aer, n order to overcome the drawback of large comutatonal comlexty requrement of F-KNN, based on the fuzzy entroy of nstance, we roose the condensed fuzzy k-nearest neghbor rule (CFKNN. The exermental results show that our roosed method s feasble and effectve. Acknowledgments Ths research s suorted by the natonal natural scence foundaton of Chna ( , , by the natural scence foundaton of Hebe Provnce (F , F , by the Key Scentfc Research Foundaton of Educaton Deartment of Hebe Provnce (ZD20039, by the Scentfc Research Foundaton of Educaton Deartment of Hebe Provnce (200932, , and by the Undergraduate Scence and Technology Innovaton Proects of Hebe Unversty ( References []. T. Cover, P. Hart. Nearest neghbor attern classfcaton. IEEE Transactons on Informaton Theory, 967, 3(:2-27. [2]. B. Dasarathy. Nearest Neghbor (NN Norms: NN Pattern Classfcaton Technques. Comuter Socety Press, 99. [3]. X. Wu, V. Kumar, J. R. Qunlan et al. To 0 algorthms n data mnng. Knowledge Informaton System, 2008, 4(:-37. [4]. T. M. Mtchell. Machne learnng. McGraw-Hll Comanes, Inc [5]. K. Small, D. Roth. Margn-based actve learnng for structured redctons. Internatonal Journal of Machne Learnng and Cybernetcs, 200, (-4:3-25. [6]. L. Wang. An mroved multle fuzzy NNC system based on mutual nformaton and fuzzy ntegral. Internatonal Journal of Machne Learnng and Cybernetcs, 20, 2(: [7]. Z. Lu, Q. Wu, Y. Zhang et al. Adatve least squares suort vector machnes flter for hand tremor cancelng n mcrosurgery. Internatonal Journal of Machne Learnng and Cybernetcs, 20, 2(: [8]. P. Hart. The condensed nearest neghbor rule. IEEE Transacton on Informaton Theory, 968, 4(5: [9]. J. M. Keller, M. R. Gray, J. A. Gvens. A fuzzy k-nearest neghbor algorthm. IEEE trans. on SMC, 985, 5(4: [0]. J. H. Zha. Fuzzy decson tree based on fuzzy-rough technque [J]. Soft Comutng, 200, DOI: 0.007/s []. C. L. Blake. J. Merz. UCI Reostory of machne learnng databases. 996, htt:// [2]. X. Z. Wang, J. H. Zha, S. X. Lu, Inducton of multle fuzzy decson trees based on rough set technque, Informaton Scences, 2008,78(6:
5 Proceedngs of the 20 Internatonal Conference on Machne Learnng and Cybernetcs, Guln, 0-3 July, 20 Table. The basc nformaton of the 0 datasets used n our exerments DB Number of nstances Number of attrbutes Number of classes Irs WDBC WPBC Glass Image Parknsons Pma CT Image RenRu Table 2. Exermental results wth K=5 Dataset The number of selected nstances The average accuracy CPU Tme(s Irs WDBC WPBC Glass Image Parknsons Pma CT Image RenRu
Learning the Kernel Parameters in Kernel Minimum Distance Classifier
Learnng the Kernel Parameters n Kernel Mnmum Dstance Classfer Daoqang Zhang 1,, Songcan Chen and Zh-Hua Zhou 1* 1 Natonal Laboratory for Novel Software Technology Nanjng Unversty, Nanjng 193, Chna Department
More informationThe Research of Support Vector Machine in Agricultural Data Classification
The Research of Support Vector Machne n Agrcultural Data Classfcaton Le Sh, Qguo Duan, Xnmng Ma, Me Weng College of Informaton and Management Scence, HeNan Agrcultural Unversty, Zhengzhou 45000 Chna Zhengzhou
More informationClassifier Selection Based on Data Complexity Measures *
Classfer Selecton Based on Data Complexty Measures * Edth Hernández-Reyes, J.A. Carrasco-Ochoa, and J.Fco. Martínez-Trndad Natonal Insttute for Astrophyscs, Optcs and Electroncs, Lus Enrque Erro No.1 Sta.
More informationTerm Weighting Classification System Using the Chi-square Statistic for the Classification Subtask at NTCIR-6 Patent Retrieval Task
Proceedngs of NTCIR-6 Workshop Meetng, May 15-18, 2007, Tokyo, Japan Term Weghtng Classfcaton System Usng the Ch-square Statstc for the Classfcaton Subtask at NTCIR-6 Patent Retreval Task Kotaro Hashmoto
More informationRecognition of Identifiers from Shipping Container Images Using Fuzzy Binarization and Enhanced Fuzzy Neural Network
Recognton of Identfers from Shng Contaner Images Usng uzzy Bnarzaton and Enhanced uzzy Neural Networ Kwang-Bae Km Det. of Comuter Engneerng, Slla Unversty, Korea gbm@slla.ac.r Abstract. In ths aer, we
More informationSkew Angle Estimation and Correction of Hand Written, Textual and Large areas of Non-Textual Document Images: A Novel Approach
Angle Estmaton and Correcton of Hand Wrtten, Textual and Large areas of Non-Textual Document Images: A Novel Approach D.R.Ramesh Babu Pyush M Kumat Mahesh D Dhannawat PES Insttute of Technology Research
More informationMultilayer Neural Networks and Nearest Neighbor Classifier Performances for Image Annotation
(IJACSA) Internatonal Journal of Advanced Comuter Scence and Alcatons, Vol. 3, No. 11, 01 Multlayer Neural Networs and Nearest Neghbor Classfer erformances for Image Annotaton Mustaha OUJAOURA Laboratory
More informationSupport Vector Machines
/9/207 MIST.6060 Busness Intellgence and Data Mnng What are Support Vector Machnes? Support Vector Machnes Support Vector Machnes (SVMs) are supervsed learnng technques that analyze data and recognze patterns.
More informationA Fast Visual Tracking Algorithm Based on Circle Pixels Matching
A Fast Vsual Trackng Algorthm Based on Crcle Pxels Matchng Zhqang Hou hou_zhq@sohu.com Chongzhao Han czhan@mal.xjtu.edu.cn Ln Zheng Abstract: A fast vsual trackng algorthm based on crcle pxels matchng
More informationA new Algorithm for Lossless Compression applied to two-dimensional Static Images
A new Algorthm for Lossless Comresson aled to two-dmensonal Statc Images JUAN IGNACIO LARRAURI Deartment of Technology Industral Unversty of Deusto Avda. Unversdades, 4. 48007 Blbao SPAIN larrau@deusto.es
More informationIndex Terms-Software effort estimation, principle component analysis, datasets, neural networks, and radial basis functions.
ISO 9001:2008 Certfed Internatonal Journal of Engneerng and Innovatve Technology (IJEIT The Effect of Dmensonalty Reducton on the Performance of Software Cost Estmaton Models Ryadh A.K. Mehd College of
More informationTraffic Classification Method Based On Data Stream Fingerprint
5th nternatonal Conference on Advanced Materals and Comuter Scence (CAMCS 6) Traffc Classfcaton Method Based On Data Stream Fngerrnt Kefe Cheng, a, Guohu We,b and Xangjun Ma3,c College of Comuter Scence
More informationCollaboratively Regularized Nearest Points for Set Based Recognition
Academc Center for Computng and Meda Studes, Kyoto Unversty Collaboratvely Regularzed Nearest Ponts for Set Based Recognton Yang Wu, Mchhko Mnoh, Masayuk Mukunok Kyoto Unversty 9/1/013 BMVC 013 @ Brstol,
More informationA New Approach For the Ranking of Fuzzy Sets With Different Heights
New pproach For the ankng of Fuzzy Sets Wth Dfferent Heghts Pushpnder Sngh School of Mathematcs Computer pplcatons Thapar Unversty, Patala-7 00 Inda pushpndersnl@gmalcom STCT ankng of fuzzy sets plays
More informationNUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS
ARPN Journal of Engneerng and Appled Scences 006-017 Asan Research Publshng Network (ARPN). All rghts reserved. NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS Igor Grgoryev, Svetlana
More informationCluster Analysis of Electrical Behavior
Journal of Computer and Communcatons, 205, 3, 88-93 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/cc http://dx.do.org/0.4236/cc.205.350 Cluster Analyss of Electrcal Behavor Ln Lu Ln Lu, School
More informationA Classifier Ensemble of Binary Classifier Ensembles
Internatonal Journal of Electroncs Communcaton and Comuter Technology (IJECCT) Volume 1 Issue 1 Setember 2011 A Classfer Ensemble of Bnary Classfer Ensembles Hamd Parvn Comuter Engneerng, Islamc Azad Unversty,
More informationLecture Note 08 EECS 4101/5101 Instructor: Andy Mirzaian. All Nearest Neighbors: The Lifting Method
Lecture Note 08 EECS 4101/5101 Instructor: Andy Mrzaan Introducton All Nearest Neghbors: The Lftng Method Suose we are gven aset P ={ 1, 2,..., n }of n onts n the lane. The gven coordnates of the -th ont
More informationA Scheduling Algorithm of Periodic Messages for Hard Real-time Communications on a Switched Ethernet
IJCSNS Internatonal Journal of Comuter Scence and Networ Securty VOL.6 No.5B May 26 A Schedulng Algorthm of Perodc Messages for Hard eal-tme Communcatons on a Swtched Ethernet Hee Chan Lee and Myung Kyun
More informationRegion Segmentation Readings: Chapter 10: 10.1 Additional Materials Provided
Regon Segmentaton Readngs: hater 10: 10.1 Addtonal Materals Provded K-means lusterng tet EM lusterng aer Grah Parttonng tet Mean-Shft lusterng aer 1 Image Segmentaton Image segmentaton s the oeraton of
More informationAnnouncements. Supervised Learning
Announcements See Chapter 5 of Duda, Hart, and Stork. Tutoral by Burge lnked to on web page. Supervsed Learnng Classfcaton wth labeled eamples. Images vectors n hgh-d space. Supervsed Learnng Labeled eamples
More informationTsinghua University at TAC 2009: Summarizing Multi-documents by Information Distance
Tsnghua Unversty at TAC 2009: Summarzng Mult-documents by Informaton Dstance Chong Long, Mnle Huang, Xaoyan Zhu State Key Laboratory of Intellgent Technology and Systems, Tsnghua Natonal Laboratory for
More informationMachine Learning. Topic 6: Clustering
Machne Learnng Topc 6: lusterng lusterng Groupng data nto (hopefully useful) sets. Thngs on the left Thngs on the rght Applcatons of lusterng Hypothess Generaton lusters mght suggest natural groups. Hypothess
More informationInvestigating the Performance of Naïve- Bayes Classifiers and K- Nearest Neighbor Classifiers
Journal of Convergence Informaton Technology Volume 5, Number 2, Aprl 2010 Investgatng the Performance of Naïve- Bayes Classfers and K- Nearest Neghbor Classfers Mohammed J. Islam *, Q. M. Jonathan Wu,
More informationPruning Training Corpus to Speedup Text Classification 1
Prunng Tranng Corpus to Speedup Text Classfcaton Jhong Guan and Shugeng Zhou School of Computer Scence, Wuhan Unversty, Wuhan, 430079, Chna hguan@wtusm.edu.cn State Key Lab of Software Engneerng, Wuhan
More informationA new paradigm of fuzzy control point in space curve
MATEMATIKA, 2016, Volume 32, Number 2, 153 159 c Penerbt UTM Press All rghts reserved A new paradgm of fuzzy control pont n space curve 1 Abd Fatah Wahab, 2 Mohd Sallehuddn Husan and 3 Mohammad Izat Emr
More informationA New Feature of Uniformity of Image Texture Directions Coinciding with the Human Eyes Perception 1
A New Feature of Unformty of Image Texture Drectons Concdng wth the Human Eyes Percepton Xng-Jan He, De-Shuang Huang, Yue Zhang, Tat-Mng Lo 2, and Mchael R. Lyu 3 Intellgent Computng Lab, Insttute of Intellgent
More informationImpact of a New Attribute Extraction Algorithm on Web Page Classification
Impact of a New Attrbute Extracton Algorthm on Web Page Classfcaton Gösel Brc, Banu Dr, Yldz Techncal Unversty, Computer Engneerng Department Abstract Ths paper ntroduces a new algorthm for dmensonalty
More informationAn Image Fusion Approach Based on Segmentation Region
Rong Wang, L-Qun Gao, Shu Yang, Yu-Hua Cha, and Yan-Chun Lu An Image Fuson Approach Based On Segmentaton Regon An Image Fuson Approach Based on Segmentaton Regon Rong Wang, L-Qun Gao, Shu Yang 3, Yu-Hua
More informationSHAPE RECOGNITION METHOD BASED ON THE k-nearest NEIGHBOR RULE
SHAPE RECOGNITION METHOD BASED ON THE k-nearest NEIGHBOR RULE Dorna Purcaru Faculty of Automaton, Computers and Electroncs Unersty of Craoa 13 Al. I. Cuza Street, Craoa RO-1100 ROMANIA E-mal: dpurcaru@electroncs.uc.ro
More informationA Binarization Algorithm specialized on Document Images and Photos
A Bnarzaton Algorthm specalzed on Document mages and Photos Ergna Kavalleratou Dept. of nformaton and Communcaton Systems Engneerng Unversty of the Aegean kavalleratou@aegean.gr Abstract n ths paper, a
More informationDetermining Fuzzy Sets for Quantitative Attributes in Data Mining Problems
Determnng Fuzzy Sets for Quanttatve Attrbutes n Data Mnng Problems ATTILA GYENESEI Turku Centre for Computer Scence (TUCS) Unversty of Turku, Department of Computer Scence Lemmnkäsenkatu 4A, FIN-5 Turku
More informationScale Selective Extended Local Binary Pattern For Texture Classification
Scale Selectve Extended Local Bnary Pattern For Texture Classfcaton Yutng Hu, Zhlng Long, and Ghassan AlRegb Multmeda & Sensors Lab (MSL) Georga Insttute of Technology 03/09/017 Outlne Texture Representaton
More informationA NOTE ON FUZZY CLOSURE OF A FUZZY SET
(JPMNT) Journal of Process Management New Technologes, Internatonal A NOTE ON FUZZY CLOSURE OF A FUZZY SET Bhmraj Basumatary Department of Mathematcal Scences, Bodoland Unversty, Kokrajhar, Assam, Inda,
More informationIncremental Learning with Support Vector Machines and Fuzzy Set Theory
The 25th Workshop on Combnatoral Mathematcs and Computaton Theory Incremental Learnng wth Support Vector Machnes and Fuzzy Set Theory Yu-Mng Chuang 1 and Cha-Hwa Ln 2* 1 Department of Computer Scence and
More informationSum of Linear and Fractional Multiobjective Programming Problem under Fuzzy Rules Constraints
Australan Journal of Basc and Appled Scences, 2(4): 1204-1208, 2008 ISSN 1991-8178 Sum of Lnear and Fractonal Multobjectve Programmng Problem under Fuzzy Rules Constrants 1 2 Sanjay Jan and Kalash Lachhwan
More informationUsing an Automatic Weighted Keywords Dictionary for Intelligent Web Content Filtering
Journal of Advances n Computer Research Quarterly pissn: 2345-606x eissn: 2345-6078 Sar Branch, Islamc Azad Unversty, Sar, I.R.Iran (Vol. 6, No. 1, February 2015), Pages: 101-114 www.jacr.ausar.ac.r Usng
More informationSpam Filtering Based on Support Vector Machines with Taguchi Method for Parameter Selection
E-mal Spam Flterng Based on Support Vector Machnes wth Taguch Method for Parameter Selecton We-Chh Hsu, Tsan-Yng Yu E-mal Spam Flterng Based on Support Vector Machnes wth Taguch Method for Parameter Selecton
More informationWeb Document Classification Based on Fuzzy Association
Web Document Classfcaton Based on Fuzzy Assocaton Choochart Haruechayasa, Me-Lng Shyu Department of Electrcal and Computer Engneerng Unversty of Mam Coral Gables, FL 33124, USA charuech@mam.edu, shyu@mam.edu
More informationJapanese Dependency Analysis Based on Improved SVM and KNN
Proceedngs of the 7th WSEAS Internatonal Conference on Smulaton, Modellng and Optmzaton, Bejng, Chna, September 15-17, 2007 140 Japanese Dependency Analyss Based on Improved SVM and KNN ZHOU HUIWEI and
More informationFuzzy Modeling of the Complexity vs. Accuracy Trade-off in a Sequential Two-Stage Multi-Classifier System
Fuzzy Modelng of the Complexty vs. Accuracy Trade-off n a Sequental Two-Stage Mult-Classfer System MARK LAST 1 Department of Informaton Systems Engneerng Ben-Guron Unversty of the Negev Beer-Sheva 84105
More informationMachine Learning: Algorithms and Applications
14/05/1 Machne Learnng: Algorthms and Applcatons Florano Zn Free Unversty of Bozen-Bolzano Faculty of Computer Scence Academc Year 011-01 Lecture 10: 14 May 01 Unsupervsed Learnng cont Sldes courtesy of
More informationYan et al. / J Zhejiang Univ-Sci C (Comput & Electron) in press 1. Improving Naive Bayes classifier by dividing its decision regions *
Yan et al. / J Zhejang Unv-Sc C (Comput & Electron) n press 1 Journal of Zhejang Unversty-SCIENCE C (Computers & Electroncs) ISSN 1869-1951 (Prnt); ISSN 1869-196X (Onlne) www.zju.edu.cn/jzus; www.sprngerlnk.com
More informationMachine Learning. Support Vector Machines. (contains material adapted from talks by Constantin F. Aliferis & Ioannis Tsamardinos, and Martin Law)
Machne Learnng Support Vector Machnes (contans materal adapted from talks by Constantn F. Alfers & Ioanns Tsamardnos, and Martn Law) Bryan Pardo, Machne Learnng: EECS 349 Fall 2014 Support Vector Machnes
More informationBOOSTING CLASSIFICATION ACCURACY WITH SAMPLES CHOSEN FROM A VALIDATION SET
1 BOOSTING CLASSIFICATION ACCURACY WITH SAMPLES CHOSEN FROM A VALIDATION SET TZU-CHENG CHUANG School of Electrcal and Computer Engneerng, Purdue Unversty, West Lafayette, Indana 47907 SAUL B. GELFAND School
More informationSupport Vector Machines
Support Vector Machnes Decson surface s a hyperplane (lne n 2D) n feature space (smlar to the Perceptron) Arguably, the most mportant recent dscovery n machne learnng In a nutshell: map the data to a predetermned
More informationBAYESIAN MULTI-SOURCE DOMAIN ADAPTATION
BAYESIAN MULTI-SOURCE DOMAIN ADAPTATION SHI-LIANG SUN, HONG-LEI SHI Department of Computer Scence and Technology, East Chna Normal Unversty 500 Dongchuan Road, Shangha 200241, P. R. Chna E-MAIL: slsun@cs.ecnu.edu.cn,
More informationSemantic Image Retrieval Using Region Based Inverted File
Semantc Image Retreval Usng Regon Based Inverted Fle Dengsheng Zhang, Md Monrul Islam, Guoun Lu and Jn Hou 2 Gppsland School of Informaton Technology, Monash Unversty Churchll, VIC 3842, Australa E-mal:
More informationHuman Face Recognition Using Generalized. Kernel Fisher Discriminant
Human Face Recognton Usng Generalzed Kernel Fsher Dscrmnant ng-yu Sun,2 De-Shuang Huang Ln Guo. Insttute of Intellgent Machnes, Chnese Academy of Scences, P.O.ox 30, Hefe, Anhu, Chna. 2. Department of
More informationA MODIFIED K-NEAREST NEIGHBOR CLASSIFIER TO DEAL WITH UNBALANCED CLASSES
A MODIFIED K-NEAREST NEIGHBOR CLASSIFIER TO DEAL WITH UNBALANCED CLASSES Aram AlSuer, Ahmed Al-An and Amr Atya 2 Faculty of Engneerng and Informaton Technology, Unversty of Technology, Sydney, Australa
More informationFinite Element Analysis of Rubber Sealing Ring Resilience Behavior Qu Jia 1,a, Chen Geng 1,b and Yang Yuwei 2,c
Advanced Materals Research Onlne: 03-06-3 ISSN: 66-8985, Vol. 705, pp 40-44 do:0.408/www.scentfc.net/amr.705.40 03 Trans Tech Publcatons, Swtzerland Fnte Element Analyss of Rubber Sealng Rng Reslence Behavor
More informationNovel Pattern-based Fingerprint Recognition Technique Using 2D Wavelet Decomposition
Mathematcal Methods for Informaton Scence and Economcs Novel Pattern-based Fngerprnt Recognton Technque Usng D Wavelet Decomposton TUDOR BARBU Insttute of Computer Scence of the Romanan Academy T. Codrescu,,
More informationA Method of Line Matching Based on Feature Points
JOURNAL OF SOFTWARE, VOL. 7, NO. 7, JULY 2012 1539 A Method of Lne Matchng Based on Feature Ponts Yanxa Wang and Yan Ma College of Comuter and Informaton Scence, Chongqng Normal Unversty, Chongqng, 400047,
More informationMULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION
MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION Paulo Quntlano 1 & Antono Santa-Rosa 1 Federal Polce Department, Brasla, Brazl. E-mals: quntlano.pqs@dpf.gov.br and
More informationAn Optimal Algorithm for Prufer Codes *
J. Software Engneerng & Applcatons, 2009, 2: 111-115 do:10.4236/jsea.2009.22016 Publshed Onlne July 2009 (www.scrp.org/journal/jsea) An Optmal Algorthm for Prufer Codes * Xaodong Wang 1, 2, Le Wang 3,
More informationImplementation Naïve Bayes Algorithm for Student Classification Based on Graduation Status
Internatonal Journal of Appled Busness and Informaton Systems ISSN: 2597-8993 Vol 1, No 2, September 2017, pp. 6-12 6 Implementaton Naïve Bayes Algorthm for Student Classfcaton Based on Graduaton Status
More informationUnder-Sampling Approaches for Improving Prediction of the Minority Class in an Imbalanced Dataset
Under-Samplng Approaches for Improvng Predcton of the Mnorty Class n an Imbalanced Dataset Show-Jane Yen and Yue-Sh Lee Department of Computer Scence and Informaton Engneerng, Mng Chuan Unversty 5 The-Mng
More informationSkew Estimation in Document Images Based on an Energy Minimization Framework
Skew Estmaton n Document Images Based on an Energy Mnmzaton Framework Youbao Tang 1, Xangqan u 1, e Bu 2, and Hongyang ang 3 1 School of Comuter Scence and Technology, Harbn Insttute of Technology, Harbn,
More informationArabic Text Classification Using N-Gram Frequency Statistics A Comparative Study
Arabc Text Classfcaton Usng N-Gram Frequency Statstcs A Comparatve Study Lala Khresat Dept. of Computer Scence, Math and Physcs Farlegh Dcknson Unversty 285 Madson Ave, Madson NJ 07940 Khresat@fdu.edu
More informationComparison of Robust Nearest Neighbour fuzzy Rough Classifier (RNN-FRC) with KNN and NEC Classifiers
Bchtrananda Behera et al, / (IJCIT) Internatonal Journal of Computer cence and Informaton Technologes, Vol. 5 (), 014, 056-06 Comparson of obust Nearest Neghbour fuzzy ough Classfer (NN-FC) wth KNN and
More informationEYE CENTER LOCALIZATION ON A FACIAL IMAGE BASED ON MULTI-BLOCK LOCAL BINARY PATTERNS
P.G. Demdov Yaroslavl State Unversty Anatoly Ntn, Vladmr Khryashchev, Olga Stepanova, Igor Kostern EYE CENTER LOCALIZATION ON A FACIAL IMAGE BASED ON MULTI-BLOCK LOCAL BINARY PATTERNS Yaroslavl, 2015 Eye
More informationA note on Schema Equivalence
note on Schema Equvalence.H.M. ter Hofstede and H.. Proer and Th.P. van der Wede E.Proer@acm.org PUBLISHED S:.H.M. ter Hofstede, H.. Proer, and Th.P. van der Wede. Note on Schema Equvalence. Techncal Reort
More informationA Feature-Weighted Instance-Based Learner for Deep Web Search Interface Identification
Research Journal of Appled Scences, Engneerng and Technology 5(4): 1278-1283, 2013 ISSN: 2040-7459; e-issn: 2040-7467 Maxwell Scentfc Organzaton, 2013 Submtted: June 28, 2012 Accepted: August 08, 2012
More informationFuzzy Rough Neural Network and Its Application to Feature Selection
70 Internatonal Journal of Fuzzy Systems, Vol. 3, No. 4, December 0 Fuzzy Rough Neural Network and Its Applcaton to Feature Selecton Junyang Zhao and Zhl Zhang Abstract For the sake of measurng fuzzy uncertanty
More informationFace Recognition Based on SVM and 2DPCA
Vol. 4, o. 3, September, 2011 Face Recognton Based on SVM and 2DPCA Tha Hoang Le, Len Bu Faculty of Informaton Technology, HCMC Unversty of Scence Faculty of Informaton Scences and Engneerng, Unversty
More informationSolving two-person zero-sum game by Matlab
Appled Mechancs and Materals Onlne: 2011-02-02 ISSN: 1662-7482, Vols. 50-51, pp 262-265 do:10.4028/www.scentfc.net/amm.50-51.262 2011 Trans Tech Publcatons, Swtzerland Solvng two-person zero-sum game by
More informationOn Evaluating Open Biometric Identification Systems
Proceedngs of Student/Faculty Research Day, CSIS, Pace Unversty, May 6th, 2005 On Evaluatng Open Bometrc Identfcaton Systems Mchael Gbbons, Sungsoo Yoon, Sung-Hyuk Cha and Charles Tappert mkegbb@us.bm.com,
More informationA Clustering Algorithm for Chinese Adjectives and Nouns 1
Clusterng lgorthm for Chnese dectves and ouns Yang Wen, Chunfa Yuan, Changnng Huang 2 State Key aboratory of Intellgent Technology and System Deptartment of Computer Scence & Technology, Tsnghua Unversty,
More informationFINDING IMPORTANT NODES IN SOCIAL NETWORKS BASED ON MODIFIED PAGERANK
FINDING IMPORTANT NODES IN SOCIAL NETWORKS BASED ON MODIFIED PAGERANK L-qng Qu, Yong-quan Lang 2, Jng-Chen 3, 2 College of Informaton Scence and Technology, Shandong Unversty of Scence and Technology,
More informationE-DEEC- Enhanced Distributed Energy Efficient Clustering Scheme for heterogeneous WSN
21 1st Internatonal Conference on Parallel, Dstrbuted and Grd Comutng (PDGC - 21) E-DEEC- Enhanced Dstrbuted Energy Effcent Clusterng Scheme for heterogeneous WSN Parul San Deartment of Comuter Scence
More informationReliable Negative Extracting Based on knn for Learning from Positive and Unlabeled Examples
94 JOURNAL OF COMPUTERS, VOL. 4, NO. 1, JANUARY 2009 Relable Negatve Extractng Based on knn for Learnng from Postve and Unlabeled Examples Bangzuo Zhang College of Computer Scence and Technology, Jln Unversty,
More informationA High-Accuracy Algorithm for Surface Defect Detection of Steel Based on DAG-SVM
Sensors & Transducers, Vol. 57, Issue 0, October 203,. 42-48 Sensors & Transducers 203 by IFSA htt://www.sensorsortal.com A Hgh-Accuracy Algorthm for Surface Defect Detecton of Steel Based on DAG-SVM,
More informationAn Improved Image Segmentation Algorithm Based on the Otsu Method
3th ACIS Internatonal Conference on Software Engneerng, Artfcal Intellgence, Networkng arallel/dstrbuted Computng An Improved Image Segmentaton Algorthm Based on the Otsu Method Mengxng Huang, enjao Yu,
More informationDeep Classification in Large-scale Text Hierarchies
Deep Classfcaton n Large-scale Text Herarches Gu-Rong Xue Dkan Xng Qang Yang 2 Yong Yu Dept. of Computer Scence and Engneerng Shangha Jao-Tong Unversty {grxue, dkxng, yyu}@apex.sjtu.edu.cn 2 Hong Kong
More informationFEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur
FEATURE EXTRACTION Dr. K.Vjayarekha Assocate Dean School of Electrcal and Electroncs Engneerng SASTRA Unversty, Thanjavur613 41 Jont Intatve of IITs and IISc Funded by MHRD Page 1 of 8 Table of Contents
More informationAssociative Based Classification Algorithm For Diabetes Disease Prediction
Internatonal Journal of Engneerng Trends and Technology (IJETT) Volume-41 Number-3 - November 016 Assocatve Based Classfcaton Algorthm For Dabetes Dsease Predcton 1 N. Gnana Deepka, Y.surekha, 3 G.Laltha
More informationData Mining: Model Evaluation
Data Mnng: Model Evaluaton Aprl 16, 2013 1 Issues: Evaluatng Classfcaton Methods Accurac classfer accurac: predctng class label predctor accurac: guessng value of predcted attrbutes Speed tme to construct
More informationA fast algorithm for color image segmentation
Unersty of Wollongong Research Onlne Faculty of Informatcs - Papers (Arche) Faculty of Engneerng and Informaton Scences 006 A fast algorthm for color mage segmentaton L. Dong Unersty of Wollongong, lju@uow.edu.au
More informationEducational Semantic Networks and their Applications
BUIU Unverstăţ Petrol Gaze dn Ploeşt Vol. X o. /008 77-85 Sera atematcă - Informatcă - Fzcă ducatonal Semantc etwors and ther Alcatons Gabrela ose vu Ionţă Unverstatea Petrol-Gaze dn Ploeşt Bd. Bucureşt
More informationFeature Selection as an Improving Step for Decision Tree Construction
2009 Internatonal Conference on Machne Learnng and Computng IPCSIT vol.3 (2011) (2011) IACSIT Press, Sngapore Feature Selecton as an Improvng Step for Decson Tree Constructon Mahd Esmael 1, Fazekas Gabor
More informationAn Internal Clustering Validation Index for Boolean Data
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 16, No 6 Specal ssue wth selecton of extended papers from 6th Internatonal Conference on Logstc, Informatcs and Servce Scence
More informationType-2 Fuzzy Non-uniform Rational B-spline Model with Type-2 Fuzzy Data
Malaysan Journal of Mathematcal Scences 11(S) Aprl : 35 46 (2017) Specal Issue: The 2nd Internatonal Conference and Workshop on Mathematcal Analyss (ICWOMA 2016) MALAYSIAN JOURNAL OF MATHEMATICAL SCIENCES
More informationOutline. Self-Organizing Maps (SOM) US Hebbian Learning, Cntd. The learning rule is Hebbian like:
Self-Organzng Maps (SOM) Turgay İBRİKÇİ, PhD. Outlne Introducton Structures of SOM SOM Archtecture Neghborhoods SOM Algorthm Examples Summary 1 2 Unsupervsed Hebban Learnng US Hebban Learnng, Cntd 3 A
More informationSignature and Lexicon Pruning Techniques
Sgnature and Lexcon Prunng Technques Srnvas Palla, Hansheng Le, Venu Govndaraju Centre for Unfed Bometrcs and Sensors Unversty at Buffalo {spalla2, hle, govnd}@cedar.buffalo.edu Abstract Handwrtten word
More informationAvailable online at Available online at Advanced in Control Engineering and Information Science
Avalable onlne at wwwscencedrectcom Avalable onlne at wwwscencedrectcom Proceda Proceda Engneerng Engneerng 00 (2011) 15000 000 (2011) 1642 1646 Proceda Engneerng wwwelsevercom/locate/proceda Advanced
More informationLobachevsky State University of Nizhni Novgorod. Polyhedron. Quick Start Guide
Lobachevsky State Unversty of Nzhn Novgorod Polyhedron Quck Start Gude Nzhn Novgorod 2016 Contents Specfcaton of Polyhedron software... 3 Theoretcal background... 4 1. Interface of Polyhedron... 6 1.1.
More informationFast Feature Value Searching for Face Detection
Vol., No. 2 Computer and Informaton Scence Fast Feature Value Searchng for Face Detecton Yunyang Yan Department of Computer Engneerng Huayn Insttute of Technology Hua an 22300, Chna E-mal: areyyyke@63.com
More informationBayesian Networks: Independencies and Inference. What Independencies does a Bayes Net Model?
Bayesan Networks: Indeendences and Inference Scott Daves and Andrew Moore Note to other teachers and users of these sldes. Andrew and Scott would be delghted f you found ths source materal useful n gvng
More informationMachine Learning 9. week
Machne Learnng 9. week Mappng Concept Radal Bass Functons (RBF) RBF Networks 1 Mappng It s probably the best scenaro for the classfcaton of two dataset s to separate them lnearly. As you see n the below
More informationCombining The Global and Partial Information for Distance-Based Time Series Classification and Clustering
Paper: Combnng The Global and Partal Informaton for Dstance-Based Tme Seres Hu Zhang, Tu Bao Ho, Mao-Song Ln, and We Huang School of Knowledge Scence, Japan Advanced Insttute of Scence and Technology,
More informationThe Research of Ellipse Parameter Fitting Algorithm of Ultrasonic Imaging Logging in the Casing Hole
Appled Mathematcs, 04, 5, 37-3 Publshed Onlne May 04 n ScRes. http://www.scrp.org/journal/am http://dx.do.org/0.436/am.04.584 The Research of Ellpse Parameter Fttng Algorthm of Ultrasonc Imagng Loggng
More informationTF 2 P-growth: An Efficient Algorithm for Mining Frequent Patterns without any Thresholds
TF 2 P-growth: An Effcent Algorthm for Mnng Frequent Patterns wthout any Thresholds Yu HIRATE, Ego IWAHASHI, and Hayato YAMANA Graduate School of Scence and Engneerng, Waseda Unversty {hrate, ego, yamana}@yama.nfo.waseda.ac.jp
More informationON SOME ENTERTAINING APPLICATIONS OF THE CONCEPT OF SET IN COMPUTER SCIENCE COURSE
Yordzhev K., Kostadnova H. Інформаційні технології в освіті ON SOME ENTERTAINING APPLICATIONS OF THE CONCEPT OF SET IN COMPUTER SCIENCE COURSE Yordzhev K., Kostadnova H. Some aspects of programmng educaton
More informationAn efficient weighted nearest neighbour classifier using vertical data representation
Int. J. Busness Intellgence and Data Mnng, Vol. x, No. x, xxxx 1 An effcent weghted nearest neghbour classfer usng vertcal data representaton Wllam Perrzo Department of Computer Scence, North Dakota State
More informationClassification / Regression Support Vector Machines
Classfcaton / Regresson Support Vector Machnes Jeff Howbert Introducton to Machne Learnng Wnter 04 Topcs SVM classfers for lnearly separable classes SVM classfers for non-lnearly separable classes SVM
More informationA Robust Webpage Information Hiding Method Based on the Slash of Tag
Advanced Engneerng Forum Onlne: 2012-09-26 ISSN: 2234-991X, Vols. 6-7, pp 361-366 do:10.4028/www.scentfc.net/aef.6-7.361 2012 Trans Tech Publcatons, Swtzerland A Robust Webpage Informaton Hdng Method Based
More informationUsing an Adaptive Neuro-Fuzzy Inference System (AnFis) Algorithm for Automatic Diagnosis of Skin Cancer
Journal of Communcaton and Computer 8 (2011) 751-755 Usng an Adaptve Neuro-Fuzzy Inference System (AnFs) Algorthm for Automatc Dagnoss of Skn Cancer Suhal M. Odeh Department of Computer Informaton Systems,
More informationAudio Content Classification Method Research Based on Two-step Strategy
(IJACSA) Internatonal Journal of Advanced Computer Scence and Applcatons, Audo Content Classfcaton Method Research Based on Two-step Strategy Sume Lang Department of Computer Scence and Technology Chongqng
More informationBroadcast Time Synchronization Algorithm for Wireless Sensor Networks Chaonong Xu 1)2)3), Lei Zhao 1)2), Yongjun Xu 1)2) and Xiaowei Li 1)2)
Broadcast Tme Synchronzaton Algorthm for Wreless Sensor Networs Chaonong Xu )2)3), Le Zhao )2), Yongun Xu )2) and Xaowe L )2) ) Key Laboratory of Comuter Archtecture, Insttute of Comutng Technology Chnese
More informationOutline. Discriminative classifiers for image recognition. Where in the World? A nearest neighbor recognition example 4/14/2011. CS 376 Lecture 22 1
4/14/011 Outlne Dscrmnatve classfers for mage recognton Wednesday, Aprl 13 Krsten Grauman UT-Austn Last tme: wndow-based generc obect detecton basc ppelne face detecton wth boostng as case study Today:
More information