A SWARM-BASED ROUGH SET APPROACH FOR FMRI DATA ANALYSIS

Size: px
Start display at page:

Download "A SWARM-BASED ROUGH SET APPROACH FOR FMRI DATA ANALYSIS"

Transcription

1 International Journal of Innovative Computing, Information and Control ICIC International c 2011 ISSN Volume 7, Number 6, June 2011 pp A SWARM-BASED ROUGH SET APPROACH FOR FMRI DATA ANALYSIS Hongbo Liu 1,2,3,4,, Ajith Abraham 3, Weishi Zhang 1 and Seán Mcloone 4 1 School of Information Dalian Maritime University No. 1, Linghai Road, Dalian , P. R. China teesiv@dlmu.edu.cn Corresponding author: lhb@dlmu.edu.cn 2 School of Computer Dalian University of Technology No. 2, Linggong Road, Ganjingzi District, Dalian , P. R. China lhb@dlut.edu.cn 3 Machine Intelligence Research Labs MIR Labs Auburn, Washington 98071, USA ajith.abraham@ieee.org 4 Department of Electronic Engineering National University of Ireland Maynooth Maynooth, Co. Kildare, Ireland sean.mcloone@eeng.nuim.ie Received April 2010; revised August 2010 Abstract. The functional Magnetic Resonance Imaging (fmri) is one of the most important tools for exploring the operation of the brain as it allows the spatially localized characteristics of brain activity to be observed. However, fmri studies generate huge volumes of data and the signals of interest have low signal to noise ratio making its analysis a very challenging problem. There is a growing need for new methods that can efficiently and objectively extract the useful information from fmri data and translate it into intelligible knowledge. In this paper, we introduce a swarm-based rough set approach to fmri data analysis. Our approach is based on exploiting the power of particle swarm optimization to discover the feature combinations in an efficient manner by observing the change in positive region as the particles proceed through the search space. The approach supports multi-knowledge extraction. We evaluate the performance of the algorithm using benchmark and fmri datasets. The results demonstrate its potential value for cognition research. Keywords: Particle swarm, Swarm intelligence, Multi-knowledge, fmri 1. Introduction. The field of neuroinformatics is concerned with the collection, organization and analysis of neuroscience data and the development of computational models and analytical tools for the exploration of this data. Standing at the intersection between neuroscience and information science, neuroinformatics plays a vital role in the integration and analysis of increasingly fine grain experimental data and in improving existing theories about nervous system and brain function [1]. Functional Magnetic Resonance Imaging (fmri) is one of the most important tools for the generation of Neuroinformatics data. It provides a high resolution volumetric mapping of the haemodynamic response of the brain which can be correlated with neural activity, thereby allowing the spatially localized characteristics of brain activity to be observed. 3121

2 3122 H. LIU, A. ABRAHAM, W. ZHANG AND S. MCLOONE However, working with and interpreting fmri data is challenging due to the sheer volume of data involved. A single scan typically consists of more than half a million voxels, and with scan rates of between 0.2 and 1 Hz common place, datasets can run into terabytes. Coupled with this, the low signal to noise ratio of the activity signatures of interest and inter-subject variability makes the task of establishing the relationships between cognition states and cognition tasks/stimuli, a particularly demanding neuroinformatics problem. Recent research has mainly focused on employing statistical methods [2, 3, 4, 5, 6] to identify areas of the brain that show significant activity in response to a stimulus, so called regions of interest (ROI). These ROIs are then analyzed in detail with neuroscientists and psychologists providing an interpretation of the observed patterns, a process which strongly depends on their accumulative experience and subjective tendency. Rough set theory provides a novel approach to extracting a reduced set of features from fmri data and facilitating knowledge extraction. The rough set approach was developed by Pawlak in the early 1980 s as a framework for discovering relationships in imprecise data [7]. Rough sets refer to a mathematical concept in set theory. Rough sets are used to represent uncertainties in data. The primary goal of the rough set approach is to derive rules from data represented in an information system. The derivation of rules serves two main purposes: Firstly, the rules may be used in the classification of database objects, that is, predict the outcomes of unseen objects. Secondly, the rules may be used to develop a model of the domain under study, that is present knowledge in a format that can be understood by a human [8]. The rough set approach consists of several steps leading towards the final goal of generating rules from information/decision systems. The main steps of the rough set approach are: (1) mapping of the information from the original database into a decision system format; (2) completion of data; (3) discretization of data; (4) computation of reducts from data; (5) derivation of rules from reducts; (6) filtering of rules. One of the most important tasks is the data reduction process. The key problem of knowledge discovery using a rough set approach is data reduction. Usually, real world objects are represented as tuples in decision tables and these tables store a huge quantity of data, which is hard to manage from a computational point of view. Finding reducts in a large information system is still an NP-hard problem [9]. The high complexity of this problem has motivated investigators to apply various approximation techniques to find near-optimal solutions. Many approaches have been proposed for finding reducts, e.g., discernibility matrices, dynamic reducts and others [10, 11]. Heuristic algorithms are a better choice. Hu et al. [12] proposed a heuristic algorithm using a discernibility matrix. The approach provided a weighting mechanism to rank attributes. Zhong and Dong [13] presented a wrapper approach using rough sets theory with greedy heuristics for feature subset selection. The aim of feature subset selection is to find a minimum set of relevant attributes that describe the dataset as well as the original full set of attributes. Finding reducts is, therefore, similar to feature selection. Zhong s algorithm employed the number of consistent instances as a heuristic. Banerjee et al. [14] presented various attempts of using Genetic Algorithms in order to obtain reducts. Babaoglu et al. [15] studied the efficiency of binary particle swarm optimization and genetic algorithm techniques as feature selection models on determination of coronary artery disease existence based upon exercise stress testing data. Classification results of a feature selection technique using binary particle swarm optimization and genetic algorithms are compared with each other and also with the results obtained when the full set of features are used as an input to a support vector machine model. The results show that feature selection using binary particle swarm optimization is more successful than feature selection using genetic algorithms for determining coronary artery disease.

3 A SWARM-BASED ROUGH SET APPROACH FOR FMRI DATA ANALYSIS 3123 The particle swarm algorithm is inspired by social behavior patterns of organisms that live and interact within large groups. In particular, it incorporates swarming behaviors observed in flocks of birds, schools of fish or swarms of bees and even human social behavior, from which the swarm intelligence paradigm has emerged [16]. The swarm intelligent model helps to find optimal regions of complex search spaces through interaction of individuals in a population of particles [17, 18]. As an algorithm, its main strength is its fast convergence, which compares favorably with many other global optimization algorithms [19, 20, 21, 22]. It has exhibited good performance across a wide range of applications [23, 24, 25]. The particle swarm algorithm is particularly attractive for feature selection as there seems to be no heuristic that can guide search to the optimal minimal feature subset. Additionally, it can be the case that particles discover the best feature combinations as they proceed throughout the search space. This paper introduces particle swarm optimization to the problem of rough set reduction processing, as a means of extracting multi-knowledge from fmri datasets. The remainder of the paper is organized as follows. The steps involved in fmri data pre-processing are described briefly in Section 2. The rough set reduction algorithm is introduced in Section 3. In Section 4, we illustrate some results of extracting knowledge from fmri Data using our approach. Finally, conclusions are presented in Section Data Pre-processing. A typical normalized fmri image contains more than 500,000 voxels, which is far greater than the dimension of any feature vector representative of brain activity. Consequently, we transform datasets from the MNI (Montreal Neurological Institute) template to the Talairach coordinate system [26] and then exploit the region information in Talairach as features to reduce the dimensionality of the images. We used the SP M99 software package 1 and in-house programs for image processing, including corrections for head motion, normalization and global fmri signal shift [27]. A simplified work flow is illustrated in Figure 1. The feature selection and extraction algorithm for fmri data is described in Algorithm 1. Figure 2 is a snapshot of one interface of our own software, which is used in the determination of appropriate regions of interest (ROI) for feature selection and extraction. For a given fmri image file, in this case spmt 002.img, the interface displays the cognitive activation information within a specified spherical volume so that the ROI voxels can be highlighted. The center and radius of the sphere are specified using the interface and are in this instance ( 6, 18, 6) and 5mm, respectively. The first column of data in the display, V oxel T, indicates the degree of activation with a significance level of 0.001, while the other columns specify the voxel location within the brain. 3. Rough Set Reduction Algorithm Reduction criteria. The basic concepts of rough set theory and its philosophy are presented and illustrated with examples in [28, 29, 30, 31]. Here, we explain only the terminology relevant to our reduction method. In rough set theory, an information system is denoted in 4-tuple by S = (U, A, V, f), where U is the universe of discourse, a non-empty finite set of N objects {x 1, x 2,, x N }. A is a non-empty finite set of attributes such that a : U V a for every a A (V a is the value set of the attribute a). V = a A V a 1

4 3124 H. LIU, A. ABRAHAM, W. ZHANG AND S. MCLOONE Analyzing the full set of fmri images, find out the most active voxels in several regions of the brain under the t-test of basic models in SP M99 and save their coordinates. for each fmri image do (a) scan the image and search for the ROI voxels corresponding to the saved coordinates. (b) for each ROI voxel compute the average of all voxels within its neighborhood (as defined by a sphere centered on the ROI voxel and with a radius set to a predefined constant). These resulting average values of ROI voxels constitute the feature vector for the image. end Algorithm 1: Feature selection & extraction algorithm for fmri data Figure 1. Pre-precessing workflow for fmri data Figure 2. Location for feature selection & extraction

5 A SWARM-BASED ROUGH SET APPROACH FOR FMRI DATA ANALYSIS 3125 f : U A V is the total decision function (also called the information function) such that f(x, a) V a for every a A, x U. The information system can also be defined as a decision table by S = (U, C, D, V, f). For the decision table, C and D are two subsets of attributes. A = {C D}, C D =, where C is the set of input features and D is the set of class indices. They are also called condition and decision attributes, respectively. Indiscernibility Relation: Let a C D, P C D. A binary relation IND(P ), called an equivalence (indiscernibility) relation, is defined as follows: IND(P ) = {(x, y) U U a P, f(x, a) = f(y, a)} (1) The equivalence relation IND(P ) partitions the set U into disjoint subsets. Let U/IND (P ) denote the family of all equivalence classes of the relation IND(P ). For simplicity of notation, U/P will be written instead of U/IND(P ). Such a partition of the universe is denoted by U/P = {P 1, P 2,, P i, }, where P i is an equivalence class of P, which is denoted [x i ] P. Equivalence classes U/C and U/D will be called condition and decision classes, respectively. Lower Approximation: Given a decision table T = (U, C, D, V, f). Let R C D, X U and U/R = {R 1, R 2,, R i, }. The R-lower approximation set of X is the set of all elements of U which can be with certainty classified as elements of X, assuming knowledge R. It can be presented formally as AP R R (X) = {R i R i U/R, R i X} (2) Positive Region: Given a decision table T = (U, C, D, V, f). Let B C, U/D = {D 1, D 2,, D i, } and U/B = {B 1, B 2,, B i, }. The B-positive region of D is the set of all objects from the universe U which can be classified with certainty to classes of U/D employing features from B, i.e., P OS B (D) = AP R B (D i) (3) D i U/D Reduct: Given a decision table T = (U, C, D, V, f). The attribute a B C is D-dispensable in B, if P OS B (D) = P OS (B {a}) (D); otherwise the attribute a is D- indispensable in B. If all attributes a B are D-indispensable in B, then B will be called D-independent. A subset of attributes B C is a D-reduct of C, if P OS B (D) = P OS C (D) and B is D-independent. It means that a reduct is the minimal subset of attributes that enables the same classification of elements of the universe as the whole set of attributes. In other words, attributes that do not belong to a reduct are superfluous with regard to classification of elements of the universe. Usually, there are many reducts in an instance information system. Let 2 A represent all possible attribute subsets {{a 1 },, {a A }, {a 1, a 2 },, {a 1,, a A }}. Let RED represent the set of reducts, i.e., RED = {B P OS B (D) = P OS C (D), P OS (B {a}) (D) < P OS B (D)} (4) Multi-knowledge: Let RED represent the set of reducts and let φ be a mapping from the condition space to the decision space. Then, multi-knowledge can be defined as follows: Ψ = {φ B B RED} (5) The rough set approach provides a tool for obtaining the reducts from a decision table. The reducts can be used to represent knowledge in real-world applications. Usually, each reduct can be applied to generate a single body of knowledge. In fact, many decision tables in the real world have multiple reducts, allowing multi-knowledge to be extracted based on multiple reducts. The results of extracting multi-knowledge can be expressed as rules.

6 3126 H. LIU, A. ABRAHAM, W. ZHANG AND S. MCLOONE Reduced Positive Universe and Reduced Positive Region: Given a decision table T = (U, C, D, V, f). Let U/C = {[u 1] C, [u 2] C,, [u m] C }. Reduced universe U can be written as: U = {u 1, u 2,, u m} (6) and P OS C (D) = [ u i 1 ]C [u i 2 ] C [u i t ] C, (7) where u i s U and [u i s ] C /D = 1 (s = 1, 2,, t). The reduced positive universe can be written as: U pos = {u i 1, u i 2,, u i t } (8) and B C, the reduced positive region P OS B(D) = X U /B X U pos X/D =1 X (9) where X/D represents the cardinality of the set X/D. B C, P OS B (D) = P OS C (D) if P OS B = U pos [30]. This provides a more efficient method for observing the change in positive region when we search for the reducts Particle swarm approach for reduction. Given a decision table, T = (U, C, D, V, f), the set of condition attributes, C, consist of m attributes. We set up a search space of m dimensions for the reduction problem. Accordingly each particle s position is represented as a binary bit string of length m. Each dimension of the particle s position maps one condition attribute. The domain for each dimension is limited to 0 or 1. The value 1 means the corresponding attribute is selected while 0 means it is not selected. Each position can be decoded to a potential reduction solution, a subset of C. The particle s position is a series of priority levels of the attributes. The sequence of an attribute will not be changed during an iteration. During the search procedure, the fitness of each individual is evaluated. According to the definition of rough set reducts, the reduction solution must ensure the decision ability is the same as the primary decision table and the number of attributes in the feasible solution is kept as low as possible. In our algorithm, we first evaluate whether the potential reduction solution satisfies P OS E = U pos or not (E is the subset of attributes represented by the potential reduction solution). If it is a feasible solution, we calculate the number of 1 s in it. The solution with the lowest number of 1 s is then selected. For the particle swarm, the fewer the number of 1 s in a particle string, the better the fitness of the individual. P OS E = U pos is used as the criterion for establishing the solution validity. The particle swarm model consists of a swarm of particles, which are initialized with a population of random candidate solutions. They move iteratively through the d-dimension problem space searching for better solutions, where the fitness f can be measured by calculating the number of condition attributes in the potential reduction solution. Each particle has a position represented by a position-vector p i (i is the index of the particle), and a velocity represented by a velocity-vector v i. Each particle remembers its own best position so far in a vector p # i, and its j-th dimensional value is p# ij. The best positionvector among the swarm so far is then stored in a vector p, and its j-th dimensional value is p j. The particle moves in a state space restricted to zero and one on each dimension. At each time step, each particle updates its velocity and moves to a new position according to Equations (10) and (11): ) v ij (t) = wv ij (t 1) + c 1 r 1 (p # ij (t 1) p ij(t 1) + c 2 r 2 (p j(t 1) p ij (t 1)). (10)

7 A SWARM-BASED ROUGH SET APPROACH FOR FMRI DATA ANALYSIS 3127 p ij (t) = { 1 if ρ < sig(v ij (t)); 0 otherwise, where c 1 is a positive constant, referred to as the coefficient of the self-recognition component, c 2 is a positive constant, called the coefficient of the social component and r 1 and r 2 are random numbers in the interval [0, 1]. The variable w is an inertia factor, whose value is typically setup to vary linearly from 1 to near 0 during the iterated processing. ρ is random number in the closed interval [0, 1]. The pseudo-code for the particle swarm search method is illustrated in Algorithm 2. Calculate U, U pos using Equations (6) and (8); Initialize the size of the particle swarm n, and other parameters; Initialize the positions and the velocities for all the particles randomly; while the end criterion is not met do t = t + 1; Calculate the fitness value of each particle; if P OS E U pos then the fitness is set as the total number of the condition attributes; else the fitness is the number of 1 in the position. end ( p = arg min n i=1 f ( p (t 1)), f( p 1 (t)), ) f( p 2 (t)),, f( p i (t)),, f( p n (t)) ; for i = 1 to n do ( ) ) p # i (t) = arg minn i=1 f ( p #i (t 1), f( p i (t)) ; for j = 1 to d do Update the j-th dimension value of p i and v i according to Equations (10) and(11). end end end Algorithm 2: A rough set reduct algorithm based on particle swarm optimisation (11) 4. Experimental Results and Discussion Experimental setup. In our experiments, we used Genetic Algorithm (GA) optimisation to benchmark the performance of PSO. Our algorithms were implemented in the C++ language and their parameters settings chosen in accordance with the recommendations of Abraham [32], Clerc [17] and Liu [20]. The computation environment was an Intel R Core T M Duo CPU GHz processor with 1G memory. In the GA, the probability of crossover was set to 0.8 and the probability of mutation was set to In PSO, self coefficient, c 1 and social coefficient, c 2, were both set as 1.49, and the inertia weight, w, was decreased linearly from 0.9 to 0.1. The size of the GA and PSO populations were both set to (even)( sqrt(d)), where D is the dimension of the position, i.e., the number of condition attributes. In each trial, the maximum number of iterations is (int)(0.1 recnum + 10 (nfields 1)), where recnum is the number of records/rows and nf ields is the number of condition attributes. Each experiment (for each algorithm) was repeated 3 times with different random seeds.

8 3128 H. LIU, A. ABRAHAM, W. ZHANG AND S. MCLOONE Table 1. Dataset information Dataset Samples No. of Attributes No. of Classes lung-cancer lymphography GA PSO R Iteration Figure 3. Performance of rough set reduction for the lung-cancer dataset 4.2. Testing on benchmarks. To illustrate the effectiveness and performance of the proposed algorithm, we illustrate the rough set reduct process and results on two benchmark problems, the well known lung-cancer and lymphography datasets from the UC Irvine machine learning repository 2. The lung-cancer dataset [33, 34] consists of 56 measurements (integer value attributes) and a corresponding classification of 27 lung biopsies into one of 3 types of pathological lung cancers. The lymphography data set [35, 36] consists of 18 categorical attributes and a corresponding diagnosis (normal find, metastases, malign lymph, fibrosis) for 148 lymph node biopsies. The information for the data sets is shown in Table 1. The objective in each case is to find the smallest set of attributes that can be used to correctly classify the biopsies. Figures 3 and 4 illustrate the performance of the algorithms for the lung-cancer and lymphography datasets, respectively. In the figures, R is the cardinality of the reduced set of attributes identified. For the lung-cancer dataset, the results (the identified reducts) for 3 repetitions of the GA and PSO algorithms are presented in Table 2. The corresponding results for the lymphography data set are given in Table 3. PSO usually achieves better results than GA optimization, although PSO is worse over the first 100 iterations, as illustrated in Figures 3 and 4. Even, in the cases where GA and PSO produce the same results, PSO converges more quickly than GA. In addition, multiple PSO runs usually produce multiple candidate reducts, allowing for the possibility of multi-knowledge extraction Extracting knowledge from fmri data. We analyze the fmri data from three cognition experiments involving: (a) tongue movement; (b) word association; (c) seeing and silently reading character data. There were 15 healthy young subjects (7 men and 8 women, mean age 22 years) in the tongue movement experiment, 10 healthy young subjects (5 men and 5 women, mean age 20.9 years) in the word association experiment and 12 healthy young subjects (5 men and 7 women, mean age 24.9 years) in the seeing 2

9 A SWARM-BASED ROUGH SET APPROACH FOR FMRI DATA ANALYSIS GA PSO R Iteration Figure 4. Performance of rough set reduction for the lymphography dataset Table 2. Reducts from the lung-cancer dataset Algorithm R Reduct(s) GA 10 1, 3, 9, 12, 33, 41, 44, 47, 54, , 14, 24, 30, 42, 44, 45, 50 PSO 9 3, 8, 9, 12, 15, 35, 47, 54, , 3, 12, 19, 25, 27, 30, 32, 40, 56 Table 3. Reducts from the lymphography dataset Algorithm R Reduct(s) GA 7 2, 6, 10, 13, 14, 17, , 13, 14, 15, 16, 18 PSO 7 1, 2, 13, 14, 15, 17, , 10, 12, 13, 14, 15, 18 and silently reading character data experiment. All subjects were recruited from the population of graduates and undergraduates at the Dalian Maritime University and Dalian University of Technology in Dalian, China. Informed consent was obtained before participation. The experiments involved a set of 9 tasks, as summarized in Table 4. Subjects were scanned on a 1.5T Siemens Magnetron Vision Scanner, employing a block design [37], while alternating between each of the tasks 1 to 8 in Table 4 and the control task. For the cognitive tasks, there are a total of 2580 fmri images, yielding a set of 2580 fmri records. A control experiment was also conducted in which the control task was alternated with itself to obtain a control task record. Using the approach described in Section 2 thirteen ROIs were identified for this set of tasks. For each ROI the activity level was labeled as either 0, 1, 2 or 3, corresponding to no, low, medium or high activity, respectively. The dataset includes 1 record for the control task and 2580 records for the other 8 cognitive tasks. Each record has an associated task identifier (0 9) stored in a decision attribute. In other words, the information system consists of 2581 rows and 14 columns (13 ROI attributes and one decision attribute) of data. The objective is to employ our PSO based rough set approach to identify multiple reducts for this system that can then form the basis for multi-knowledge extraction.

10 3130 H. LIU, A. ABRAHAM, W. ZHANG AND S. MCLOONE Table 4. The task sequence in the fmri experiments No. Task 0 Control task 1 Tongue movement 2 Associating verb from single noun 3 Associating verb from single non-noun 4 Making verb before single word 5 Looking at number 6 Silent reading Number 7 Looking at Chinese word 8 Silent reading Chinese word 15 Number of reducts Length of reduct Figure 5. Summary of the reducts obtained for the fmri dataset In our investigation the reduct estimation process was repeated 3 times with different random seeds. In each case, the PSO swarm size was set to 18 while the other parameter settings were as specified in Subsection 4.1. This provides 18 3 opportunities to extract reducts, although the length of these reduction results are not always optimal, in the sense of having minimum length. To verify that the algorithm was producing valid reducts, following convergence the solution represented by each particle was checked to see if it satisfied the criterion P OS E = U pos. The results obtained are summarized in Figure 5. All 54 reducts identified by the algorithm were valid, and varied in cardinality from two to seven. Once reducts have been identified they can be used to define classification rules. Typical examples are as follows: Rule 1: if M1 = 2, SMA = 2, Broca = 2 then Task = 1; Rule 2: if BAs{7,19,20,40,44,45} = 3, BSC = 2 then Task = 2; Rule 3: if BAs{10,11,13,44,45} = 3, BSC = 1 then Task = 3; Rule 4: if BAs{7,19,40} = 3, BSC = 3 then Task = 4; Rule 5: if SMA = 2, Broca = 3 then Task = 6; Rule 6: if SMA = 2, Broca = 2, Wernike = 3 then Task = 8. Here, M1, SMA, Broca, BSC and BAs {7, 10, 11, 13, 19, 20, 40, 44 and 45} are the anatomical labels [38] for the parts of the brain corresponding to the ROIs identified in the fmri pre-processing step. 5. Conclusions. In this paper, we investigated a rough set approach to extracting knowledge from fmri Data. The data preprocessing work flow and methods for the rough set

11 A SWARM-BASED ROUGH SET APPROACH FOR FMRI DATA ANALYSIS 3131 approach were discussed initially. Then, a rough set reduction approach that exploits the particle swarm optimization algorithm was presented as a means of determining the best feature combinations in an efficient manner. The approach involves observing the change in positive region as the PSO particles proceed through the search space. The performance of PSO and GA based reduct estimation has been compared on two benchmark datasets. The results indicate that PSO usually requires less time and obtains better results than the GA, although its stability needs to be improved in further research. Results have also been presented for fmri data analysis. Although the validity of the rules derived from the reducts cannot be established without further input from neuroscientists, the simplicity of the rules obtained suggest that the proposed approach has a lot of potential for solving the reduction problem, and therefore of significant benefit for cognition research. The proposed PSO based algorithm can identify multiple reducts and hence is capable of multi-knowledge extraction. However, in its current form it is not suitable for large scale datasets (greater than 3000 records), since it needs to extract the multiple reducts through a distributed multi-run search process. In order to work with much larger datasets, the search method needs to be improved significantly. Some improved PSO algorithms have been proposed in [18, 22, 39]. Exploring these alternate PSO implementations for efficient extraction of multi-knowledge from larger datasets is the subject of future research. Acknowledgment. The first author would like to thank Prof. Xiukun Wang and Drs. Shichang Sun, Benxian Yue, Mingyan Zhao and Hong Ye for their scientific collaboration in this research work. This work is supported by the National Natural Science Foundation of China (Grant Nos , ) and the Fundamental Research Funds for the Central Universities (Grant No. 2009QN043). REFERENCES [1] M. A. Arbib and J. S. Grethe, Computing the Brain: A Guide to Neuroinformatics, Academic Press, Boston, [2] A. Carpentier, K. R. Pugh, M. Westerveld, C. Studholme, O. Skrinjar, J. L. Thompson, D. D. Spencer and R. T. Constable, Functional MRI of language processing: Dependence on input modality and temporal lobe epilepsy, Epilepsia, vol.42, no.10, pp , [3] A. Rodriguez-Fornells, M. Rotte, H. J. Heinze, T. Nösselt and T. F. Münte, Brain potential and functional MRI evidence for how to handle two languages with one brain, Nature, vol.415, no.6875, pp , [4] E. Fedorenko and N. Kanwisher, Neuroimaging of language: Why hasn t a clearer picture emerged? Language and Linguistics Compass, vol.3, pp , [5] E. Fedorenko, P.-J. Hsieh, A. Castanon, S. Whitfield-Gabrieli and N. Kanwisher, A new method for fmri investigations of language: Defining ROIs functionally in individual subjects, Journal of Neurophysiology, vol.104, pp , [6] J. J. Pillaia, Insights into adult postlesional language cortical plasticity provided by cerebral blood oxygen level Dependent functional MR imaging, American Journal of Neuroradiology, vol.31, pp , [7] Z. Pawlak, Rough sets, International Journal of Computer and Information Sciences, vol.11, pp , [8] G. Røed, Knowledge Extraction from Process Data: A Rough Set Approach to Data Mining on Time Series, Master Thesis, Norwegian University of Science and Technology, [9] M. Boussouf, Hybrid approach to feature selection, Lecture Notes in Artificial Intelligence, vol.1510, pp , [10] A. Skowron and C. Rauszer, The discernibility matrices and functions in information systems, Handbook of Applications and Advances of the Rough Set Theory, pp , [11] J. Zhang, J. Wang, D. Li, H. He and J. Sun, A new heuristic reduct algorithm base on rough sets theory, Lecture Notes in Artificial Intelligence, vol.2762, pp , [12] K. Hu, L. Diao and L. Shi, A heuristic optimal reduct algorithm, Lecture Notes in Computer Science, vol.1983, pp , 2000.

12 3132 H. LIU, A. ABRAHAM, W. ZHANG AND S. MCLOONE [13] N. Zhong and J. Dong, Using rough sets with heuristics for feature selection, Journal of Intelligent Information Systems, vol.16, no.3, pp , [14] M. Banerjee, S. Mitra and A. Anand, Feature selection using rough sets, Studies in Computational Intelligence, vol.16, pp.3-20, [15] I. Babaoglu, O. Findik and Ü. Erkan, A comparison of feature selection models utilizing binary particle swarm optimization and genetic algorithm in determining coronary artery disease using support vector machine, Expert Systems with Applications, vol.37, no.4, pp , [16] J. Kennedy and R. Eberhart, Swarm Intelligence, Morgan Kaufmann Publishers, San Francisco, CA, [17] M. Clerc, Particle Swarm Optimization, ISTE Publishing Company, London, [18] X. Cai and Z. Cui, Hungry particle swarm optimization, ICIC Express Letters, vol.4, no.3(b), pp , [19] K. E. Parsopoulos and M. N. Vrahatis, Recent approaches to global optimization problems through particle swarm optimization, Natural Computing, vol.1, pp , [20] H. Liu, A. Abraham and M. Clerc, Chaotic dynamic characteristics in swarm intelligence, Applied Soft Computing, vol.7, no.3, pp , [21] Z. Cui, X. Cai and J. Zeng, Chaotic performance-dependent particle swarm optimization, International Journal of Innovative Computing, Information and Control, vol.5, no.4, pp , [22] C. Wang, P. Sui and W. Liu, Improved particle swarm optimization algorithm based on double mutation, ICIC Express Letters, vol.3, no.4(b), pp , [23] K. E. Parsopoulos and M. N. Vrahatis, On the computation of all global minimizers through particle swarm optimization, IEEE Trans. on Evolutionary Computation, vol.8, no.3, pp , [24] J. F. Schute and A. A. Groenwold, A study of global optimization using particle swarms, Journal of Global Optimization, vol.31, pp , [25] C. Lai, C. Wu and M. Tsai, Feature selection using particle swarm optimization with application in spam filtering, International Journal of Innovative Computing, Information and Control, vol.5, no.2, pp , [26] C. M. Lacadie, R. K. Fulbright, N. Rajeevan, R. T. Constable and X. Papademetris, More accurate Talairach coordinates for neuroimaging using non-linear registration, Neuroimage, vol.42, no.2, pp , [27] Y. Ji, H. Liu, X. Wang and Y. Tang, Cognitive states classification from fmri data using support sector machines, Proc. of the 3rd International Conference on Machine Learning and Cybernetics, pp , [28] Z. Pawlak, Rough sets and intelligent data analysis, Information Sciences, vol.147, pp.1-12, [29] G. Wang, Rough reduction in algebra view and information view, International Journal of Intelligent Systems, vol.18, pp , [30] Z. Xu, Z. Liu, B. Yang and W. Song, A quick attribute reduction algorithm with complexity of max(o( C U ), O( C 2 U/C )), Chinese Journal of Computers, vol.29, no.3, pp , [31] Q. X. Wu and D. A. Bell, Multi-knowledge extraction and application, Lecture Notes in Artificial Intelligence, vol.2639, pp , [32] A. Abraham, Evolutionary computation, in Handbook For Measurement Systems Design, P. Sydenham and R. Thorn (eds.), London, John Wiley and Sons Ltd., [33] A. Abraham, The power of decision tables, Lecture Notes in Computer Science, vol.912, pp , [34] L. Polat and S. Günes, Principles component analysis, fuzzy weighting pre-processing and artificial immune recognition system based diagnostic system for diagnosis of lung cancer, Expert Systems with Applications, vol.34, no.1, pp , [35] A. Hoang, Supervised Classifier Performance on the UCI Database, University of Adelaide, [36] U. G. Mangai, S. Samanta, S. Das and P. R. Chowdhury, A survey of decision fusion and feature fusion strategies for pattern classification, IETE Technical Review, vol.27, no.4, pp , [37] P. Rozencwajg and D. Corroyer, Strategy development in a block design task, Intelligence, vol.30, no.1, pp.1-25, [38] S. C. Blank, S. K. Scott, K. Murphy, E. Warburton and R. J. S. Wise, Speech production: Wernicke, broca and beyond, Brain, vol.125, no.8, pp , [39] S. S. Fan and J. Chang, Dynamic multi-swarm particle swarm optimizer using parallel PC cluster systems for global optimization of large-scale multimodal functions, Engineering Optimization, vol.42, no.5, pp , 2010.

Extracting Multi-Knowledge from fmri Data through Swarm-based Rough Set Reduction

Extracting Multi-Knowledge from fmri Data through Swarm-based Rough Set Reduction Extracting Multi-Knowledge from fmri Data through Swarm-based Rough Set Reduction Hongbo Liu 1, Ajith Abraham 2, Hong Ye 1 1 School of Computer Science, Dalian Maritime University, Dalian 116026, China

More information

A *69>H>N6 #DJGC6A DG C<>C::G>C<,8>:C8:H /DA 'D 2:6G, ()-"&"3 -"(' ( +-" " " % '.+ % ' -0(+$,

A *69>H>N6 #DJGC6A DG C<>C::G>C<,8>:C8:H /DA 'D 2:6G, ()-&3 -(' ( +-   % '.+ % ' -0(+$, The structure is a very important aspect in neural network design, it is not only impossible to determine an optimal structure for a given problem, it is even impossible to prove that a given structure

More information

EFFICIENT ATTRIBUTE REDUCTION ALGORITHM

EFFICIENT ATTRIBUTE REDUCTION ALGORITHM EFFICIENT ATTRIBUTE REDUCTION ALGORITHM Zhongzhi Shi, Shaohui Liu, Zheng Zheng Institute Of Computing Technology,Chinese Academy of Sciences, Beijing, China Abstract: Key words: Efficiency of algorithms

More information

Variable Neighborhood Particle Swarm Optimization for Multi-objective Flexible Job-Shop Scheduling Problems

Variable Neighborhood Particle Swarm Optimization for Multi-objective Flexible Job-Shop Scheduling Problems Variable Neighborhood Particle Swarm Optimization for Multi-objective Flexible Job-Shop Scheduling Problems Hongbo Liu 1,2,AjithAbraham 3,1, Okkyung Choi 3,4, and Seong Hwan Moon 4 1 School of Computer

More information

Argha Roy* Dept. of CSE Netaji Subhash Engg. College West Bengal, India.

Argha Roy* Dept. of CSE Netaji Subhash Engg. College West Bengal, India. Volume 3, Issue 3, March 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Training Artificial

More information

A Particle Swarm Approach to Quadratic Assignment Problems

A Particle Swarm Approach to Quadratic Assignment Problems A Particle Swarm Approach to Quadratic Assignment Problems Hongbo Liu 1,3, Ajith Abraham 2,3, and Jianying Zhang 1 1 Department of Computer Science, Dalian University of Technology, Dalian, 116023, China

More information

Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic Algorithm and Particle Swarm Optimization

Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic Algorithm and Particle Swarm Optimization 2017 2 nd International Electrical Engineering Conference (IEEC 2017) May. 19 th -20 th, 2017 at IEP Centre, Karachi, Pakistan Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic

More information

RECORD-TO-RECORD TRAVEL ALGORITHM FOR ATTRIBUTE REDUCTION IN ROUGH SET THEORY

RECORD-TO-RECORD TRAVEL ALGORITHM FOR ATTRIBUTE REDUCTION IN ROUGH SET THEORY RECORD-TO-RECORD TRAVEL ALGORITHM FOR ATTRIBUTE REDUCTION IN ROUGH SET THEORY MAJDI MAFARJA 1,2, SALWANI ABDULLAH 1 1 Data Mining and Optimization Research Group (DMO), Center for Artificial Intelligence

More information

Traffic Signal Control Based On Fuzzy Artificial Neural Networks With Particle Swarm Optimization

Traffic Signal Control Based On Fuzzy Artificial Neural Networks With Particle Swarm Optimization Traffic Signal Control Based On Fuzzy Artificial Neural Networks With Particle Swarm Optimization J.Venkatesh 1, B.Chiranjeevulu 2 1 PG Student, Dept. of ECE, Viswanadha Institute of Technology And Management,

More information

Job Scheduling on Computational Grids Using Fuzzy Particle Swarm Algorithm

Job Scheduling on Computational Grids Using Fuzzy Particle Swarm Algorithm Job Scheduling on Computational Grids Using Fuzzy Particle Swarm Algorithm Ajith Abraham 1,3, Hongbo Liu 2, and Weishi Zhang 3 1 School of Computer Science and Engineering, Chung-Ang University, Seoul,

More information

LEARNING WEIGHTS OF FUZZY RULES BY USING GRAVITATIONAL SEARCH ALGORITHM

LEARNING WEIGHTS OF FUZZY RULES BY USING GRAVITATIONAL SEARCH ALGORITHM International Journal of Innovative Computing, Information and Control ICIC International c 2013 ISSN 1349-4198 Volume 9, Number 4, April 2013 pp. 1593 1601 LEARNING WEIGHTS OF FUZZY RULES BY USING GRAVITATIONAL

More information

Improving Tree-Based Classification Rules Using a Particle Swarm Optimization

Improving Tree-Based Classification Rules Using a Particle Swarm Optimization Improving Tree-Based Classification Rules Using a Particle Swarm Optimization Chi-Hyuck Jun *, Yun-Ju Cho, and Hyeseon Lee Department of Industrial and Management Engineering Pohang University of Science

More information

Minimal Test Cost Feature Selection with Positive Region Constraint

Minimal Test Cost Feature Selection with Positive Region Constraint Minimal Test Cost Feature Selection with Positive Region Constraint Jiabin Liu 1,2,FanMin 2,, Shujiao Liao 2, and William Zhu 2 1 Department of Computer Science, Sichuan University for Nationalities, Kangding

More information

IMPROVING THE PARTICLE SWARM OPTIMIZATION ALGORITHM USING THE SIMPLEX METHOD AT LATE STAGE

IMPROVING THE PARTICLE SWARM OPTIMIZATION ALGORITHM USING THE SIMPLEX METHOD AT LATE STAGE IMPROVING THE PARTICLE SWARM OPTIMIZATION ALGORITHM USING THE SIMPLEX METHOD AT LATE STAGE Fang Wang, and Yuhui Qiu Intelligent Software and Software Engineering Laboratory, Southwest-China Normal University,

More information

GENETIC ALGORITHM VERSUS PARTICLE SWARM OPTIMIZATION IN N-QUEEN PROBLEM

GENETIC ALGORITHM VERSUS PARTICLE SWARM OPTIMIZATION IN N-QUEEN PROBLEM Journal of Al-Nahrain University Vol.10(2), December, 2007, pp.172-177 Science GENETIC ALGORITHM VERSUS PARTICLE SWARM OPTIMIZATION IN N-QUEEN PROBLEM * Azhar W. Hammad, ** Dr. Ban N. Thannoon Al-Nahrain

More information

Research on Applications of Data Mining in Electronic Commerce. Xiuping YANG 1, a

Research on Applications of Data Mining in Electronic Commerce. Xiuping YANG 1, a International Conference on Education Technology, Management and Humanities Science (ETMHS 2015) Research on Applications of Data Mining in Electronic Commerce Xiuping YANG 1, a 1 Computer Science Department,

More information

Research Article Path Planning Using a Hybrid Evolutionary Algorithm Based on Tree Structure Encoding

Research Article Path Planning Using a Hybrid Evolutionary Algorithm Based on Tree Structure Encoding e Scientific World Journal, Article ID 746260, 8 pages http://dx.doi.org/10.1155/2014/746260 Research Article Path Planning Using a Hybrid Evolutionary Algorithm Based on Tree Structure Encoding Ming-Yi

More information

Modified Particle Swarm Optimization

Modified Particle Swarm Optimization Modified Particle Swarm Optimization Swati Agrawal 1, R.P. Shimpi 2 1 Aerospace Engineering Department, IIT Bombay, Mumbai, India, swati.agrawal@iitb.ac.in 2 Aerospace Engineering Department, IIT Bombay,

More information

On Reduct Construction Algorithms

On Reduct Construction Algorithms 1 On Reduct Construction Algorithms Yiyu Yao 1, Yan Zhao 1 and Jue Wang 2 1 Department of Computer Science, University of Regina Regina, Saskatchewan, Canada S4S 0A2 {yyao, yanzhao}@cs.uregina.ca 2 Laboratory

More information

Feature weighting using particle swarm optimization for learning vector quantization classifier

Feature weighting using particle swarm optimization for learning vector quantization classifier Journal of Physics: Conference Series PAPER OPEN ACCESS Feature weighting using particle swarm optimization for learning vector quantization classifier To cite this article: A Dongoran et al 2018 J. Phys.:

More information

Multi-objective Peer-to-Peer Neighbor-Selection Strategy Using Genetic Algorithm

Multi-objective Peer-to-Peer Neighbor-Selection Strategy Using Genetic Algorithm Multi-objective Peer-to-Peer Neighbor-Selection Strategy Using Genetic Algorithm Ajith Abraham 1,3,BenxianYue 2, Chenjing Xian 3, Hongbo Liu 2,3, and Millie Pant 4 1 Centre for Quantifiable Quality of

More information

Novel Initialisation and Updating Mechanisms in PSO for Feature Selection in Classification

Novel Initialisation and Updating Mechanisms in PSO for Feature Selection in Classification Novel Initialisation and Updating Mechanisms in PSO for Feature Selection in Classification Bing Xue, Mengjie Zhang, and Will N. Browne School of Engineering and Computer Science Victoria University of

More information

CHAPTER 6 HYBRID AI BASED IMAGE CLASSIFICATION TECHNIQUES

CHAPTER 6 HYBRID AI BASED IMAGE CLASSIFICATION TECHNIQUES CHAPTER 6 HYBRID AI BASED IMAGE CLASSIFICATION TECHNIQUES 6.1 INTRODUCTION The exploration of applications of ANN for image classification has yielded satisfactory results. But, the scope for improving

More information

DECISION TREE INDUCTION USING ROUGH SET THEORY COMPARATIVE STUDY

DECISION TREE INDUCTION USING ROUGH SET THEORY COMPARATIVE STUDY DECISION TREE INDUCTION USING ROUGH SET THEORY COMPARATIVE STUDY Ramadevi Yellasiri, C.R.Rao 2,Vivekchan Reddy Dept. of CSE, Chaitanya Bharathi Institute of Technology, Hyderabad, INDIA. 2 DCIS, School

More information

Wrapper Feature Selection using Discrete Cuckoo Optimization Algorithm Abstract S.J. Mousavirad and H. Ebrahimpour-Komleh* 1 Department of Computer and Electrical Engineering, University of Kashan, Kashan,

More information

International Journal of Digital Application & Contemporary research Website: (Volume 1, Issue 7, February 2013)

International Journal of Digital Application & Contemporary research Website:   (Volume 1, Issue 7, February 2013) Performance Analysis of GA and PSO over Economic Load Dispatch Problem Sakshi Rajpoot sakshirajpoot1988@gmail.com Dr. Sandeep Bhongade sandeepbhongade@rediffmail.com Abstract Economic Load dispatch problem

More information

QUANTUM BASED PSO TECHNIQUE FOR IMAGE SEGMENTATION

QUANTUM BASED PSO TECHNIQUE FOR IMAGE SEGMENTATION International Journal of Computer Engineering and Applications, Volume VIII, Issue I, Part I, October 14 QUANTUM BASED PSO TECHNIQUE FOR IMAGE SEGMENTATION Shradha Chawla 1, Vivek Panwar 2 1 Department

More information

Optimized Algorithm for Particle Swarm Optimization

Optimized Algorithm for Particle Swarm Optimization Optimized Algorithm for Particle Swarm Optimization Fuzhang Zhao Abstract Particle swarm optimization (PSO) is becoming one of the most important swarm intelligent paradigms for solving global optimization

More information

CT79 SOFT COMPUTING ALCCS-FEB 2014

CT79 SOFT COMPUTING ALCCS-FEB 2014 Q.1 a. Define Union, Intersection and complement operations of Fuzzy sets. For fuzzy sets A and B Figure Fuzzy sets A & B The union of two fuzzy sets A and B is a fuzzy set C, written as C=AUB or C=A OR

More information

A Comparison of Global and Local Probabilistic Approximations in Mining Data with Many Missing Attribute Values

A Comparison of Global and Local Probabilistic Approximations in Mining Data with Many Missing Attribute Values A Comparison of Global and Local Probabilistic Approximations in Mining Data with Many Missing Attribute Values Patrick G. Clark Department of Electrical Eng. and Computer Sci. University of Kansas Lawrence,

More information

CHAPTER 6 ORTHOGONAL PARTICLE SWARM OPTIMIZATION

CHAPTER 6 ORTHOGONAL PARTICLE SWARM OPTIMIZATION 131 CHAPTER 6 ORTHOGONAL PARTICLE SWARM OPTIMIZATION 6.1 INTRODUCTION The Orthogonal arrays are helpful in guiding the heuristic algorithms to obtain a good solution when applied to NP-hard problems. This

More information

A Fuzzy C-means Clustering Algorithm Based on Pseudo-nearest-neighbor Intervals for Incomplete Data

A Fuzzy C-means Clustering Algorithm Based on Pseudo-nearest-neighbor Intervals for Incomplete Data Journal of Computational Information Systems 11: 6 (2015) 2139 2146 Available at http://www.jofcis.com A Fuzzy C-means Clustering Algorithm Based on Pseudo-nearest-neighbor Intervals for Incomplete Data

More information

Particle swarm optimization for mobile network design

Particle swarm optimization for mobile network design Particle swarm optimization for mobile network design Ayman A. El-Saleh 1,2a), Mahamod Ismail 1, R. Viknesh 2, C. C. Mark 2, and M. L. Chan 2 1 Department of Electrical, Electronics, and Systems Engineering,

More information

Cell-to-switch assignment in. cellular networks. barebones particle swarm optimization

Cell-to-switch assignment in. cellular networks. barebones particle swarm optimization Cell-to-switch assignment in cellular networks using barebones particle swarm optimization Sotirios K. Goudos a), Konstantinos B. Baltzis, Christos Bachtsevanidis, and John N. Sahalos RadioCommunications

More information

Optimization of Benchmark Functions Using Artificial Bee Colony (ABC) Algorithm

Optimization of Benchmark Functions Using Artificial Bee Colony (ABC) Algorithm IOSR Journal of Engineering (IOSRJEN) e-issn: 2250-3021, p-issn: 2278-8719 Vol. 3, Issue 10 (October. 2013), V4 PP 09-14 Optimization of Benchmark Functions Using Artificial Bee Colony (ABC) Algorithm

More information

Reconfiguration Optimization for Loss Reduction in Distribution Networks using Hybrid PSO algorithm and Fuzzy logic

Reconfiguration Optimization for Loss Reduction in Distribution Networks using Hybrid PSO algorithm and Fuzzy logic Bulletin of Environment, Pharmacology and Life Sciences Bull. Env. Pharmacol. Life Sci., Vol 4 [9] August 2015: 115-120 2015 Academy for Environment and Life Sciences, India Online ISSN 2277-1808 Journal

More information

Handling Multi Objectives of with Multi Objective Dynamic Particle Swarm Optimization

Handling Multi Objectives of with Multi Objective Dynamic Particle Swarm Optimization Handling Multi Objectives of with Multi Objective Dynamic Particle Swarm Optimization Richa Agnihotri #1, Dr. Shikha Agrawal #1, Dr. Rajeev Pandey #1 # Department of Computer Science Engineering, UIT,

More information

Classification with Diffuse or Incomplete Information

Classification with Diffuse or Incomplete Information Classification with Diffuse or Incomplete Information AMAURY CABALLERO, KANG YEN Florida International University Abstract. In many different fields like finance, business, pattern recognition, communication

More information

Mobile Robot Path Planning in Static Environments using Particle Swarm Optimization

Mobile Robot Path Planning in Static Environments using Particle Swarm Optimization Mobile Robot Path Planning in Static Environments using Particle Swarm Optimization M. Shahab Alam, M. Usman Rafique, and M. Umer Khan Abstract Motion planning is a key element of robotics since it empowers

More information

NOVEL HYBRID GENETIC ALGORITHM WITH HMM BASED IRIS RECOGNITION

NOVEL HYBRID GENETIC ALGORITHM WITH HMM BASED IRIS RECOGNITION NOVEL HYBRID GENETIC ALGORITHM WITH HMM BASED IRIS RECOGNITION * Prof. Dr. Ban Ahmed Mitras ** Ammar Saad Abdul-Jabbar * Dept. of Operation Research & Intelligent Techniques ** Dept. of Mathematics. College

More information

IMPROVED ARTIFICIAL FISH SWARM ALGORITHM AND ITS APPLICATION IN OPTIMAL DESIGN OF TRUSS STRUCTURE

IMPROVED ARTIFICIAL FISH SWARM ALGORITHM AND ITS APPLICATION IN OPTIMAL DESIGN OF TRUSS STRUCTURE IMPROVED ARTIFICIAL FISH SWARM ALGORITHM AD ITS APPLICATIO I OPTIMAL DESIG OF TRUSS STRUCTURE ACAG LI, CHEGUAG BA, SHUJIG ZHOU, SHUAGHOG PEG, XIAOHA ZHAG College of Civil Engineering, Hebei University

More information

Feature Selection Based on Relative Attribute Dependency: An Experimental Study

Feature Selection Based on Relative Attribute Dependency: An Experimental Study Feature Selection Based on Relative Attribute Dependency: An Experimental Study Jianchao Han, Ricardo Sanchez, Xiaohua Hu, T.Y. Lin Department of Computer Science, California State University Dominguez

More information

Efficient Rule Set Generation using K-Map & Rough Set Theory (RST)

Efficient Rule Set Generation using K-Map & Rough Set Theory (RST) International Journal of Engineering & Technology Innovations, Vol. 2 Issue 3, May 2015 www..com 6 Efficient Rule Set Generation using K-Map & Rough Set Theory (RST) Durgesh Srivastava 1, Shalini Batra

More information

A Web Page Recommendation system using GA based biclustering of web usage data

A Web Page Recommendation system using GA based biclustering of web usage data A Web Page Recommendation system using GA based biclustering of web usage data Raval Pratiksha M. 1, Mehul Barot 2 1 Computer Engineering, LDRP-ITR,Gandhinagar,cepratiksha.2011@gmail.com 2 Computer Engineering,

More information

Artificial Bee Colony (ABC) Optimization Algorithm for Solving Constrained Optimization Problems

Artificial Bee Colony (ABC) Optimization Algorithm for Solving Constrained Optimization Problems Artificial Bee Colony (ABC) Optimization Algorithm for Solving Constrained Optimization Problems Dervis Karaboga and Bahriye Basturk Erciyes University, Engineering Faculty, The Department of Computer

More information

Efficient SQL-Querying Method for Data Mining in Large Data Bases

Efficient SQL-Querying Method for Data Mining in Large Data Bases Efficient SQL-Querying Method for Data Mining in Large Data Bases Nguyen Hung Son Institute of Mathematics Warsaw University Banacha 2, 02095, Warsaw, Poland Abstract Data mining can be understood as a

More information

ARMA MODEL SELECTION USING PARTICLE SWARM OPTIMIZATION AND AIC CRITERIA. Mark S. Voss a b. and Xin Feng.

ARMA MODEL SELECTION USING PARTICLE SWARM OPTIMIZATION AND AIC CRITERIA. Mark S. Voss a b. and Xin Feng. Copyright 2002 IFAC 5th Triennial World Congress, Barcelona, Spain ARMA MODEL SELECTION USING PARTICLE SWARM OPTIMIZATION AND AIC CRITERIA Mark S. Voss a b and Xin Feng a Department of Civil and Environmental

More information

Fast Efficient Clustering Algorithm for Balanced Data

Fast Efficient Clustering Algorithm for Balanced Data Vol. 5, No. 6, 214 Fast Efficient Clustering Algorithm for Balanced Data Adel A. Sewisy Faculty of Computer and Information, Assiut University M. H. Marghny Faculty of Computer and Information, Assiut

More information

Genetic-PSO Fuzzy Data Mining With Divide and Conquer Strategy

Genetic-PSO Fuzzy Data Mining With Divide and Conquer Strategy Genetic-PSO Fuzzy Data Mining With Divide and Conquer Strategy Amin Jourabloo Department of Computer Engineering, Sharif University of Technology, Tehran, Iran E-mail: jourabloo@ce.sharif.edu Abstract

More information

Binary Differential Evolution Strategies

Binary Differential Evolution Strategies Binary Differential Evolution Strategies A.P. Engelbrecht, Member, IEEE G. Pampará Abstract Differential evolution has shown to be a very powerful, yet simple, population-based optimization approach. The

More information

A PSO-based Generic Classifier Design and Weka Implementation Study

A PSO-based Generic Classifier Design and Weka Implementation Study International Forum on Mechanical, Control and Automation (IFMCA 16) A PSO-based Generic Classifier Design and Weka Implementation Study Hui HU1, a Xiaodong MAO1, b Qin XI1, c 1 School of Economics and

More information

Feeder Reconfiguration Using Binary Coding Particle Swarm Optimization

Feeder Reconfiguration Using Binary Coding Particle Swarm Optimization 488 International Journal Wu-Chang of Control, Wu Automation, and Men-Shen and Systems, Tsai vol. 6, no. 4, pp. 488-494, August 2008 Feeder Reconfiguration Using Binary Coding Particle Swarm Optimization

More information

A Classifier with the Function-based Decision Tree

A Classifier with the Function-based Decision Tree A Classifier with the Function-based Decision Tree Been-Chian Chien and Jung-Yi Lin Institute of Information Engineering I-Shou University, Kaohsiung 84008, Taiwan, R.O.C E-mail: cbc@isu.edu.tw, m893310m@isu.edu.tw

More information

A Parallel Evolutionary Algorithm for Discovery of Decision Rules

A Parallel Evolutionary Algorithm for Discovery of Decision Rules A Parallel Evolutionary Algorithm for Discovery of Decision Rules Wojciech Kwedlo Faculty of Computer Science Technical University of Bia lystok Wiejska 45a, 15-351 Bia lystok, Poland wkwedlo@ii.pb.bialystok.pl

More information

FITTING PIECEWISE LINEAR FUNCTIONS USING PARTICLE SWARM OPTIMIZATION

FITTING PIECEWISE LINEAR FUNCTIONS USING PARTICLE SWARM OPTIMIZATION Suranaree J. Sci. Technol. Vol. 19 No. 4; October - December 2012 259 FITTING PIECEWISE LINEAR FUNCTIONS USING PARTICLE SWARM OPTIMIZATION Pavee Siriruk * Received: February 28, 2013; Revised: March 12,

More information

CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM

CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 20 CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 2.1 CLASSIFICATION OF CONVENTIONAL TECHNIQUES Classical optimization methods can be classified into two distinct groups:

More information

Feature Selection Algorithm with Discretization and PSO Search Methods for Continuous Attributes

Feature Selection Algorithm with Discretization and PSO Search Methods for Continuous Attributes Feature Selection Algorithm with Discretization and PSO Search Methods for Continuous Attributes Madhu.G 1, Rajinikanth.T.V 2, Govardhan.A 3 1 Dept of Information Technology, VNRVJIET, Hyderabad-90, INDIA,

More information

1 Lab 5: Particle Swarm Optimization

1 Lab 5: Particle Swarm Optimization 1 Lab 5: Particle Swarm Optimization This laboratory requires the following: (The development tools are installed in GR B0 01 already): C development tools (gcc, make, etc.) Webots simulation software

More information

Rough Set Approach to Unsupervised Neural Network based Pattern Classifier

Rough Set Approach to Unsupervised Neural Network based Pattern Classifier Rough Set Approach to Unsupervised Neural based Pattern Classifier Ashwin Kothari, Member IAENG, Avinash Keskar, Shreesha Srinath, and Rakesh Chalsani Abstract Early Convergence, input feature space with

More information

Hybrid Feature Selection for Modeling Intrusion Detection Systems

Hybrid Feature Selection for Modeling Intrusion Detection Systems Hybrid Feature Selection for Modeling Intrusion Detection Systems Srilatha Chebrolu, Ajith Abraham and Johnson P Thomas Department of Computer Science, Oklahoma State University, USA ajith.abraham@ieee.org,

More information

Particle Swarm Optimization

Particle Swarm Optimization Particle Swarm Optimization Gonçalo Pereira INESC-ID and Instituto Superior Técnico Porto Salvo, Portugal gpereira@gaips.inesc-id.pt April 15, 2011 1 What is it? Particle Swarm Optimization is an algorithm

More information

SIMULTANEOUS COMPUTATION OF MODEL ORDER AND PARAMETER ESTIMATION FOR ARX MODEL BASED ON MULTI- SWARM PARTICLE SWARM OPTIMIZATION

SIMULTANEOUS COMPUTATION OF MODEL ORDER AND PARAMETER ESTIMATION FOR ARX MODEL BASED ON MULTI- SWARM PARTICLE SWARM OPTIMIZATION SIMULTANEOUS COMPUTATION OF MODEL ORDER AND PARAMETER ESTIMATION FOR ARX MODEL BASED ON MULTI- SWARM PARTICLE SWARM OPTIMIZATION Kamil Zakwan Mohd Azmi, Zuwairie Ibrahim and Dwi Pebrianti Faculty of Electrical

More information

C-NBC: Neighborhood-Based Clustering with Constraints

C-NBC: Neighborhood-Based Clustering with Constraints C-NBC: Neighborhood-Based Clustering with Constraints Piotr Lasek Chair of Computer Science, University of Rzeszów ul. Prof. St. Pigonia 1, 35-310 Rzeszów, Poland lasek@ur.edu.pl Abstract. Clustering is

More information

Particle Swarm Optimization Approach for Scheduling of Flexible Job Shops

Particle Swarm Optimization Approach for Scheduling of Flexible Job Shops Particle Swarm Optimization Approach for Scheduling of Flexible Job Shops 1 Srinivas P. S., 2 Ramachandra Raju V., 3 C.S.P Rao. 1 Associate Professor, V. R. Sdhartha Engineering College, Vijayawada 2 Professor,

More information

Open Access Research on the Prediction Model of Material Cost Based on Data Mining

Open Access Research on the Prediction Model of Material Cost Based on Data Mining Send Orders for Reprints to reprints@benthamscience.ae 1062 The Open Mechanical Engineering Journal, 2015, 9, 1062-1066 Open Access Research on the Prediction Model of Material Cost Based on Data Mining

More information

An improved PID neural network controller for long time delay systems using particle swarm optimization algorithm

An improved PID neural network controller for long time delay systems using particle swarm optimization algorithm An improved PID neural network controller for long time delay systems using particle swarm optimization algorithm A. Lari, A. Khosravi and A. Alfi Faculty of Electrical and Computer Engineering, Noushirvani

More information

An Application of Genetic Algorithm for Auto-body Panel Die-design Case Library Based on Grid

An Application of Genetic Algorithm for Auto-body Panel Die-design Case Library Based on Grid An Application of Genetic Algorithm for Auto-body Panel Die-design Case Library Based on Grid Demin Wang 2, Hong Zhu 1, and Xin Liu 2 1 College of Computer Science and Technology, Jilin University, Changchun

More information

Density Based Clustering using Modified PSO based Neighbor Selection

Density Based Clustering using Modified PSO based Neighbor Selection Density Based Clustering using Modified PSO based Neighbor Selection K. Nafees Ahmed Research Scholar, Dept of Computer Science Jamal Mohamed College (Autonomous), Tiruchirappalli, India nafeesjmc@gmail.com

More information

Collaborative Rough Clustering

Collaborative Rough Clustering Collaborative Rough Clustering Sushmita Mitra, Haider Banka, and Witold Pedrycz Machine Intelligence Unit, Indian Statistical Institute, Kolkata, India {sushmita, hbanka r}@isical.ac.in Dept. of Electrical

More information

1 Lab + Hwk 5: Particle Swarm Optimization

1 Lab + Hwk 5: Particle Swarm Optimization 1 Lab + Hwk 5: Particle Swarm Optimization This laboratory requires the following equipment: C programming tools (gcc, make), already installed in GR B001 Webots simulation software Webots User Guide Webots

More information

Enhancing Forecasting Performance of Naïve-Bayes Classifiers with Discretization Techniques

Enhancing Forecasting Performance of Naïve-Bayes Classifiers with Discretization Techniques 24 Enhancing Forecasting Performance of Naïve-Bayes Classifiers with Discretization Techniques Enhancing Forecasting Performance of Naïve-Bayes Classifiers with Discretization Techniques Ruxandra PETRE

More information

Using CODEQ to Train Feed-forward Neural Networks

Using CODEQ to Train Feed-forward Neural Networks Using CODEQ to Train Feed-forward Neural Networks Mahamed G. H. Omran 1 and Faisal al-adwani 2 1 Department of Computer Science, Gulf University for Science and Technology, Kuwait, Kuwait omran.m@gust.edu.kw

More information

A Naïve Soft Computing based Approach for Gene Expression Data Analysis

A Naïve Soft Computing based Approach for Gene Expression Data Analysis Available online at www.sciencedirect.com Procedia Engineering 38 (2012 ) 2124 2128 International Conference on Modeling Optimization and Computing (ICMOC-2012) A Naïve Soft Computing based Approach for

More information

Application of Improved Discrete Particle Swarm Optimization in Logistics Distribution Routing Problem

Application of Improved Discrete Particle Swarm Optimization in Logistics Distribution Routing Problem Available online at www.sciencedirect.com Procedia Engineering 15 (2011) 3673 3677 Advanced in Control Engineeringand Information Science Application of Improved Discrete Particle Swarm Optimization in

More information

Comparing Classification Performances between Neural Networks and Particle Swarm Optimization for Traffic Sign Recognition

Comparing Classification Performances between Neural Networks and Particle Swarm Optimization for Traffic Sign Recognition Comparing Classification Performances between Neural Networks and Particle Swarm Optimization for Traffic Sign Recognition THONGCHAI SURINWARANGKOON, SUPOT NITSUWAT, ELVIN J. MOORE Department of Information

More information

Keywords Clustering, K-Mean, Firefly algorithm, Genetic Algorithm (GA), Particle Swarm Optimization (PSO).

Keywords Clustering, K-Mean, Firefly algorithm, Genetic Algorithm (GA), Particle Swarm Optimization (PSO). Volume 4, Issue 12, December 214 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com An Hybrid Technique

More information

A Modified PSO Technique for the Coordination Problem in Presence of DG

A Modified PSO Technique for the Coordination Problem in Presence of DG A Modified PSO Technique for the Coordination Problem in Presence of DG M. El-Saadawi A. Hassan M. Saeed Dept. of Electrical Engineering, Faculty of Engineering, Mansoura University, Egypt saadawi1@gmail.com-

More information

Classification Using Unstructured Rules and Ant Colony Optimization

Classification Using Unstructured Rules and Ant Colony Optimization Classification Using Unstructured Rules and Ant Colony Optimization Negar Zakeri Nejad, Amir H. Bakhtiary, and Morteza Analoui Abstract In this paper a new method based on the algorithm is proposed to

More information

Particle Swarm Optimization applied to Pattern Recognition

Particle Swarm Optimization applied to Pattern Recognition Particle Swarm Optimization applied to Pattern Recognition by Abel Mengistu Advisor: Dr. Raheel Ahmad CS Senior Research 2011 Manchester College May, 2011-1 - Table of Contents Introduction... - 3 - Objectives...

More information

A Hybrid Feature Selection Algorithm Based on Information Gain and Sequential Forward Floating Search

A Hybrid Feature Selection Algorithm Based on Information Gain and Sequential Forward Floating Search A Hybrid Feature Selection Algorithm Based on Information Gain and Sequential Forward Floating Search Jianli Ding, Liyang Fu School of Computer Science and Technology Civil Aviation University of China

More information

Hybrid Particle Swarm-Based-Simulated Annealing Optimization Techniques

Hybrid Particle Swarm-Based-Simulated Annealing Optimization Techniques Hybrid Particle Swarm-Based-Simulated Annealing Optimization Techniques Nasser Sadati Abstract Particle Swarm Optimization (PSO) algorithms recently invented as intelligent optimizers with several highly

More information

Discrete Particle Swarm Optimization With Local Search Strategy for Rule Classification

Discrete Particle Swarm Optimization With Local Search Strategy for Rule Classification Discrete Particle Swarm Optimization With Local Search Strategy for Rule Classification Min Chen and Simone A. Ludwig Department of Computer Science North Dakota State University Fargo, ND, USA min.chen@my.ndsu.edu,

More information

LECTURE 16: SWARM INTELLIGENCE 2 / PARTICLE SWARM OPTIMIZATION 2

LECTURE 16: SWARM INTELLIGENCE 2 / PARTICLE SWARM OPTIMIZATION 2 15-382 COLLECTIVE INTELLIGENCE - S18 LECTURE 16: SWARM INTELLIGENCE 2 / PARTICLE SWARM OPTIMIZATION 2 INSTRUCTOR: GIANNI A. DI CARO BACKGROUND: REYNOLDS BOIDS Reynolds created a model of coordinated animal

More information

An Approach to Polygonal Approximation of Digital CurvesBasedonDiscreteParticleSwarmAlgorithm

An Approach to Polygonal Approximation of Digital CurvesBasedonDiscreteParticleSwarmAlgorithm Journal of Universal Computer Science, vol. 13, no. 10 (2007), 1449-1461 submitted: 12/6/06, accepted: 24/10/06, appeared: 28/10/07 J.UCS An Approach to Polygonal Approximation of Digital CurvesBasedonDiscreteParticleSwarmAlgorithm

More information

Chapter 14 Global Search Algorithms

Chapter 14 Global Search Algorithms Chapter 14 Global Search Algorithms An Introduction to Optimization Spring, 2015 Wei-Ta Chu 1 Introduction We discuss various search methods that attempts to search throughout the entire feasible set.

More information

Convolutional Code Optimization for Various Constraint Lengths using PSO

Convolutional Code Optimization for Various Constraint Lengths using PSO International Journal of Electronics and Communication Engineering. ISSN 0974-2166 Volume 5, Number 2 (2012), pp. 151-157 International Research Publication House http://www.irphouse.com Convolutional

More information

A NEW APPROACH TO SOLVE ECONOMIC LOAD DISPATCH USING PARTICLE SWARM OPTIMIZATION

A NEW APPROACH TO SOLVE ECONOMIC LOAD DISPATCH USING PARTICLE SWARM OPTIMIZATION A NEW APPROACH TO SOLVE ECONOMIC LOAD DISPATCH USING PARTICLE SWARM OPTIMIZATION Manjeet Singh 1, Divesh Thareja 2 1 Department of Electrical and Electronics Engineering, Assistant Professor, HCTM Technical

More information

Approach Using Genetic Algorithm for Intrusion Detection System

Approach Using Genetic Algorithm for Intrusion Detection System Approach Using Genetic Algorithm for Intrusion Detection System 544 Abhijeet Karve Government College of Engineering, Aurangabad, Dr. Babasaheb Ambedkar Marathwada University, Aurangabad, Maharashtra-

More information

Hamming Distance based Binary PSO for Feature Selection and Classification from high dimensional Gene Expression Data

Hamming Distance based Binary PSO for Feature Selection and Classification from high dimensional Gene Expression Data Hamming Distance based Binary PSO for Feature Selection and Classification from high dimensional Gene Expression Data Haider Banka and Suresh Dara Department of Computer Science and Engineering Indian

More information

Particle Swarm Optimization

Particle Swarm Optimization Dario Schor, M.Sc., EIT schor@ieee.org Space Systems Department Magellan Aerospace Winnipeg Winnipeg, Manitoba 1 of 34 Optimization Techniques Motivation Optimization: Where, min x F(x), subject to g(x)

More information

THREE PHASE FAULT DIAGNOSIS BASED ON RBF NEURAL NETWORK OPTIMIZED BY PSO ALGORITHM

THREE PHASE FAULT DIAGNOSIS BASED ON RBF NEURAL NETWORK OPTIMIZED BY PSO ALGORITHM THREE PHASE FAULT DIAGNOSIS BASED ON RBF NEURAL NETWORK OPTIMIZED BY PSO ALGORITHM M. Sivakumar 1 and R. M. S. Parvathi 2 1 Anna University, Tamilnadu, India 2 Sengunthar College of Engineering, Tamilnadu,

More information

PARTICLE Swarm Optimization (PSO), an algorithm by

PARTICLE Swarm Optimization (PSO), an algorithm by , March 12-14, 2014, Hong Kong Cluster-based Particle Swarm Algorithm for Solving the Mastermind Problem Dan Partynski Abstract In this paper we present a metaheuristic algorithm that is inspired by Particle

More information

Improving the Efficiency of Fast Using Semantic Similarity Algorithm

Improving the Efficiency of Fast Using Semantic Similarity Algorithm International Journal of Scientific and Research Publications, Volume 4, Issue 1, January 2014 1 Improving the Efficiency of Fast Using Semantic Similarity Algorithm D.KARTHIKA 1, S. DIVAKAR 2 Final year

More information

Classification of Soil and Vegetation by Fuzzy K-means Classification and Particle Swarm Optimization

Classification of Soil and Vegetation by Fuzzy K-means Classification and Particle Swarm Optimization Classification of Soil and Vegetation by Fuzzy K-means Classification and Particle Swarm Optimization M. Chapron ETIS, ENSEA, UCP, CNRS, 6 avenue du ponceau 95014 Cergy-Pontoise, France chapron@ensea.fr

More information

Discrete Particle Swarm Optimization for TSP based on Neighborhood

Discrete Particle Swarm Optimization for TSP based on Neighborhood Journal of Computational Information Systems 6:0 (200) 3407-344 Available at http://www.jofcis.com Discrete Particle Swarm Optimization for TSP based on Neighborhood Huilian FAN School of Mathematics and

More information

[Kaur, 5(8): August 2018] ISSN DOI /zenodo Impact Factor

[Kaur, 5(8): August 2018] ISSN DOI /zenodo Impact Factor GLOBAL JOURNAL OF ENGINEERING SCIENCE AND RESEARCHES EVOLUTIONARY METAHEURISTIC ALGORITHMS FOR FEATURE SELECTION: A SURVEY Sandeep Kaur *1 & Vinay Chopra 2 *1 Research Scholar, Computer Science and Engineering,

More information

Attribute Reduction using Forward Selection and Relative Reduct Algorithm

Attribute Reduction using Forward Selection and Relative Reduct Algorithm Attribute Reduction using Forward Selection and Relative Reduct Algorithm P.Kalyani Associate Professor in Computer Science, SNR Sons College, Coimbatore, India. ABSTRACT Attribute reduction of an information

More information

Fuzzy C-means Clustering with Temporal-based Membership Function

Fuzzy C-means Clustering with Temporal-based Membership Function Indian Journal of Science and Technology, Vol (S()), DOI:./ijst//viS/, December ISSN (Print) : - ISSN (Online) : - Fuzzy C-means Clustering with Temporal-based Membership Function Aseel Mousa * and Yuhanis

More information

A METHOD FOR DIAGNOSIS OF LARGE AIRCRAFT ENGINE FAULT BASED ON PARTICLE SWARM ROUGH SET REDUCTION

A METHOD FOR DIAGNOSIS OF LARGE AIRCRAFT ENGINE FAULT BASED ON PARTICLE SWARM ROUGH SET REDUCTION A METHOD FOR DIAGNOSIS OF LARGE AIRCRAFT ENGINE FAULT BASED ON PARTICLE SWARM ROUGH SET REDUCTION ZHUANG WU Information College, Capital University of Economics and Business, Beijing 100070, China ABSTRACT

More information

Best First and Greedy Search Based CFS and Naïve Bayes Algorithms for Hepatitis Diagnosis

Best First and Greedy Search Based CFS and Naïve Bayes Algorithms for Hepatitis Diagnosis Best First and Greedy Search Based CFS and Naïve Bayes Algorithms for Hepatitis Diagnosis CHAPTER 3 BEST FIRST AND GREEDY SEARCH BASED CFS AND NAÏVE BAYES ALGORITHMS FOR HEPATITIS DIAGNOSIS 3.1 Introduction

More information