1XPHULFDO&RQVWUXFWLRQRI0HPEHUVKLS)XQFWLRQVDQG $JJUHJDWLRQ2SHUDWRUVIURP(PSLULFDO'DWD

Similar documents
Chapter 2: FUZZY SETS

CS 450 Numerical Analysis. Chapter 7: Interpolation

Lecture 8. Divided Differences,Least-Squares Approximations. Ceng375 Numerical Computations at December 9, 2010

Parameterization. Michael S. Floater. November 10, 2011

Knowledge Discovery and Data Mining

Spline Methods Draft. Tom Lyche and Knut Mørken

On Appropriate Selection of Fuzzy Aggregation Operators in Medical Decision Support System

1.2 Numerical Solutions of Flow Problems

Spline Methods Draft. Tom Lyche and Knut Mørken

Spline Methods Draft. Tom Lyche and Knut Mørken. Department of Informatics Centre of Mathematics for Applications University of Oslo

Parameterization of triangular meshes

Natural Quartic Spline

Course Number 432/433 Title Algebra II (A & B) H Grade # of Days 120

Middle School Math Course 2

Computational Physics PHYS 420

Middle School Math Course 3 Correlation of the ALEKS course Middle School Math 3 to the Illinois Assessment Framework for Grade 8

FUNDAMENTALS OF FUZZY SETS

Central Valley School District Math Curriculum Map Grade 8. August - September

Minnesota Academic Standards for Mathematics 2007

Introduction to Fuzzy Logic. IJCAI2018 Tutorial

An introduction to interpolation and splines

Things to Know for the Algebra I Regents

Montana City School GRADE 5

Numerical Methods in Physics Lecture 2 Interpolation

CHAPTER 5 FUZZY LOGIC CONTROL

Algorithms and Data Structures

08 - Designing Approximating Curves

implicit surfaces, approximate implicitization, B-splines, A- patches, surface fitting

Linear Models. Lecture Outline: Numeric Prediction: Linear Regression. Linear Classification. The Perceptron. Support Vector Machines

What is Multigrid? They have been extended to solve a wide variety of other problems, linear and nonlinear.

Simple Linear Interpolation Explains All Usual Choices in Fuzzy Techniques: Membership Functions, t-norms, t-conorms, and Defuzzification

Using a fuzzy inference system for the map overlay problem

Nonparametric Approaches to Regression

lecture 10: B-Splines

Voluntary State Curriculum Algebra II

7 Fractions. Number Sense and Numeration Measurement Geometry and Spatial Sense Patterning and Algebra Data Management and Probability

PITSCO Math Individualized Prescriptive Lessons (IPLs)

Dyadic Interpolation Schemes

Lecture 2.2 Cubic Splines

CHAPTER 6 Parametric Spline Curves

Chapter 18. Geometric Operations

Integrated Math I. IM1.1.3 Understand and use the distributive, associative, and commutative properties.

Anadarko Public Schools MATH Power Standards

Scope and Sequence for the New Jersey Core Curriculum Content Standards

GLOSSARY OF TERMS. Commutative property. Numbers can be added or multiplied in either order. For example, = ; 3 x 8 = 8 x 3.

Curve Representation ME761A Instructor in Charge Prof. J. Ramkumar Department of Mechanical Engineering, IIT Kanpur

Chapter 15 Introduction to Linear Programming

Disjunctive and Conjunctive Normal Forms in Fuzzy Logic

Assessing the Quality of the Natural Cubic Spline Approximation

Middle School Math Course 3

Themes in the Texas CCRS - Mathematics

2D Spline Curves. CS 4620 Lecture 13

Smarter Balanced Vocabulary (from the SBAC test/item specifications)

CURRICULUM UNIT MAP 1 ST QUARTER

I How does the formulation (5) serve the purpose of the composite parameterization

Interpolation by Spline Functions

Bellman s Escape Problem for Convex Polygons

2D Spline Curves. CS 4620 Lecture 18

7 th GRADE PLANNER Mathematics. Lesson Plan # QTR. 3 QTR. 1 QTR. 2 QTR 4. Objective

The goal is the definition of points with numbers and primitives with equations or functions. The definition of points with numbers requires a

Ohio Tutorials are designed specifically for the Ohio Learning Standards to prepare students for the Ohio State Tests and end-ofcourse

ALGEBRA II A CURRICULUM OUTLINE

CCSSM Curriculum Analysis Project Tool 1 Interpreting Functions in Grades 9-12

Curve and Surface Fitting with Splines. PAUL DIERCKX Professor, Computer Science Department, Katholieke Universiteit Leuven, Belgium

w KLUWER ACADEMIC PUBLISHERS Global Optimization with Non-Convex Constraints Sequential and Parallel Algorithms Roman G. Strongin Yaroslav D.

See the course website for important information about collaboration and late policies, as well as where and when to turn in assignments.

UNIT 1: NUMBER LINES, INTERVALS, AND SETS

DOWNLOAD PDF BIG IDEAS MATH VERTICAL SHRINK OF A PARABOLA

GEOG 5113 Special Topics in GIScience. Why is Classical set theory restricted? Contradiction & Excluded Middle. Fuzzy Set Theory in GIScience

Random Forest A. Fornaser

5. Compare the volume of a three dimensional figure to surface area.

Prentice Hall Mathematics: Course Correlated to: Colorado Model Content Standards and Grade Level Expectations (Grade 6)

correlated to the Illinois Mathematics Performance Descriptors

Nonparametric regression using kernel and spline methods

Equations and Functions, Variables and Expressions

Curriculum Connections (Fractions): K-8 found at under Planning Supports

Lecture 3 Box-partitions and dimension of spline spaces over Box-partition

Computergrafik. Matthias Zwicker Universität Bern Herbst 2016

Prentice Hall Mathematics: Pre-Algebra 2004 Correlated to: Colorado Model Content Standards and Grade Level Expectations (Grade 8)

Parametric Curves. University of Texas at Austin CS384G - Computer Graphics Fall 2010 Don Fussell

Integrated Mathematics I Performance Level Descriptors

8 Piecewise Polynomial Interpolation

Math background. 2D Geometric Transformations. Implicit representations. Explicit representations. Read: CS 4620 Lecture 6

8 th Grade Pre Algebra Pacing Guide 1 st Nine Weeks

Linear Methods for Regression and Shrinkage Methods

X Std. Topic Content Expected Learning Outcomes Mode of Transaction

VW 1LQH :HHNV 7KH VWXGHQW LV H[SHFWHG WR

Alignment to the Texas Essential Knowledge and Skills Standards

Bumptrees for Efficient Function, Constraint, and Classification Learning

Hands-On Standards Deluxe Grades: 7, 8 States: California Content Standards

Local Minima in Regression with Optimal Scaling Transformations

Computergrafik. Matthias Zwicker. Herbst 2010

EXPLORE MATHEMATICS TEST

Fuzzy Sets and Systems. Lecture 1 (Introduction) Bu- Ali Sina University Computer Engineering Dep. Spring 2010

Similarity Measures of Pentagonal Fuzzy Numbers

S. Sreenivasan Research Scholar, School of Advanced Sciences, VIT University, Chennai Campus, Vandalur-Kelambakkam Road, Chennai, Tamil Nadu, India

Large Data Analysis via Interpolation of Functions: Interpolating Polynomials vs Artificial Neural Networks

Research Article Data Visualization Using Rational Trigonometric Spline

Parametric Curves. University of Texas at Austin CS384G - Computer Graphics

Fuzzy Set-Theoretical Approach for Comparing Objects with Fuzzy Attributes

Transcription:

XPHULFDO&RQVWUXFWLRQRI0HPEHUVKLSXQFWLRQVDQG $JJUHJDWLRQSHUDWRUVIURP(PSLULFDO'DWD G. Beliakov School of Computing and athematics Deakin University Rusden campus, 66 Blackburn Rd., Clayton 368, Australia gleb@deakin.edu.au $EVWUDFW $ JRRG FKRLFH RI PHPEHUVKLS IXQFWLRQV DQG DJJUHJDWLRQ RSHUDWRUV LV FUXFLDO IRU WKH EHKDLRXU RI IX]]\ V\VWHPV *RRGQHVV RI ILW WR HPSLULFDO GDWD DQG IOHLELOLW\ LQ PRGHOOLQJ DULRXV VLWXDWLRQV DUH WKH PDLQ FULWHULD XVHG E\ GHHORSHUV KLV SDSHU SURLGHV D JHQHUDO PHWKRG IRU QRQSDUDPHWULF UHSUHVHQWDWLRQ RI PHPEHUVKLS IXQFWLRQV DQG DJJUHJDWLRQ RSHUDWRUV XVLQJ FRQVWUDLQHG VSOLQH IXQFWLRQV HQVRU SURGXFW PRQRWRQH VSOLQHV DUH XVHG WR DSSURLPDWH DJJUHJDWLRQ RSHUDWRUV GLUHFWO\ZKLOHXQLDULDWHVSOLQHVDUHXVHGWRDSSURLPDWH WKHLU DGGLWLH JHQHUDWRUV DPSOHV EDVHG RQ SXEOLVKHG HPSLULFDOGDWDDUHSURLGHG.H\ZRUGV Fuzzy sets, aggregation operators, monotone splines, least squares splines, non-parametric regression.,qwurgxfwlrq In the development of fuzzy systems, one frequently faces the problem of the adequate choice of membership functions (m.f. and aggregation operators (a.o.. It is customary (e.g. in fuzzy control to use triangular or trapezoidal membership functions, and PLQ, PD or product operators for operations on fuzzy sets. These choices are based mostly on the algebraic simplicity of these functions. Fine tuning allows one to adjust some parameters and to obtain the system whose behaviour is close to that of human experts. Fine tuning is generally DGKRF process which relies on the developer s guess and past experience. It does not compromise the overall comprehensibility of the system (it does not change the rule base but adjusts the form of membership functions and methods of aggregation, so that the system provides the desired output. While it certainly cannot be avoided, one can minimise guessing by selecting membership functions and operators in a more objective way. Both can be estimated from the empirical data. There exist a range of methods for experimental assessment of membership functions -6]. The majority of these methods are based on the weighted subjective opinion of experts. Using this empirical data, one can adjust the parameters of the selected algebraic representation, with the help of regression techniques. Similar procedure is applicable to aggregation operators. any families of a.o. are readily available, and their choice for a particular problem should be based on the quality of fit to empirical data rather than on picking. Having selected a particular family, one can adjust the parameters to the data - experts estimates of the membership values in the composed set and in the setscomponents. This is usually done using linear ], but mostly non-linear,8] regression. The process depends very much on the functions being used (compensatory operators, generalised means, ordered weighted aggregation, triangular norms, but none of the existing methods is general. A disadvantage of fixing the algebraic form of m.f. and a.o. is that there are no strong theoretical criteria for choosing the way of doing this. In other words, semantics of the problem does not translate into any particular algebraic formula, but determines a rather general class of m.f. and a.o. (continuous, unimodal; commutative, associative, etc.. Thus, one usually selects the simplest functions, which may not actually be the best. This paper develops an alternative, purely data driven way of representing m.f. and a.o. based on non-parametric techniques. This method is general: it works independently of the algebraic form of m.f. and a.o., and it is versatile in approximating functions of any shape, while preserving their semantics. On the other hand, it is based on standard well-studied techniques of spline approximation, which makes the algorithms and program code readily available. Furthermore, because our method is numerically efficient, it can be used as a generic mechanism of representing m.f. and a.o. in fuzzy systems. 0HPEHUVKLSIXQFWLRQV 3URSHUWLHVRIPHPEHUVKLSIXQFWLRQV The membership functions of fuzzy sets take a variety of shapes. S-shape, bell-shape, triangular and trapezoidal are the most common examples. Algebraically, these functions are expressed as piecewise polynomials, rational, exponential functions, etc. 0]. In the presence The adjective non-parametric is misleading. on-parametric methods (also called distribution-free in statistical literature actually do involve parameters, either fixed a priori or estimated from the data. Unlike in parametric approach, these parameters are not meaningful in relation to the original problem. A comprehensive discussion of the method of splines in non-parametric regression is given in ].

of empirical data, one can fix the desired algebraic form and fit the parameters to the data using regression techniques. Alternatively, it is possible to use nonparametric methods (for instance, joining the data points with straight lines 5], and thus to handle a more general class of functions. In this approach, we fix not the algebraic form but a class of functions (such as continuous, square integrable, smooth, etc. and let the data determine the shape of the estimator. In order to preserve the semantics of membership functions, we need to examine some of their properties 6,0], and then to ensure that the estimator I complies with them. First, note that membership functions are continuous. Second, their range is at most the unit interval 0,]. Finally, they are either monotone or unimodal (we consider only simple fuzzy sets, not set combinations, such as "Tall OR Short person", (convex fuzzy sets 6]. While the first two conditions are rather technical, monotonicity (unimodality is monotonicity on two neighbouring intervals is semantically important for order preservation. That is, if we choose some attribute as the measure of membership in the set, the higher its value, the bigger should be the membership. Therefore, we arrived to the problem of monotone (or isotone approximation, which translates into the restrictions on the class the membership function estimator can be drawn from. We will use a standard technique of non-parametric regression method of least squares splines. Splines arise as solutions to certain extremal problems in approximation theory (they are the most VPRRWK functions approximating the data,]. They can be represented as linear combinations of some basis functions E j I D E. The coefficients D are adjusted to fit the data in the least squares sense. Since the class of functions is limited to monotone ones, certain restrictions on the coefficients D have to be imposed. In the subsequent sections we examine these restrictions and design a basis in which these restrictions take the most simple form. We then apply our method to estimation of membership functions from the data. 8QLDULDWHPRQRWRQHVSOLQHV As our approximation technique, we choose to use polynomial B-splines ]. These functions have been extensively studied, they are quite versatile in approximating different shapes, easy to compute, and possess good smootheness properties. Spline approximation is a standard technique of numerical analysis, and detailed algorithms are available. Splines are categorised into three groups: interpolating, smoothing and least-squares splines,]. We consider least-squares splines here, because a the empirical data is not accurate (and therefore interpolation is not appropriate, and b we want a reduction in the number of coefficients representing the spline. Suppose, there is a given set of data points { \ }, L L L on the interval DE], and a prescribed set of knots + + { W }, W 0 D, W + E, that split DE] into + subintervals. The least squares spline 6 is a piecewise polynomial of order + which minimises the least squares criterion, ( 6 \ L L L The knots are the points where the polynomial segments are joined together. The spline 6 is expressed as 6 D, or 6 D ( + where + ( are normalised B-splines of order +, is the row-vector and D is the columnvector of coefficients. The indices run from - to, according to notation of ]. The linear space of functions of the form ( is the space of polynomial splines of order + on the partition { W }. Its dimension is 0++. Functions + ( possess many useful properties, such as positivity, local support, recursive definition, numerical stability, etc. However they are not well suited to express monotonicity condition. We look for a different representation of splines in which this condition is expressed better. Let us define the functions + P + P.. ( These 0 functions (trapezoidal, or T-splines also form a basis, and any spline can be represented as 6 E, or 6 E (3 + Expression (3 does not define any new spline, but merely changes the representation of the spline (. The choice of functions + ( is due to the following observations. The derivatives of + ( expressed in matrix form as + ê (, can be where ( is the row-vector of derivatives of ê + ê and is the two-diagonal 0í0 matrix whose non-zero entries are given by LL W W L L,. LL W W L L

Let ' k be the diagonal 0í0 matrix whose diagonal entries are ' W W. Then ( LL L L µ (' / where / is lower triangular matrix whose non-zero elements are all s. From ( /, and + ê + ( ( ê/ / ( ' ' The value of the derivative of the spline (3 is + ê ( E ' E 6 ê(., Since the functions are non-negative and the entries of ' k are non-negative, the sign of the derivative of the spline is the same as the sign of the components of E. Thus spline (3 is monotone increasing if E are positive, and is monotone decreasing if E are negative. A stronger result can be formulated for linear and quadratic splines ( and. In these cases the matrix k is diagonal, and therefore, the spline (3 is increasing if and only if E are positive (decreasing if and only if E are negative. Thus, for linear and quadratic splines (3, nonnegativity of the coefficients E is the necessary and sufficient condition for spline monotonicity. Unimodal splines are obtained by making part of E non-negative and the rest non-positive. To find coefficients of the spline (3 we need to minimize the least squares criterion subject to nonnegativity condition. It is the classical non-negative leastsquares problem LS ]. Efficient methods of its solution exist, and the algorithms are available in -4]. One such method, LSEI, takes the form Solve (E H, $E \, *E ã J, (4 Where $ is the matrix of observation equations, $ L L, stands for "approximately equal" (in the least squares sense, ( is the matrix of observation equations that need to be satisfied exactly (it could be empty, and * is the matrix of linear restrictions, in our case *, and J. The proposed method of monotone least squares splines consists in filling the matrix $ with the values of at data points L, and solving the LS problem using (4. Since /, standard algorithms for B-splines can be used, with subsequent matrix multiplication. On the other hand, once the vector E is found from (4, one can obtain the coefficients of the traditional (and more efficient B- splines representation ( using D/E. Figure presents a monotone linear spline, built using LSEI algorithm. For comparison, the usual linear spline is presented in figure. ote its failure to preserve monotonicity of the data. µ Figure : onotone least squares spline. Figure : Unrestricted linear least squares spline. SHULPHQWDOUHVXOWV Once we have an effective LS algorithm, we can use it to build membership functions from empirical data. At this point we would also like to impose some additional restrictions on function values, specifically its range. This can be easily done by forcing the spline to interpolate certain points, namely (D,0 and (E,, using the system (EH. Because the spline is monotone, its range will be exactly 0,]. To illustrate the method, we use the data from 5], the fuzzy set "tall people". Quadratic monotone spline with 5 approximation knots on DE] is used. The results are presented in figure 3. x x

µ fixed in advance. Usually fitting is performed using nonlinear regression. The method proposed here is general: it can approximate any generalised aggregation operator, and at the same time it provides tools to specify a particular family. It is based on monotone tensor product splines. HQVRUSURGXFWVSOLQHV Height (inches Figure 3 : Approximation of membership function of the fuzzy set "tall people" using monotone quadratic spline. $JJUHJDWLRQRSHUDWRUV &ODVVHVRIDJJUHJDWLRQRSHUDWRUV Aggregation operators are used to combine the membership values in the sets-components into one value, the membership in the composed set, which could be a union, intersection or some other combination. Besides classical PLQ and PD many other operators are frequently used in practice,5,6]. Unlike PLQ and PD, they do not possess some of the algebraic properties, especially mutual distributivity, and the choice based on set-theoretical soundness is very restrictive. Usually the choice is based on applicability to a particular problem, which translates into goodness of fit to the data ]. In one interpretation, all aggregation operators are equivalent to similarity relations,8], and none is theoretically more sound than the others. At all comes down to empirical evaluation. The most general class of aggregation operators is called generalised aggregation operators ]. It consists of all monotone non-decreasing functions I: 0,] n 0,], with the property I(0 and I(, where the number in bold denotes an Q-vector. Semantically, the monotonicity of the operator is very important (for instance for order preservation, and the boundary conditions allow one to obtain classical logic in the limiting case. Among generalised aggregation operators certain classes play a prominent role. Triangular norms T and conorms C possess commutativity and associativity properties, and their boundary conditions 5,6] T,, T,00, C,0, C, (5 are more restrictive. Averaging operators are commutative as well, but also idempotent. Some other properties, that we take advantage of, will be discussed in the next section. There exist several methods of fitting the parameters of aggregation operators to data,,8,0]. All these methods are specific to a particular class of operators Let the data be given as {( \ },, where L L L L is the V- dimensional vector. We split the V-dimensional domain into (+ V regions ((+ with respect to each + + dimension using the approximation knots { W }, with W 0 and W + coinciding with the ends of the interval 0,]. The tensor product of -splines is the construction ] ³...,..., (. The data is approximated with,...,... E (,...,....... 6, (6 or, in matrix form 6(... E E... E... E where denotes tensor product of matrices ]. Expressing partial derivatives in matrix form (... (' (...... (,... ('... E..., E ( 6( (... ê... E (... ê/... E The tensor product of the identity and diagonal matrices can be dropped (we are interested in the sign of the derivatives, not in their actual values, and the formula becomes 6( (...... E ( /...... / E (...... (/...,... / E with standing for "proportional". In the case (linear splines, the first tensor product is a positive diagonal matrix, which can be dropped. Therefore, the matrix * of linear restrictions on E in (4 is given by Ä* Å * Å... Å Å Æ * Ô Ö, * /...,... /. (8

For a particular case of bi-linear splines ( it translates into Q O P O E ã 0, Q,..., PO, P +,...,, ( E ã 0, P,..., O Q, Q +,...,. µ The problem of monotone multivariate spline approximation becomes the restricted least squares problem, which can be solved using LSEI algorithm (4. The rows of the matrices $ and ( are given by the values of tensor products of T-splines (, and the matrix * is given by (8. y x $SSURLPDWLRQRIDJJUHJDWLRQRSHUDWRUV Given empirical data {( \ },, the generalised L L L aggregation operator is approximated with bi-linear (or multi-linear monotone spline using LSEI algorithm as described in the previous section. The boundary conditions I(0 and I( are enforced by specifying the appropriate entries of the matrix ( and vector H. As an illustration, we took the data from ] (figure 4. It represents subjects estimates of the membership values of various objects in the fuzzy sets "metallic object", "container" and "metallic container", taken on three different occasions. The empirical data is shown with circles. In figure 5 the quality of approximation is illustrated with the graph of predicted vs. observed values, as in ] (the straight line corresponds to perfect fit. Sometimes additional restrictions on the class the aggregation operator is selected from are required because of the semantics of the problem. Certain restrictions can be introduced into LSEI algorithm directly. For instance, additional boundary conditions (5 can be enforced by requiring the spline to interpolate the values 6 ( W, W, 6( W,0 0 or 6 ( W,0 W, 6( W,, O O O O O O Figure 4 : Approximation of an aggregation operator using data from ]. µ predicted µ predicted µ predicted µ predicted µ observed Figure 5 : Quality of approximation of the operator. where W O, O0,,+ are the approximation knots within 0,]. Since the spline is linear, this would guarantee (5. Like the other interpolation conditions, this is done by setting the values of ( and H. Another possible restriction of this type is 6, (idempotency, which is important for averaging operators. It is easily translated into the interpolation conditions 6 ( WO, W O W O. Commutativity of the aggregation operator can be enforced in two ways. The first method is to use half of the matrix E (it should be symmetric and linear combinations of tensor product T-splines + y µ x as the basis functions. The second method is to double up the empirical data and to use {(,, and { },, \ L, L L L }, L \ L L L in the general method of tensor product Figure 6 : Approximation of the Hamacher sum operator using tensor product linear spline with boundary conditions (5.

approximation. At the final stage it is necessary to ensure that E is symmetric (in the process of numerical computations the symmetry may be broken. Figure 6 illustrates approximation of a triangular conorm (Hamacher sum operator + \ \ I, \ \ with monotone tensor product spline.the 0 data points are randomly generated and are marked with circles. The data also contains random noise uniformly distributed in -0.,0.]. Restrictions (5 are enforced. $GGLWLHJHQHUDWRUV $VVRFLDWLLW\RIWULDQJXODUQRUPV Unlike commutativity and boundary conditions, associativity property of aggregation operators does not have direct geometrical interpretation ]. So it cannot be introduced into the process of multivariate spline approximation by means of any restrictions. Still associativity could be semantically important, and together with commutativity and boundary conditions, it defines the important class of triangular norms (co-norms. Fortunately, a large proportion of triangular norms (conorms, called Archimedian norms (T,<, C,>, (0, possess additive generators 4,0], the monotone functions J: 0,] 0,ì, J(0 (J(00 for co-norms. The generator is unique up to a multiplier, and is due primarily to the associativity ]. The operators are obtained from (DEJ -] (J(D+J(E or &(DEJ -] (J(D+J(E, (0 where J -] is the pseudoinverse function 6]. The Eqs. (0 can be used to approximate the triangular norms and co-norms from data, using their additive generators. This way the associativity of the aggregation operators can be enforced. 4XDVLDULWKPHWLFPHDQV Another class of aggregation operators that possess generator functions is the class of quasi-arithmetic means. They are defined from 3] Ä + Ô J( D J( E 0 ( D, E J Å, ( Æ Ö where J is continuous and strictly monotone. A particular case is quasi-linear averaging operators (J S 8], see also 4]. As with the case of triangular norms, one can approximate operators of this class by approximating their generators. The next section describes how to do this using monotone splines. $SSURLPDWLRQRIJHQHUDWRUIXQFWLRQV Consider triangular co-norms. From (0 we have J(& J + J ; J + J -J(& 0. As the empirical data we have {( },, \ L,. We L L L approximate the unknown generator function J with a monotone spline (3. Then, from (3 E ( + ( 0 ( \, or E,, 0, ( ( \ where,, \ are the new functions of three variables. Thus, we approximate the function I(DEF0 on 0,] 3 using linear combination (, where coefficients E have to be non-negative to ensure monotonicity of J. Once again we arrived to the problem of non-negative least squares, that can be solved using LS or LSEI algorithm. After the function J is found, the actual operator is computed numerically from (0. This is an expensive procedure, because the inverse of the spline is not available in closed form. It is preferable to tabulate the values of the operator for certain values of the arguments (e.g., on a rectangular grid, and then to build a simple tensor product interpolating spline (or use any other method of interpolation. In a similar way the generators of quasi-arithmetic means ( are found. Instead of ( one uses ( + ( 0 E. ( \ This method is easily generalised for Q-dimensional case (averaging operators generally are not associative by using Ä + + Ô J(... J( Q 0,..., Q J Å Æ Q Ö &RQFOXVLRQV, ( +... + } ( 0 E. { Q Q \ In the development of fuzzy systems, membership functions of fuzzy sets and aggregation operators can rarely be defined on the basis of some abstract theoretical properties. Usually they are adjusted to fit some form of empirical data, be it the data from a controlled experiment, or subjective "feeling" of the developer. In traditional parametric approaches, the algebraic form of m.f. or a.o. is fixed, and a small number of parameters are varied to fit the data in the least squares sense. These methods are subject to two major difficulties: technical -

the selected parameters enter the expression non-linearly, and non-linear approximation is notoriously difficult, and semantical - the algebraic form of m.f. and a.o. can rarely be translated into a meaningful semantical interpretation. On the other hand, high level concepts with clear semantical meaning, such as continuity, commutativity, idempotency or associativity of operators, define classes so large that they cannot be parameterised with any finite number of parameters. In contrast, non-parametric approach is purely data driven. The quality of fit is the most important criterion, and any function adequately describing the data is acceptable, unless it contradicts basic semantically important properties. Among the most important semantical properties is order preservation, which translates into monotonicity. Thus, to be useful, any method of non-parametric estimation of m.f. and a.o. has to provide adequate tools to ensure the monotonicity of the functions. Polynomial splines are a powerful method of approximation and non-parametric regression. Splines are versatile in approximating functions of any shape, but their well known drawback is not preserving the shape of the derivatives. Special methods to ensure monotonicity or convexity have to be employed. This paper develops one such method, applicable to univariate and multivariate least squares splines. It translates monotonicity into a simple requirement of nonnegativity of the coefficients of the spline, and the problem is reduced to standard linear restricted least squares problem. Approximation of membership functions with splines is relatively straightforward: linear or quadratic monotone splines provide an appropriate solution. Aggregation operators provide room for several methods of approximation. Generalised a.o. can be approximated using monotone tensor product spline. This method takes into account only the data. Additional boundary conditions (5 and idempotency can be specified as interpolation conditions. Commutativity can be achieved by making the matrix of coefficients symmetric. Triangular norms and co-norms can be approximated using their additive generators. It ensures their associativity. Quasi-arithmetic means can be approximated using their generator functions. Thus, the advantage of using monotone splines is their generality on the one hand, and a range of tools they provide to select a particular class or property on the other. Linearity of the approximation problem is also a bonus. Besides being a method for building m.f. and a.o. from empirical data, monotone splines are also an effective tool for representation and coding of known operators. Indeed, rather than representing an operator/m.f. in algebraic form, one can specify its values at certain points, and then build a spline that accurately approximates it. The numerical computation of such approximation is practically as effective as using the original algebraic representation (one should pass to B-spline representation (, which is numerically very stable and efficient. This way one can provide a generic code (for fuzzy controllers, or for decision or expert systems, while the actual operators and membership functions used by the system will be determined by the supplied array of coefficients. 5HIHUHQFHV ] H.-J. Zimmermann, X]]\ VHW WKHRU\ DQG LWV DSSOLFDWLRQV, Kluwer, Boston, 6. ] E. Hisdal, /RJLFDO VWUXFWXUHV IRU UHSUHVHQWDWLRQ RI QRZOHGJHDQGXQFHUWDLQW\, Physica-Verlag, ew ork, 8. 3] G. Beliakov, X]]\ VHWV DQG PHPEHUVKLS IXQFWLRQV EDVHGRQSUREDELOLWLHV, Information Sciences, : 5-, 5. 4] G.P. Amaya Cruz and G. Beliakov. $SSURLPDWH UHDVRQLQJ DQG LQWHUSUHWDWLRQ RI ODERUDWRU\ WHVWV LQ PHGLFDO GLDJQRVWLFV, Cybernetics and Systems, 6: 3-, 5. 5] A.. orwich and I.B. Turksen $ PRGHO IRU WKH PHDVXUHPHQWRIPHPEHUVKLSDQGWKHFRQVHTXHQFHVRILWV HPSLULFDOLPSOHPHQWDWLRQ, Fuzzy Sets and Systems, : - 5, 84. 6] J.E. Chen and K.. Otto, &RQVWUXFWLQJ PHPEHUVKLS IXQFWLRQV XVLQJ LQWHUSRODWLRQ DQG PHDVXUHPHQW WKHRU\, Fuzzy Sets and Systems, 3: 33-3, 5. ] D. Filev and R. agerqwkhlvvxhrirewdlqlqj:$ RSHUDWRUZHLJKWV, Fuzzy Sets and Systems, 4: 5-6, 8. 8] H. Dyckhoff and W. Pedrycz, *HQHUDOL]HG PHDQV DV PRGHO RI FRPSHQVDWLH FRQQHFWLHV, Fuzzy Sets and Systems,4: 43-54, 84. ] R. L. Eubank RQSDUDPHWULF UHJUHVVLRQ DQG VSOLQH VPRRWKLQJ, arcel Dekker, ew ork,. 0] J. Dombi, 0HPEHUVKLSIXQFWLRQDVHDOXDWLRQ, Fuzzy Sets and Systems, 35: -, 0. ] P. Dierckx, &XUH DQG VXUIDFH ILWWLQJ ZLWK VSOLQHV, Clarendon press, Oxford, 5. ] C. Lawson and R.Hanson, 6ROLQJ OHDVW VTXDUHV SUREOHPV, SIA, Philadelphia, 5. 3] R.J. Hanson and K.H. Haskell, $OJRULWKPZR DOJRULWKPV IRU WKH OLQHDUO\ FRQVWUDLQHG OHDVW VTXDUHV SUREOHP, AC Trans. ath. Software, 8: 33-333, 8. 4] J.J. Dongarra and E. Grosse 'LVWULEXWLRQ RI PDWKHPDWLFDOVRIWZDUHLDHOHFWURQLFPDLO, Comm. AC, 30: 403-440, 8. 5] D. Dubois and H. Prade $ UHLHZ RI IX]]\ VHW DJJUHJDWLRQ FRQQHFWLHV, Information Sciences, 36: 85-, 85. 6]. izumoto, 3LFWRULDO UHSUHVHQWDWLRQV RI IX]]\ FRQQHFWLHV 3DUW, &DVHV RI WQRUPV WFRQRUPV DQG DHUDJLQJ RSHUDWRUV, Fuzzy Sets and Systems, 3: - 4, 8. ] G. Beliakov, 'HILQLWLRQ RI JHQHUDO DJJUHJDWLRQ RSHUDWRUV WKURXJK VLPLODULW\ UHODWLRQV, Fuzzy Sets and Systems, 4: -0, 000. 8] G. Beliakov, $JJUHJDWLRQ SHUDWRUV DV 6LPLODULW\ 5HODWLRQV, in:,qirupdwlrq 8QFHUWDLQW\ XVLRQ, eds. R. ager, B. Bouchon-eunier and L. Zadeh, Kluwer, Boston,, 33-34.

] G. Klir and T. Folger, X]]\ VHWV XQFHUWDLQW\ DQG LQIRUPDWLRQ, Prentice Hall, Singapore,. 0] H.-J. Zimmermann and P. Zysno/DWHQWFRQQHFWLHV LQ KXPDQ GHFLVLRQ PDLQJ, Fuzzy Sets and Systems 4: 3-5, 80. ] P. Halmos,LQLWHGLPHQVLRQDOHFWRUVSDFHV, D.van ostrand Company, Princeton, 58. ] B. Schweizer and A. Sklar$VVRFLDWLHIXQFWLRQVDQG VWDWLVWLFDO WULDQJOH LQHTXDOLWLHV, Publ. athematicae Debrecen, 8: 6-86, 6. 3] J. AczelQDSSOLFDWLRQVDQGWKHRU\RIIXQFWLRRQDO HTXDWLRQV, Academic Press, ew ork, 6. 4] J. Dombi, $JHQHUDOFODVVRIIX]]\RSHUDWRUVWKHGH 0RUJDQ FODVV RI IX]]\ RSHUDWRUV DQG IX]]LQHVV PHDVXUHV LQGXFHG E\ IX]]\ RSHUDWRUV, Fuzzy Sets and Systems, 8: 4-63, 8.