An Evolving Neuro-Fuzzy System with
Online Learning/Self-learning
Yevgeniy V. Bodyanskiy
Kharkiv National University of Radio Electronics, Kharkiv, Ukraine,
Email: bodya@kture.kharkov.ua

Oleksii K. Tyshchenko and Anastasiia O. Deineko
Kharkiv National University of Radio Electronics, Kharkiv, Ukraine,
Email: {lehatish, anastasiya.deineko}@gmail.com
Abstract— A new neuro-fuzzy system’s architecture and a learning method that adjusts its weights as well as automatically
determines a number of neurons, centers’ location of membership functions and the receptive field’s parameters in an online
mode with high processing speed is proposed in this paper. The basic idea of this approach is to tune both synaptic weights and
membership functions with the help of the supervised learning and self-learning paradigms. The approach to solving the problem
has to do with evolving online neuro-fuzzy systems that can process data under uncertainty conditions. The results proves the
effectiveness of the developed architecture and the learning procedure.
Index Terms— computational intelligence, evolving neuro-fuzzy system, online learning/ self-learning, membership function,
prediction/forecasting, machine learning.

I. INTRODUCTION
Nowadays artificial neural networks (ANNs) are widely used in Data Mining tasks, prediction tasks,
identification and emulation tasks etc. under conditions of uncertainty, nonlinearity, stochasticity and chaoticity,
various kinds of disturbance and noise [1-10]. They are universal approximators and are able to learn using data
which characterize the object under study. If data should be processed in a sequential online mode, a convergence
rate of a learning process comes to the forefront, which significantly limits the ANNs’ class suitable for work under
these conditions. ANNs, which use kernel activation functions (radial basis, bell-shaped, potential), are very
effective from the speed optimization point of view in the learning process. Radial-basis neural networks (RBFN)
are widely used, their output signal depends linearly on synaptic weights. It allows to use adaptive identification
algorithms like the recurrent least-squares method, the Kaczmarz (Widrow-Hoff) algorithm etc. for their learning.
However, the RBFN is exposed to the so-called “curse of dimensionality” which means that when the input space
dimensionality increases, there’s an exponential growth of the adjustable parameters’ (weights’) amount.
Neuro-fuzzy systems (NFSs) have more potential compared to neural networks [11-16], which combine learning
capabilities, universal approximating properties and linguistic transparency of the results. The most popular NFSs
are ANFIS and TSK-systems, whose output signal depends linearly on synaptic weights, that allows to use optimal
linear identification adaptive algorithms for their learning. At the same time, to avoid gaps in the input space
generated by scatter partitioning [17] which is used in ANFIS and TSK-systems, the parameters’ tuning of
membership functions is performed in the NFS’s first hidden layer. The backpropagation algorithm is used for this
purpose which is implemented with the help of multi-epochs learning [18]. Online tuning doesn’t work in this case.
The idea of evolving computational systems is very popular nowadays with Data Mining scientists [19-26]. Both
the system’s architecture and the amount of adjustable parameters are growing rapidly while processing data. To
control the RBFN activation functions’ parameters (centers and matrix receptive fields) in an online mode, it was
proposed in [27-29] to use the self-organizing Kohonen map [30], which provides these parameters’ tuning in the
self-learning process in an online mode. So the basic idea of this approach is to tune both synaptic weights and
membership functions with the help of the supervised learning and self-learning paradigms.
The approach to solving the problem has to do with evolving online neuro-fuzzy systems that can process data
under uncertainty conditions. It seems appropriate to extend this approach to an adaptive parameter tuning of
membership functions in neuro-fuzzy systems.
The proposed tuning procedure of activation functions’ parameters and their quantity was used in the proposed
evolving neuro-fuzzy architecture. The tuning procedure works in an online mode. The proposed computational
system was tested in forecasting tasks. The error was rather low (for a synthetic dataset: a training error was 0.02%,
a test error was 1.5%; for a real-world dataset: a training error was 4.4%, a test error was 5.4%).
The remainder of this paper is organized as follows: Section 2 gives a neuro-fuzzy system’s architecture and a
learning procedure of output layer parameters. Section 3 describes membership functions’ self-learning in the first

hidden layer. Section 4 presents time-series forecasting with the help of the proposed neuro-fuzzy system.
Conclusions and future work are given in the final section.
II. A NEURO-FUZZY SYSTEM’S ARCHITECTURE AND A LEARNING PROCEDURE OF OUTPUT LAYER PARAMETERS
The proposed system’s architecture (shown in fig.1) consists of five sequentially connected layers.
A  n  1  dimensional vector of input signals x(k )  ( x1 (k ), x2 (k ),..., xn (k ))T (here k  1, 2,... is current discrete

time) is fed to the input (zero) layer of the neuro-fuzzy system to be processed. The first hidden layer contains nh
( h for each input) membership functions il ( x) , i  1, 2,..., n; l  1, 2,..., h and carries out the input space
fuzzification. The second hidden layer provides the membership levels’ aggregation calculated in the first layer and
consists of h multiplication blocks. The third hidden layer is a layer of synaptic weights to be defined during a
learning process. The fourth layer is formed by two adders and calculates sums of the output signals of the second
and third layers. And, finally, normalization is fulfilled in the fifth (output) layer, which results in an output signal
ŷ calculation.
Thus, if a vector signal x  k  is fed to the NFS’s input the first hidden layer elements calculate membership
levels 0  li  x  k    1 , thus traditional Gaussian functions are commonly used as membership functions
  x  k   c 2
i
li
li  xi  k    exp  
2

2 i

where cli ,  i are centers’ parameters and width parameters



(1)


correspondingly. It should be noticed that the

preliminary data normalization on a certain interval, for example, 1  xi  k   1, simplifies calculations, since the
width parameters  i can be accepted equal for all the inputs, i.е.  i   .
n

Aggregated values

   x  k 
i 1

li

i

are calculated in the second hidden layer, thus the Gaussian functions with the

same width parameters  are
  x  k   c 2
i
li
li  xi  k     exp  

2

2

i 1
i 1

n

n

 x k   c

l
  exp  


2 2



2






(2)

(here cl   cl1 , cl 2 ,..., cl n  ), i.е. signals at the outputs of the multiplication blocks of the second hidden layer are
T

similar to the signals at the neurons’ outputs of the RBFN’s first hidden layer.

Fig.1. The neuro-fuzzy system’s architecture.

n

The third hidden layer outputs are wl  li  xi  k   (here wl , l  1, 2,..., h are synaptic weights to be defined),
i 1

the fourth hidden layer outputs are

n

h

 w    x  k 
l 1

l

li

i 1

i

and

h

n

   x  k  
li

l 1 i 1

i

and, finally, the system’s output (the

fifth layer) is
n

h

yˆ  x  k   

 w    x  k 
l 1
h

l

li

i 1

n

i

  li  xi  k  

n

   x  k 

h

  wl

li

i 1

i

n

h

  li  xi  k  

l 1

l 1 i 1

h

  wl l  x  k    wT   x  k  

(3)

l 1

l 1 i 1

where
n

l  x  k   

   x  k 
li

i 1

i

n

h

   x  k  
li

l 1 i 1

, w   w1 , w2 ,..., wh 

T

i

  x  k    1  x  k   ,  2  x  k   ,...,  h  x  k    .
T

It’s easy to notice that the proposed system implements a nonlinear mapping of the input space into a scalar
output signal like the normalized RBFN [31]. The proposed system in its architecture matches the zero-order
Takagi-Sugeno-Kang system, i.е. the Wang – Mendel architecture [15].
As already mentioned, to tune the NFS’s synaptic weights, one can use the well-known adaptive algorithms of
identification/learning like the exponentially weighted recurrent least-squares method






P  k  1 y  k   wT  k  1 y  x  k  
P  k  1  y  k   yˆ  k  
 w  k   w  k  1 
  x  k    w  k  1 
  x  k  ,
   T  x  k   P  k  1   x  k  
   T  x  k   P  k  1   x  k  



P  k  1   x  k    T  x  k   P  k  1 
(4)
1
,
 P  k    P  k  1 
T







x
k
P
k
x
k
1

















0
1




(here y  k  is a reference learning signal,  is a forgetting parameter of outdated information), or the one-step
gradient Kaczmarz-Widrow-Hoff algorithm (it’s optimal in speed):
y  k   wT  k  1   x  k  
w  k   w  k  1 
  x  k  ,
2
  x  k 

(5)

a learning algorithm which possesses both tracking and smoothing properties [32, 33]
 w  k   w  k  1  p 1  k  y  k   wT  k  1   x  k     x  k   ,

(6)

2
 p  k    p  k  1    x  k   , 0    1
and similar procedures, including the well-known linear identification procedures [31].
It’s interesting to note that the procedure (6) is associated with the algorithm (4) by the ratio
p  k   Tr P  k  ,
(7)





when   0 it gets the form of the algorithm (5).
III. MEMBERSHIP FUNCTIONS’ SELF-LEARNING IN THE FIRST HIDDEN LAYER
The membership functions’ tuning process in the first hidden layer can be illustrated by a two-dimensional input
vector x  k    x1  k  , x2  k   and five membership functions li  xi  k   , l  1, 2,3, 4,5; i  1, 2 at every input. In
T

this case, the NFS contains nh  10 membership functions. Centers’ initial positions cli  0  are evenly distributed

along axes x1 and x2 , a distance between them is defined according to this relation
  0 

xi max  xi min
2

 0,5
h 1
h 1

(8)

for 1  xi  1 .
This situation is illustrated in fig.2.
In the case of the multi-dimensional input vector x  k   R n , centers cli  0  are evenly distributed along the
hypercube axes  1,1 .
n

The first vector x1 is fed to the system input (in fig.2 – x 1   x1 1 , x2  2   ). There are centres-"winners"
T

cli*  0  on each axis, and they are the closest ones to xi 1 in the sense of a distance
dli  xi 1  cli  0  ,

i.е.

cli*  0   arg min d1i , d 2i ,..., d hi  .

(9)
(10)

Fig. 2. Membership functions’ self-learning at the first step.
Let’s notice that this procedure is in fact an implementation of the competitive process according to Т. Kohonen
[30] but there’s a slight difference that the «winner» on each axis can belong to membership functions with different
*
indexes l . These «winners» in fig.2 are c41
 0  and c42*  0  .
Then these «winners» catch up to the input signal’s components xi 1 according to the Kohonen self-learning
method «The winner takes all» (WTA), which can be written down for the situation in fig.2 in the form
cli*  0   li 1  xi 1  cli*  0  

(11)
cli 1  
for the winner l  4,
c 0 otherwise, l  1, 2,3,5;
 li  
and in a common case:
cli*  k  1  li  k   xi  k   cli*  k  1 

cli  k    for the winner l  1, 2,..., h; i  1, 2,..., n; (12)
c k  1 otherwise.

 li 
At the same time a value
1
li  k  
(13)
kli

can be accepted as a learning step parameter in the simplest case where kli is an amount of times when cli  k  was a

«winner» that corresponds to the popular К-means clusterization method (stochastic approximation in the case of
online processing).
In a common case, one can use an estimate which was proposed for the traditional Kohonen map [34]:
li  k   pli1 ,
(14)

2
 pli  k    pli  k  1  xi , 0    1.
It can be noticed that the proposed approach is a modification of the Kohonen self-learning method but the
difference is a traditional self-learning procedure is implemented on the hypersphere x  k   1 , in our case – on
2

the hypercube  1,1 (the hypersphere x  k   1, q   ).
n

q

The combined learning/self-learning architecture of the neuro-fuzzy system is shown in fig.3.

Fig.3. A combined learning/self-learning procedure.
The functioning process of the system is performed in the following way. When an input vector x  k  is fed, the
correction of membership functions li  xi  k   is carried out at first in the self-learning block, which means that
centers cli  k  are calculated. Then the neuro-fuzzy system’s output layer synaptic weights w  k  are calculated on
the grounds of clarified membership functions and a previously calculated synaptic weights’ vector w  k  1 with
the help of the supervised learning algorithms ((4), (5) or (6)).
IV. TIME-SERIES FORECASTING WITH THE HELP OF THE PROPOSED NEURO-FUZZY SYSTEM
In our experiment we used a signal generated by the Mackey-Glass equation [35] which is a non-linear
differential equation
x
dx
   n  x
(15)
dt
1  x
where  ,  , n are some coefficients, x is a value of a variable x in the  t     th time moment. The equation

produces a number of periodic and chaotic values depending on parameters. In this work, these values were
calculated with the help of the 4-th order Runge-Kutta method.

Fig.4. The Mackey-Glass time-series.
1600 values were generated with the help of the Mackey-Glass equation during a simulation procedure. These
values were normalized and fed to the neuro-fuzzy system input. The sample was divided into a training set and a
test set in the ratio 2:3. The learning results are shown in Fig.5:

Fig. 5. The neuro-fuzzy system’s learning results.
The learning error was about 0,02%. This high results’ accuracy is explained by stationary properties of the
Mackey-Glass time-series.
Then the system was transferred to a prediction mode. Prediction of the time-series values was fulfilled in an
online mode, and elaboration of adjustable parameters in the network in a prediction mode was not carried out. The
forecasting results are shown in Fig.6:

Fig.6. The prediction results of the Mackey-Glass time-series.
The error was 1.5% in a prediction mode.
To implement the experiment on real data, a sample that contains 2611 observations which characterize electricity
consumption in Ukraine (December 1st 2008 – May 25th 2014, monthly) is used. To build a predictor model based
on the proposed neural network’s architecture data preprocessing was carried out in the form shown in Tab.1 where
x1  k  is the amount of consumed electric power for the next month, x2  k  is the amount of consumed electric
power in the current month, x3  k  is a seasonal component and the amount of consumed electric power 12 months
ago.
Table 1. Electricity consumption in Ukraine (October 2013 – May 2014)

Oct
2013

Nov
2013

Dec
2013

Jan
2014

x1(k)

558275

543247

541478

582639

x2(k)

565640

558275

543247

541478

x3(k)

550135

534579

573978

589912

Feb
2014

Mar
2014

Apr
2014

May
2014

x1(k)

583798

579065

578932

575576

x2(k)

582639

579065

583798

578932

x3(k)

594405

568605

573412

598185

Fig.7. The graphical display of electricity consumption data.
The electricity consumption data were normalized and fed to the neuro-fuzzy network’s input. The network was
launched in a learning mode initially.
We obtained the results which are shown in Fig.8:

Fig.8. The neuro-fuzzy system’s results in a learning mode.
The result error on a training set was 4,43%.
Then our system was launched in a prediction mode. It should be noticed that the prediction results’ validation
was performed in such a way: the system returned a result vector whose values were in the range [0,1] as well as the
input vector’s values, and then values of this output vector with the help of the quadratic error criterion were
compared to actual values. Which means that the values predicted by the network itself were used as history. A
number of forecasted points was limited to 14. The prediction results are shown in Fig.9:

Fig.9. The prediction results of electricity consumption.
The error is 5,37%. We should notice that the total error at various time intervals was from 3 to 7%. At the
beginning of the experiment centers’ recalculation wasn’t performed after every new value had come to the system’s
input, and the error was up to 20%. After the centers’ values were recalculated, a function was rapidly leaving the
local extremum area. This led to a sharp decrease of the result error.
VI. CONCLUSION
The approach, which combines training of both synaptic weights and membership functions’ centers and which
is based on both supervised learning and self-learning, is proposed in this paper. The main advantage of the
proposed approach is that it can be used in an online mode, when a training set is fed to a system’s input
sequentially, and its volume is not fixed beforehand. The results can be used for solving a wide class of Dynamic
Data Mining problems.

ACKNOWLEDGMENT
The authors would like to thank anonymous reviewers for their careful reading of this paper and for their helpful
comments.
REFERENCES
[1]
[2]
[3]
[4]
[5]
[6]
[7]
[8]
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18]
[19]
[20]
[21]
[22]
[23]
[24]
[25]
[26]
[27]
[28]
[29]
[30]
[31]
[32]
[33]
[34]
[35]

A. Cichocki, R. Unbehauen, Neural Networks for Optimization and Signal Processing. Stuttgart: Teubner, 1993.
S. Haykin, Neural Networks: A Comprehensive Foundation. Upper Saddle River, New Jersey: Prentice Hall, 1999.
R.J. Schalkoff, Artificial Neural Networks, New York: The McGraw-Hill Comp., 1997.
D. Graupe, Principles of Artificial Neural Networks (Advanced Series in Circuits and Systems). Singapore: World Scientific
Publishing Co. Pte. Ltd., 2007.
K. Suzuki, Artificial Neural Networks: Architectures and Applications. NY: InTech, 2013.
G. Hanrahan, Artificial Neural Networks in Biological and Environmental Analysis. NW: CRC Press, 2011.
K.-L. Du and M.N.S. Swamy, Neural Networks and Statistical Learning. London: Springer-Verlag, 2014.
S.F. Lilhare and N.G. Bawane, “Artificial Neural Network Based Control Strategies for Paddy Drying Process”, in Int. J.
Information Technology and Computer Science, vol. 6, no. 11, 2014, pp.28-35, doi: 10.5815/ijitcs.2014.11.04.
M. Abo-Zahhad, S.M. Ahmed, and S.A. Abd-Elrahman, “Integrated Model of DNA Sequence Numerical Representation
and Artificial Neural Network for Human Donor and Acceptor Sites Prediction”, in Int. J. Information Technology and
Computer Science, vol. 6, no. 8, 2014, pp.51-57, doi: 10.5815/ijitcs.2014.08.07.
M.L. Pai, K.V. Pramod, and A.N. Balchand, “Long Range Forecast on South West Monsoon Rainfall using Artificial Neural
Networks based on Clustering Approach”, in Int. J. Information Technology and Computer Science, vol. 6, no. 7, 2014,
pp.1-8, doi: 10.5815/ijitcs.2014.07.01.
L. Rutkowski, Computational Intelligence. Methods and Tehniques. Berlin-Heidelberg: Springer-Verlag, 2008.
J.-S. Jang, C.-T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and
Maching Intelligence. Upper Saddle River, N.J.: Prentice Hall, 1997.
C.L. Mumford and L.C. Jain, Computational Intelligence. Berlin: Springer-Verlag, 2009.
R. Kruse, C. Borgelt, F. Klawonn, C. Moewes, M. Steinbrecher, and P. Held, Computational Intelligence. A Methodological
Introduction. Berlin: Springer-Verlag, 2013.
L.-X. Wang and J.M. Mendel, “Fuzzy basis functions, universal approximation and orthogonal least squares learning”, in
IEEE Trans. on Neural Networks, vol. 3, 1993, pp. 807-814.
K.J. Cios and W. Pedrycz, Neuro-fuzzy algorithms. Oxford: IOP Publishing Ltd and Oxford University Press, 1997.
J. Friedman, T. Hastie, and R. Tibshirani, The Elements of Statistical Learning. Data Mining, Inference and Prediction.
Berlin: Springer, 2003.
S. Osowski, Sieci neuronowe do przetwarzania informacji. Warszawa: Oficijna Wydawnicza Politechniki Warszawskiej,
2006.
N. Kasabov, Evolving Connectionist Systems. London: Springer-Verlag, 2003.
E. Lughofer, Evolving Fuzzy Systems – Methodologies, Advanced Concepts and Applications. Berlin-Heidelberg: SpringerVerlag, 2011.
Ye. Bodyanskiy, P. Grimm and N. Teslenko, “Evolving cascaded neural network based on multidimensional
Epanechnikov’s kernels and its learning algorithm,” in Int. J. Information Technologies and Knowledge, vol. 5, no. 1, 2011,
pp. 25-30.
P. Angelov, D. Filev, and N. Kasabov, Evolving Intelligent Systems: Methodology and Applications. New York: John Wiley
and Sons, 2010.
N. Kasabov, Evolving Connectionist Systems: The Knowledge Engineering Approach, London: Springer-Verlag, 2007.
N.K. Kasabov, “Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning”, in IEEE
Transactions on Systems, Man and Cybernetics, Part B: Cybernetics, no. 31(6), 2001, pp. 902-918.
N.K. Kasabov and Q. Song, “DENFIS: Dynamic evolving neural-fuzzy inference system and its application for time-series
prediction”, in IEEE Transactions on Fuzzy Systems, no. 10(2), 2002, pp. 144-154.
E. Lughofer, “FLEXFIS: A robust incremental learning approach for evolving TS fuzzy models”, in IEEE Transactions on
Fuzzy Systems, no. 16(6), 2008, pp. 1393-1410.
Ye.V. Bodyanskiy and A.A. Deineko, “Adaptive learning of the RBFN architecture and parameters”, in System
Technologies, vol.4, no. 87, 2013, pp. 166-173. (in Russian)
Ye.V. Bodyanskiy and A.A. Deineko, “The evolving radial-basis neural network and its learning with the help of the
Kohonen map”, in Proc. Sci. Conf. «Information Technologies in Metallurgy and Mechanical Engineering», 2013, pp. 7577. (in Russian)
J.A. Torres, S. Martinez, F.J. Martinez, and M. Peralta, “The problem of organizing and partition large data sets in learning
algorithms for SOM-RBF mixed structure”, in Proc. 5th Int. Joint Conf. on Computational Intelligence, 2013, pp. 497-501.
T. Kohonen, Self-Organizing Maps. Berlin: Springer-Verlag, 1995.
O. Nelles, Nonlinear System Identification. Berlin: Springer, 2001.
Ye. Bodyanskiy, V. Kolodyazhniy, and A. Stephan, “An adaptive learning algorithm for a neuro-fuzzy network”, in
Computational Intelligence. Theory and Applications, B. Reusch, Ed. Berlin – Heidelberg – New York: Springer, 2001,
pp. 68-75.
P. Otto, Ye. Bodyanskiy, and V. Kolodyazhniy, “A new learning algorithm for a forecasting neuro-fuzzy network”, in
Integrated Computer-Aided Engeneering, vol. 10, no. 4, 2003, pp. 399-409.
Ye.V. Bodyanskiy and О.G. Rudenko, Artificial Neural Networks: Architectures, Learning, Applications. Kharkiv:
ТЕLЕТЕH, 2004. (in Russian)
M.C. Mackey and L. Glass, “Oscillation and chaos in physiological control systems”, in Science, no. 197, 1977, pp. 238289.

