INTERNATIONAL JOURNAL OF BIOLOGY AND BIOMEDICAL ENGINEERING

Volume 8, 2014

Ensembled Correlation Between Liver Analysis
Outputs
S. E. Seker, Y. Unal, Z. Erdem, and H. Erdinc Kocer

patterns or temporal monitoring of the liver disease status.
Liver function tests are operated to give information about
the patient’s liver. The tests can be applied for several reasons.
• Screening to identify the liver dsyfunction

Abstract—Data mining techniques on the biological analysis are
spreading for most of the areas including the health care and medical
information. We have applied the data mining techniques, such as
KNN, SVM, MLP or decision trees over a unique dataset, which is
collected from 16,380 analysis results for a year. Furthermore we
have also used meta-classifiers to question the increased correlation
rate between the liver disorder and the liver analysis outputs. The
results show that there is a correlation among ALT, AST, Billirubin
Direct and Billirubin Total down to 15% of error rate. Also the
correlation coefficient is up to 94%. This makes possible to predict
the analysis results from each other or disease patterns can be applied
over the linear correlation of the parameters.

• Pattern of disease to recognize the type of disease
• Asses severity to understand how sever is the disease
• Follow up to keep track of the liver disease [2].
In this study we propose a correlation among the major test
parameters using ensemble classification algorithm over three
classical classification algorithms which are already proven the
success on liver disorder.

Keywords—Data mining, decision trees, knn, liver analysis, mlp,
svm.

I. INTRODUCTION

II. RELATED WORKS

EDICAL analysis has shown with using machine
learning techniques for two decades. Learning of
creation machine is beneficial on medical analysis because it
provides to decrease human resources and their cost, and
increase the accuracy of diagnosis [1].
The liver is an effective organ at neutralizing and expelling
toxins from the body. If the amount of toxins exceeds the
organs functioning capacity, cells of affected areas in the
organ will experience cell damage. Some emerging substances
and enzymes will be released into the bloodstream. While the
patient is being diagnose, enzymes levels in the blood will be
analyzed. Both elevated enzyme levels and the varied effects
of different alcohol levels on different patients can result in
inaccurate diagnosis [1],[2].
This study is built on multiple methodologies studied on the
analysis related to the liver health. The methodologies are
well-known classification and clustering algorithms to find out
the correlation between the four different liver functioning
tests, ALT, AST, Bilirubin Direct (BD) and Bilirubin
Total(BT). The values are suitable for the correaltion and this
correlation can be useful to autmoatically identify disease

If we look at the literature regarding this subject, almost all
of the studies mentioned below have been carried out based on
the Liver Disorders Data Set at the UCI database. Data mining
algorithms were implemented to the data as part of these
studies and in the other part of the study, other machine
methods of learning were used.
Bendi Venkata Ramana et. al., used two different database
using naive bayes, C4.5, back probagation, Neural network
and SVM that are the classification method in their studies [3].
Studies conducted by P.Rajeswari, G.Sophia Reena based
on the dataset from UCI were classified by the WEKA
program through the use of Naive bayes, Kstar ve FT tree
algorithms [4].
In the study conducted by Hyontai sug [5] used 3 different
data mining algorithms (decision tree, C4.5 and CART) in the
dataset obtained from the UCI and with the method of
oversampling, he attempted to increase prediction accuracy.
In the study conducted by Rong-Ho Lin used classification
and regression tree (CART) and case-based reasoning (CBR)
techniques [6] which were obtained from medical center in
Taiwan from 2005 to 2006.
Kim et. al., adopted a prediction model including logistic
regression, a decision tree and a neural network to analyze the
risk factors of liver disease [7].
Newton Cheung, using C4.5 %65.59 [1], Newton Cheung,
using Naive Bayes %63.39 [1], Newton Cheung, BNND
(Bayesian Network with Naive Dependence) %61.83 [1],
Newton Cheung, BNNF (Bayesian Network with Naive
Dependence & Feature Selection) using %61.42 [1], Tony Van

M

S. E. Seker is with the Computer Engineering Dept. of Istanbul University,
Istanbul , TURKEY (corresponding author to provide phone: +90-532-4467882; e-mail: academic@sadievrenseker.com).
Y. Unal, is with the Computer and Inst. Tech. Dept. of Amasya University,
Amasya, TURKEY (e-mail: yavuz.unal@amasya.edu.tr).
Z. Erdem Turkish National Science Foundation, Ankara, TURKEY, (email: zeki.erdem@tubitak.gov.tr).
H. E. Kocer is with the Electronic and Computer Edu. Dept. of Selcuk
University, Konya, TURKEY(ekocer@selcuk.edu.tr)
ISSN: 1998-4510

1

INTERNATIONAL JOURNAL OF BIOLOGY AND BIOMEDICAL ENGINEERING

Gestel et. al., VMC (Vector Machine Classifiers) using %69.7
[8], Yuh-Jye Lee ve O.L. Mangasarian, SSVM (Smooth
Support Vector Machine) using %70.33 [9], Yuh-Jye Lee ve
O.L. Mangasarian, RSVM using %74.86 [10], D.T. Pham et.
Al., Inductive Learning using %53.76 [11], M. Yalçın ve T.
Yıldırım, MLP using %74.56 [2], M. Yalçın ve T. Yıldırım,
PNN using %73,.86 [2], M. Yalçın ve T. Yıldırım, GRNN
using %60.68 [2], M. Yalçın and T. Yıldırım, RBF using
%58.99 [2], K. Polat and his friends AIRS (Supervised
Artificial Immune System)using %81[12], again K. Polat and
his friends FW-AIRS using %83.38[13], M. Neshat and A. E.
Zadeh, hopfield neural network and fuzzy hopfield neural
netwok using have been achieved 91% success rate[14].

Volume 8, 2014

performance issues [19].
Decision stump [20], as a decision tree is one of the most
simplified version of the decision tree learning algorithms. The
level of the tree is limited with 1 only and most crucial rule is
kept on the only internal node to divide the dataset into subsets.
Bagging [21] is the short cut of boostrap aggregation
method and it can be considered as a meta algorithm working
as an ensemble function on the machine learning problems.
Bagging can be considered as a voting algorithm in small
pieces of the data set. Algorithm starts with dividing the data
set into small samplings where each sampling is smaller than
the dataset itself and for each sample the sampling is done
uniformly with replacement. After creating the sample groups
from the data set, bagging applies data mining techniques and
and monitors if any observation is repeating in the rest of the
sampling groups. The most repeated learning outcome is
considered as more crucial learning outcome like in the
majority vote learning.
Relevance Vector Machines (RVM) is a special case of GP
and the methodology of RVM is close to the support vector
machine (SVM) [22],[23].
Purpose of ANN studies is adapting the biological neural
networks into data processing. Multi-layer perceptron (MLP)
is a developed version of ANN which organizes the neurons
into layers as input, output or hidden layers [24],[25].
The last classifier implemented in this study is KNN (knearest neighborhood). The k, c-neighborhood (or k, c(x) in
short) of an U-outlier x is the set of k class c instances that are
nearest to x (k-nearest class c neighbors of x).

III. BACKGROUND
The background section of this study can be divided into
two categories. The first category holds the background of the
data mining techniques and the second is the background
information about the laboratory tests.
Decision Stump, M5P, REPTree, Bagging, MLP, SVM and
KNN data mining techniques used in this study.
After the model tree proposition [15] by Quinlann in 1992,
which is capable of classification over the continous data sets
via class functions instead of discrete class labels, there has
been several improvements on those trees.

Fig. 1. M5 tree structure

M5 is a variation of model trees where the selection method
of attributes is replaced with predictive attribute instead of
theoretic metrics in classical model trees [16].
Later on the model tree concept is utilized for extracting the
rules from the data set [17].
M5P, tries to generate a model tree, where each of the leaf
nodes keeps a function over the continuous data set with the
maximum coverage.
For example a data set equally distributed between 0 and 5
can be handled with a model tree demonstrated on Figure 1 if
the level of tree is limited with 2.
REPTree is a regression tree built on the continuous data
set. Different than the model tree, regression trees hold the
data (instances) in each leaf and the nodes hold the rules to
sperate the values.[18] The tree building is done over the
information gain and variance reduction. Also REPTree
utilizes the prunning and reduced-error prunning for the
ISSN: 1998-4510

Fig. 2. KNN grouping

The K-NN [14] is explained in Figure 2. Here k is a user
defined parameter. For example, k , c1(x) of an U-outliers x is
the k-nearest class c1 neighbors of x.
Let

D Cout ,q ( x) be the mean distance of a U-outlier x to its

k-nearest U-outlier neighbors. Also, let

D C , q ( x) be the mean

distance from x to its k,c(x), and let
2

D C min,q ( x) be the

INTERNATIONAL JOURNAL OF BIOLOGY AND BIOMEDICAL ENGINEERING

D C , q ( x) , c ∈ {Set of existing classes}.
In order words, k, cmin is the nearest existing class

Volume 8, 2014

IV. MATERIAL AND METHODS

minimum among all

Dataset
Properties of the data set is given in Table I.

neighborhood of x. Then k-NSC of x is given in equation (1).

k − NSC ( x) =

D C min,q ( x) − D Cout , q ( x)
max( D C min,q ( x), D Cout , q ( x))

(1)
TABLE I.
Attributes

A. Ensemble Classification
We have implemented MaVL (Majority Vote Learning)
[24] based ensemble method to combine three different
classification methods. MV can be considered as a meta
classifier which works over the classifiers like KNN, C4.5 or
SVM in our case.
Let

Si ∈ S where S is the set of classifiers and let Ci

Min.

Max.

Mean

StdDev

ALT

6

2.708

23.475

45.203

AST

3

4.202

23.729

65.335

Bilirubin Direct

0.01

46.388

68.195

1553.409

Bilirubin Total

0.01

44.593

72.887

1,576.01
3

The test results are collected from a state hospital during a 1
year long study

∈ C where C is the set of classes,

C ( x) = argmaxi ∑ w j I ( S j ( x ) = i )

MAJOR TEST PARAMETER PROPERTIES

B

(2)

V. EVALUATION

j =1

Where

In this section, the evaluation of data mining techniques on
the data set are evaluated via relative absolute error (RAE) and
root relative square error (RRSE) calculations. We also
provide a correlation coefficient, which is calculated via
Pearson product-moment correlation coefficient method.
(PPMCC) The results are provided just after giving the details
of the evaluation calculations.

w j is the weight of each indicator function I()

which is added into the equation for normalization and the
weights of each classifier is equal in our model.
MaVL, gets the summation for each of the classifier’s vote
and the sample is classified into the class with the highest vote.

A. Relative Absolut Error (RAE) Equations
The third error calculation method is RAE (Relative
Absolute Error) and the calculation is given in equation (3)
[29].

B. Liver Function Tests
Commonly used tests are available to see how well the liver
functions. Some of these test include:
ALT :Alaine transaminase (ALT) is an enzyme and is found
in the liver at high levels. It is an indicator of whether or not
there is liver damage. If the blood at high level, it indicates
liver damage. It is measured by blood test. The normal range is
10 to 40 international units per liter (IU/L) [25].
AST: AST (aspartat aminotransferaz) is an enzyme and is in
liver, heart and muscle cell at high levels. At the same time, it
is smaller at the other tissues. It is measured by blood test. The
test is done with other tests (for example; ALP and bilirubin)
to liver disease diagnosis and monitoring. The normal range is
10 to 34 IU/L.( IU/L = international units per liter) [27],[28].
Bilirubin: Bilirubin is in the bile and a yellowish fluid
generated by the liver. A small amount of old red blood cells is
replaced with new blood cells for each day. This old blood
cellsis removed and than bilirubin is replaced. With help of
bilirubin the liver helps to rid the body of destroyed old red
blood cells though the stool. It is measured by blood test. High
amount of bilirubin in the blood may cause jaundice. The
normal level in the blood is as follows: Direct (also called
conjugated) bilirubin: 0 to 0.3 mg/dL. Total bilirubin: 0.3 to
1.9 mg/dL. (mg/dL = milligrams per deciliter)[27],[28].

Ei =

∑| P
j =1
n

( ij )

∑| T
j =1

j

−Tj |

(3)

−T |

P(ij ) is the value predicted by the individual program i for
sample case

j (out of n sample cases), T j is the target value

for sample case

j , and T is given by the equation (4) [29]:
T=

1 n
∑Tj
n j =1

For a perfect fit, the numerator is equal to 0 and
the

(4)

Ei = 0 So,

Ei index ranges from 0 to infinity, with 0 corresponding

to the ideal.
B. Root Relative Square Error (RRSE)
Also the results are interpreted by using a second error
calculation method RRSE (Root Relative Squared Error) and
the calculation is given in equation (5) [30].

ISSN: 1998-4510

3

INTERNATIONAL JOURNAL OF BIOLOGY AND BIOMEDICAL ENGINEERING

n

xrrse =

∑ (P
j =1
n

ij

Volume 8, 2014

− Tj )

(5)

∑ (T j − T ) 2
j =1

Where

P(ij ) is the value predicted for the sample case j, T j

is the target value for sample case j and
equation (6) [30].
1 n
T = ∑ TJ
n j =1

T is calculated by
(6)

The RRSE value ranges from 0 to ∞ , with 0 corresponding
to ideal.
C. Pearson Product-Moment Correlation Coefficient
Method (PPMCC)
Pearson prodcut-momment correlation coefficient is a real
number between +1 and -1 to measure the linear correlation
between two variables. [30].
In most simple form, it is symbolized with (ρ) and can be
considered as the covariance of both variables divided by the
standard deviations of the variables.

PX ,Y =

cov( X , Y )

σ xσ y

Fig. 3. examples of scatter diagrams with different values of correlation
coefficient

The value of 1 means the samples are exactly on the same
line and the slope of line is positive. The value of -1 means the
samples are on the same line but the slope is negative this
time. Any value between 0 an +1 indicates the slope is positive
and the points are not exactly on the same line but a linearity
can be claimed with a line passing close to each of the
samples. On the other hand if drawing a line is impossible
among the samples than the ρ value is 0.

(7)

If the covariance is rewritten as expected value:

PX ,Y =

E[( X − µ x )(Y − µ y )]

σ xσ y

D. Evaluation of Data Mining Techniques

(8)

During this study, 9 different data mining technique has
been applied over the dataset. The methods and the error rates
are given in Table II.

TABLE II.

PERFORMANCE STUDY OF ALGORITHM
PPMC
C

KNN, N=1

ISSN: 1998-4510

4

0.8855

RAE
(%)

20.48

RRSE(%
)

48.68

KNN, N=3

0.9102

17.83

41.43

SVM

0.8692

20.78

50.21

Desicion Stump

0.9390

15.43

34.38

M5P

0.9243

19.31

38.42

REPTree

0.9340

15.84

35.72

MLP

0.9305

18.58

36.62

Simple Linear Regression

0.8686

29.37

49.55

Bagging

0.9303

16.79

36.68

MaVL

0.9423

16.66

35.22

INTERNATIONAL JOURNAL OF BIOLOGY AND BIOMEDICAL ENGINEERING

[17] G. Holmes, M. Hall and E. Frank. Generating Rule Sets from Model
Trees, Working Paper 99/2, Working Paper Series, ISSN 1170-487X,
1999.
[18] M. Göndör and V. P. Breffelean, “REPTree and M5P for measuring
fiscal policy influences on the romanian capital market during 20032010”, International Journal of Mathematics and Computer in
Simulation, Issue 4, Vol. 6, 2012.
[19] D. Thitiprayoonwongse, P. Surıyaphol, N. Soonthornphisaj, “Data
mining of dengue infection using decision tree”, WSEAS international
conference on Latest Advances in Information Science and
Applications, Singapore, 2012.
[20] J. J. Oliver, and D. Hand, David, “Averaging over decision stumps, in
machine learning” ECML-94, European Conference on Machine
Learning, Catania, Italy, April 6–8, 1994, Proceedings, Lecture Notes in
Computer Science (LNCS) 784, Springer, pp. 231–241, 1994.
[21] L. Breiman, "Bagging predictors". Machine Learning, vol. 24 (2):
pp.123–140, 1996.
[22] I. Ocak and S. E. SEKER, “Calculation of surface settlements caused by
EPBM tunneling using artificial neural network, SVM, and Gaussian
processes”, Environmental Earth Sciences, Springer-Verlag, 2013.
[23] W. Zhang, C. Ma and L. Yang, “The research on fault diagnostic of
power transformer based on support vector machine” , WSEAS
international conference on Advances in Circuits,Systems, Automation
and Mechanics, Montreux, Switzerland 2012.
[24] S. E. SEKER, K. Al-NAAMI, “Sentimental Analysis on Turkish Blogs
via Ensemble Classifier“, DMIN 2013
[25] I. Ocak, S. E. SEKER, “Estimation of Elastic Modulus of Intact Rocks
by Artificial Neural Network,“ Rock Mechanics and Rock Engineering,
DOI: 10.1007/s00603-012-0236-z, 2013.
[26] S. E. SEKER, C. MERT, K. Al-Naami, U. AYAN, N. OZALP,
“Ensemble classification over stock market time series and economy
news“, Intelligence and Security Informatics (ISI), Proceeding of 2013
IEEE International Conference, pp 272 – 273, ISBN 978-1-4673-62146P.
[27] Berk and K. Korenblat, Approach to the patient with jaundice or
abnormal liver tests. In: Goldman L, Schafer AI, eds. Cecil Medicine.
24th ed. Philadelphia, Pa: Saunders Elsevier; 2011:chap 149.
[28] D. S. Pratt , Liver chemistry and function tests. In: Feldman M,
Friedman LS, Brandt LJ, eds. Sleisenger and Fordtran's Gastrointestinal
and Liver Disease. 9th ed. Philadelphia, Pa: Saunders Elsevier;
2010:chap 73.
[29] S. A. Qureshi, S. M. Mirza, and M. Arif, “Fitness function evaluation
for image reconstruction using binary genetic algorithm for parallel ray
transmission tomography”, emerging technologies. In Proceedings of
Emerging Technologies, 2006. ICET '06. International Conference on.
(Islamabad, Pakistan, November 13-14,2006). 196–201.
[30] S. M. Stigler, "Francis galton's account of the invention of correlation".
Statistical Science Vol. 4 (2): pp.73–79, May 1989.

VI. CONCLUSION
We believe this study can be useful for further studies like
reducing the number of analysis, since the prediction can be
correlated and furthermore the correlation can be utilized for
detecting the anomaly on the analysis.

REFERENCES
[1]

[2]

[3]

[4]

[5]

[6]
[7]

[8]

[9]

[10]

[11]
[12]

[13]

[14]

[15]

[16]

N. Cheung, “Machine learning techniques for medical analysis ”,
School of Information Technology and Electrical Engineering, BsC
thesis, University of Queenland, 19 Oct. 2001.
S. E. Seker, Y. Unal, Z. Erdem, H. E. Kocer “Correlation Between Liver
Analysis Outputs “, SCI 2013 (System, Control and Informatics)
Proceedings of the 2013 International Conference on Systems, Control
and Informatics (SCI 2013), Venice, Italy, Sept, 28-29, 2013, ISBN:
978-1-61804-206-4 , pp. 217-222.
B. V. Ramana, M. S. P. Babu and N.B Venkateswarlu “A critical study
of
selected
classification
algorithms
for
liver
disease
diagnosis”International Journal of Database Management Systems (
IJDMS ), Vol.3, No.2, May 2011.
P. Rajeswari, and G. S. Reena, “Analysis of liver disorder using data
mining algorithm” Global Journal of Computer Science and Technology
Vol. 10 Issue 14 (Ver. 1.0) pp. 48-52, 2010.
H. Sug, "Improving the prediction accuracy of liver disorder disease
with oversampling" Applied Mathematics in Electrical and Computer
Engineering, AMERICAN-MATH'12/CEA'12 Proceedings of the 6th
WSEAS international conference on Computer Engineering and
Applications, and Proceedings of the 2012 American conference on
Applied Mathematics pp.331-335, 2012.
R. H. Lin, " An intelligent model for liver disease diagnosis" Artificial
Intelligence in Medicine Volume 47, Issue 1, pp. 53– 62, 2009.
Y.S. Kim, S.Y. Sohn, C.N. Yoon "Screening test data analysis for liver
disease prediction model using growth curve" Biomedicine and
Pharmacotherapy, vol. 57 , pp. 482– 488, 2003.
T. V. Gestel, J. A. K. Suykens., G. Lanckriet, A. Lambrechts, B. D.
Moor and J. Vandewalle, “Bayesian framework for least squares support
vector machine classifiers, gaussian processes and kernel fisher
discriminant analysis”, Neural Computation, vol. 15(4), pp.1115-1147,
2002.
Y. J. Lee and O.L. Mangasarian, “SSVM: A smooth support vector
machine for classificarion”, Data Mining Institute Technical Report 9903, Computational Optimization and Applications, 1999.
Y.J. Lee and O.L. Mangasarian, “RSVM: Reduced support vector
machines”, Data Mining Institute Technical Report 00-07, July, 2000,
First SIAM International Conference on Data Mining, Chicago, April 57, 2001.
D.T. Pham, S.S. Dimov and Z. Salem, “Technique for selecting
examples in inductive learning”, ESIT Conferance, 2000.
K. Polat, S. Kara, “A novel approach to resource allocation mechanism
in artificial immune recognition system: fuzzy resource allocation
mechanism and application to diagnosis of atherosclerosis disease”,
ICARIS 2006, LNCS 4163, pp. 244 – 255, 2006.
K. Polat, S. Sahan, “Breast cancer and liver disorders classification
using artificial immune recognition system (AIRS) with performance
evaluation by fuzzy resource allocation mechanism”, Expert Systems
with Applications, vol. 32 , pp.172–183, 2007.
M.Neshat, A.E. Zadeh, “Hopfield neural network and fuzzy hopfield
neural network for diagnosis of liver disorder”, Intelligent Systems (IS),
5th IEEE International Conf., pp. 162-167, 2010.
J.R Quinlan, “Learning with continous classes. In Proc. Of the Fifth
Australian Joint Conference on Artificial Intelligence, pp. 343-348,
World Scientific, Singapore, 1992.
Y. Wang, Y. And I. H. Witten, “Induction of model trees for predicting
continous classes”, In Proc. of the poster papers of the European
Conference on Machine Learning, pp. 128-137, Prague, Czech
Republic, 1997.

ISSN: 1998-4510

Volume 8, 2014

5

