arXiv:1707.00994v1 [cs.CE] 4 Jul 2017

iDTI-ESBoost: Identification of Drug Target Interaction
Using Evolutionary and Structural Features with Boosting
Farshid Rayhan1 , Sajid Ahmed1 , Swakkhar Shatabda1∗, Dewan Md Farid1 ,
Zaynab Mousavian3 , Abdollah Dehzangi4 and M Sohel Rahman2 ,
1
Department of Computer Science and Engineering, United International University
2
Department of Computer Science and Engineering,
Bangladesh University of Engineering and Technology
3
Laboratory of Systems Biology and Bioinformatics (LBB),
Institute of Biochemistry and Biophysics, University of Tehran, Tehran, Iran
4
Carver College of Medicine, University of Iowa

Abstract
Background:
Prediction of new drug-target interactions is extremely important as it can lead the researchers to find new uses for old drugs and to realize the therapeutic profiles or side effects
thereof. However, experimental prediction of drug-target interactions is expensive and timeconsuming. As a result, computational methods for prediction of new drug-target interactions
have gained much interest in recent times.
Results:
We present iDTI-ESBoost, a prediction model for identification of drug-target interactions
using evolutionary and structural features. Our proposed method uses a novel balancing
technique and a boosting technique for the binary classification problem of drug-target interaction. On four benchmark datasets taken from a gold standard data, iDTI-ESBoost
outperforms the state-of-the-art methods in terms of area under Receiver operating characteristic (auROC) curve. iDTI-ESBoost also outperforms the latest and the best-performing
method in the literature to-date in terms of area under precision recall (auPR) curve. This
is significant as auPR curves are argued to be more appropriate as a metric for comparison
∗

Corresponding email: swakkhar@cse.uiu.ac.bd

1

for imbalanced datasets, like the one studied in this research. In the sequel, our experiments
establish the effectiveness of the classifier, balancing methods and the novel features incorporated in iDTI-ESBoost.
Conclusions:
iDTI-ESBoost is a novel prediction method that has for the first time exploited the structural features along with the evolutionary features to predict drug-protein interactions. We
believe the excellent performance of iDTI-ESBoost both in terms of auROC and auPR
would motivate the researchers and practitioners to use it to predict drug-target interactions.
To facilitate that, iDTI-ESBoost is readily available for use at: http://farshidrayhan.
pythonanywhere.com/iDTI-ESBoost/

Introduction
Target specific drug design is one of the key techniques in therapeutic drug discovery [1]. Prediction
of new drug target interactions can lead the researchers to find new uses for old drugs and to
realize the therapeutic profiles or side effects thereof [2, 3, 4]. Since experimental prediction of
drug-target interaction is expensive and time-consuming [5, 6], computational methods have been
gaining increasing popularity in recent years.
The computational approaches taken in the literature to address the drug-target interaction
include, but are not limited to ligand based methods [7, 8], target or receptor based methods
[9, 10], gene ontology based methods [11], literature text mining methods [12, 13], etc. The
performance of the ligand based methods degrade as the number of known ligands of a particular
target protein decreases. Receptor based methods often use docking simulation [14] and hugely
rely on availability of the three dimensional structure of the protein targets. Notably, finding
three-dimensional structures of the proteins is a expensive and time-consuming task using NMR
and X-ray Crystallography. Moreover, three dimensional structures are very difficult to predict
for ion channel proteins and G-protein coupled receptors (GPCRs). On the other hand, the
tremendous growth in the Biomedical literature has increased the problem of redundancy in the
compound/gene names as the main obstacle for literature based systematic text mining methods.

2

Recently, chemo-genomic methods [15] have been attempted to predict drug-target interactions.
These methods are mainly learning-based methods [16, 17], graph-based methods [18, 19] and
network-based methods [20, 21]. In the supervised learning setting, several classification algorithms
have been used in the literature. Examples include support vector machine [22, 23], deep learning
[24], fuzzy [25], nearest neighbor algorithm [26], etc. Yamanishi et al. [16] proposed a formalization
of the drugtarget interaction inference as a supervised learning problem for a bipartite graph.
In that pioneering work, they also proposed a gold standard dataset that had been later used
extensively in the literature [22, 27, 24]. In a subsequent work, the same authors [27] explored the
relationship among the chemical space, the pharmacological space and the topology of drug-target
interactions networks and applied distanced based learning. Wang et al. proposed RLS-KF [28]
that uses regularized least squares method integrated with nonlinear kernel fusion. Drug-based
similarity inference (DBSI) was proposed in [21] utilizing two dimensional chemical structural
similarity. Another method, KBMF2K, was proposed in [29] that used chemical and genomic
kernels and bayesian matrix factorization. Among other methods, NetCBP [30], DASPfind [31],
SELF-BLM [23], etc. are noteworthy. In a recent work [22], position specific scoring matrix based
bigram features and molecular fingerprint were used to predict drug target interactions. In the
absence of three dimensional structures of the protein target, most of the supervised learning
methods in the literature do not exploit the structure based features.
In this paper, we present iDTI-ESBoost, a method for identification of Drug Target Interaction
Using Evolutionary and Structural Information with Boosting. We exploit the structural features
along with the evolutionary features to predict drug-protein interactions. Our work was inspired
due to the modern successful secondary structural prediction tools like SPIDER2 [32, 33] and its
use to generate features in supervised learning and classification [34]. Our proposed method uses
a novel set of features extracted using structural information along with the evolutionary features
and molecular fingerprints of drugs. To handle the large amount of imbalance in the data, we
propose a novel balancing method and use it along with a boosting algorithm to achieve superior
performance over the state-of-the-art algorithms. In our experiments our method, iDTI-ESBoost,
has shown to have significantly outperformed other methods on a gold standard data set widely

3

used in the literature under standard evaluation criteria. Our method is publicly available to use
at: http://farshidrayhan.pythonanywhere.com/iDTI-ESBoost/.
The rest of the paper follows are the general suggestions made in [35]: description of dataset,
formulation of statistical samples, selection and development of a powerful classification algorithm,
demonstration of the performance of the predictor using cross-validation, implementation of web
server followed by a conclusion.

Materials and Methods
In this section, we provide the details of the benchmark datasets, feature extraction and balancing
methods, classifiers and evaluation metrics used in this research work. Figure 1 depicts the training
module of our proposed method, iDTI-ESBoost. The training dataset of iDTI-ESBoost contains
both interacting (positive) and non-interacting drug-target pairs. For each instance of drug-target
pair, a drug is searched in the DrugBank database [36] to fetch the drug chemical structure in
SMILES format. Similarly, a target protein sequence is first fetched from KEGG database [37]
and then fed to SPIDER2 [33] and PSI-BLAST [38] in order to receive, respectively, structural
information as an SPD file and position specific scoring matrix (PSSM) based profile containing
evolutionary information. A feature extraction module then uses these files to generate three types
of features: drug molecular fingerprints, PSSM bigram and structural features based on the output
of the secondary structure prediction software SPIDER2. Features generated in this phase is then
fed to an AdaBoost classifier that learns the model for prediction purposes.
The prediction module is very similar to that of the training module shown in Figure 1. For
prediction, a query drug-target pair is feed to the system in a similar way to extract three types
of features and then the trained and stored model is used to predict whether the given drug-target
pair is interacting or non-interacting.

4

Drug-target Interaction Datasets
In this paper, we have used the gold standard datasets introduced by Yamanishi et al.

in

[16]. The datasets are publicly available at: http://web.kuicr.kyoto-u.ac.jp/supp/yoshi/
drugtarget/. Yamanishi et al. used DrugBank [39], KEGG BRITE [40], BRENDA [41] and
SuperTarget [42] to extract information about drug-target interactions. They used the known
drugs to four types of protein targets, namely, enzymes, ion channels, g-protein coupled receptors
(GPCRs) and nuclear receptors. The number of proteins in these classes are 664, 204, 95 and 26
respectively, that interact with, respectively, 445, 210, 223 and 54 drugs through 2926, 1476,635
and 90 known interactions. A brief description of the datasets are given in Table 1. These benchmark datasets have been used in many studies in the literature [22, 27, 21, 24] and are referred to
as the ‘gold’ standard.

Graph Construction from the Dataset
Based on the interactions of four types of proteins with known drugs, we build positive and negative
samples for each dataset using a method similar to the one used in [22] as follows. The drug-target
interaction network for each dataset is a bipartite graph, G = (V, E), where the set of vertices is
V = D ∪ T such that D is the set of drugs and T is the set of targets, D ∩ T = ∅ and the set of
edges is E. Here, any edge e = (d, t) ∈ E denotes an interaction only between a drug, d ∈ D with
a protein target, t ∈ T . Now, for a particular graph from a dataset, all the known interactions
in the graph represented by its edges are considered to be positive samples and the non-existent
edges are taken as negative samples. Note that, here, non-existent edges refer to the possible valid
edges only that are not there; i.e., they do not include edges among the vertices of the same partite
set. Formally, a dataset is an union of positive and negative sets as follows:

S = S+ ∪ S−

(1)

Here, S+ = {(u, v) : u ∈ D, v ∈ T, (u, v) ∈ E}, and S− = {(u, v) : u ∈ D, v ∈ T, (u, v) ∈
/ E}.
For example, in the nuclear receptor, there are 54 drugs and 26 proteins with possible 54×26 = 1404

5

interactions. Since 90 interactions are known, these are treated to be positive and the rest 1314 as
negative. The same procedure was followed for each of the datasets. As expected, the constructed
datasets using this technique are imbalanced as the number of negative samples far outnumbers
that of positive samples. This issue is attended to later by applying some balancing techniques.

Feature Extraction
A dataset constructed in this way has drug-target pairs as instances. In the feature extraction
phase, a drug identifier is looked up in the KEGG databased [40] and the corresponding SMILES
format is downloaded from the DrugBank database [36]. The features based on drugs are generated
using this SMILES data.
Similarly, a protein target of each pair is first searched with in the KEGG database [40] to fetch
the protein sequence. This protein sequence is then fed to two different software: Position Specific
Iterated BLAST (PSI-BLAST) [38] to fetch evolutionary profile based position specific scoring
matrix (PSSM) and a secondary structure prediction tool, SPIDER3 [33] to generate SPD3 files
that contains the structural information. Three groups of features are extracted using these three
files. The details are described in the rest of this section.

SMILES Based Features
Several descriptors are used to represent the features or properties of drug compounds [43]. To this
end, one of the most popular features is molecular fingerprints, which is widely used for similarity
searching [44], clustering [45], and classification [22]. Each drug compound is represented by 881
chemical substructures defined in PubChem database [46]. The presence (absence) of a particular
substructure is encoded as 1 (0). Thus the length of this molecular fingerprint based feature is
881. We used the rcdk package of R [47] to extract these molecular fingerprints based features.

PSSM Based Features
We used the PSSM matrix returned by the PSI-BLAST software to generate evolutionary features
from the protein target sequences. Each PSSM file contains a PSSM matrix that is constructed

6

after multiple sequence alignment using the non redundant (NR) database. The PSSM file contains
a matrix M of dimension L × 20, where L is the length of the protein and each of the entries in
this matrix, mij , represents the probability of observing the j-th amino acid in the i-th location
of the given protein sequence. We first convert this matrix M to a normalized matrix using a
normalization technique similar to that proposed in [48]. The dimension of this matrix is same as
the original matrix M . After that we generate PSSM-bigram features using the following equation:
L−1

1X
Ni,k Ni+1,l (1 ≤ k ≤ 20, 1 ≤ l ≤ 20)
PSSM-bigram(k, l) =
L i=1

(2)

Bigram features for PSSM were first proposed in [49] and subsequently used successfully in
drug-target interaction prediction in [22]. Total number of features generated usign this method
is 400.

0.0.1

Structure Based Features

The traditional drug discovery is a lock-key problem, where the lock is the target. The structure
of the target thus play a very important role in traditional drug discovery and is at the center of
the docking based software. We make a hypothesis that even if the full structure is not present for
the targets, estimated structural properties thereof can play an important role in drug-target interaction prediction. Structural features are generated using the structural information generated
and stored in SPD files by SPIDER2 software. The information generated by SPIDER2 are: accessible surface area (ASA), secondary structural (SS) motifs, torsional angles (TA) and structural
probabilities (SP). Following features are generated using these information:
1. Secondary Structure Composition: This feature is the normalized count or frequencies
of the structural motifs present at the amino-acid residue positions. There are three types
of motifs: α-helix (H), β-sheet (E) and random coil (C). SPIDER2 returns a vector SS of
dimension L × 1 containing this information. Thus we can define this feature as following:
L

1X
SS-Composition(i) =
cij , 1 ≤ i ≤ 3
L j=1
7

(3)

Here, L is the length of the protein and

cij =




1, if SSj = fi


0, else

Here, SSj is the structural motif at position j of the protein sequence and fi is one of the 3
different motif symbols.
2. Accessible Surface Area Composition: The accessible surface area composition is the
normalized sum of accessible surface area defined by:

L

1X
ASA(i)
ASA-Composition =
L i=1

(4)

Here ASA is the vector of accessible surface area of dimension L × 1 containing the values
of accessible surface area for all the amino acid residues.
3. Torsional Angles Composition: Four different types of torsional angles: φ, ψ, τ and θ
are returned by SPIDER2 for each residue. First, we convert each of them into radians from
degree angles and then take sign and cosine of the angles at each residue position. Thus we
get a matrix of dimension L × 8. We denote this matrix by T . Torsional angles composition
is defined as:
L

1X
TA-Composition(k) =
Ti,k (1 ≤ k ≤ 8)
L i=1

(5)

4. Torsional Angles Bigram: The Bigram for the torsional angles is similar to that of the
PSSM matrix and is defined as:

L−1

1X
TA-bigram(k, l) =
Ti,k Ti+1,l (1 ≤ k ≤ 8, 1 ≤ l ≤ 8)
L i=1

(6)

5. Structural Probabilities Bigram: Structural probabilities for each position of the aminoacid residue are given in the SPD2 file as a matrix of dimension L × 3, which we denote by
P . Recall that, there are three types of structiral motifs, namely, α-helix (H), β-sheet (E)
8

and random coil (C). The Bigram of the structural probabilities is similar to that of PSSM
matrix and is defined as:
L−1

1X
Pi,k Pi+1,l (1 ≤ k ≤ 3, 1 ≤ l ≤ 3)
SP-bigram(k, l) =
L i=1

(7)

6. Torsional Angles Auto-Covariance: This feature is also derived from the torsional angles
and is defined as:
L−k

1X
TA-Auto-Covariance(k, j) =
Ti,j Ti+k,j (1 ≤ j ≤ 8, 1 ≤ k ≤ DF )
L i=1

(8)

This feature group depends on parameter DF which is the distance factor. In this study, we
used DF = 10.
7. Structural Probablities Auto-Covariance: This feature is also derived from the structural probabilities and is defined as:
L−k

SP-Auto-Covariance(k, j) =

1X
Pi,j Pi+k,j (1 ≤ j ≤ 3, 1 ≤ k ≤ DF )
L i=1

(9)

A brief summary of the three group of features derived from each drug-target pair is given in
Table 2.

Balancing Methods
Recall that, each of our four datasets is heavily imbalanced. Several sampling techniques in
the literature have been deployed in imbalanced settings of data: random under sampling [22],
synthetic over sampling [50] , balanced random sampling (BRS) [51], neighborhood cleaning rule
[52], cluster based under sampling [53, 54], etc. In this paper, we explore random under sampling
(RUS) method as done previously for drug-target interaction prediction in [22]. We also propose
a novel modified cluster based under sampling method based on [54] as follows. In this method,
the dataset is first divided into two subsets as major class and minor class . In the major class
k-means clustering is applied to divide the major class samples in k clusters . But the minor
9

class samples are kept unchanged. Now from the k clusters of major class samples, subsamples
are chosen randomly to represent the entire major class. We denote this method as cluster based
under sampling (CUS) throughout this paper. The random under sampling will be denoted as
random under sampling (RUS). The pseudo-code for the CUS algorithm is given in Algorithm 1.
Algorithm 1: ClusterBasedUnderSampling(dataset,k,h)
major, minor ←divide(dataset)
2 clusters ← k-MeansClustering(major, k)
3 kCombined ← ∅
4 for each cluster ∈ clusters do
5
clusteredData ← major.getData(cluster)
6
reduced ← randomSubsample(clusteredData, h)
7
kCombined ← kCombined ∪ reduced
8 end
0
9 dataset ← kCombined ∪ minor
0
10 return dataset
1

Our CUS algorithm depends on two parameters, namely, k and h. In our experiments, we have
varied k for values from 5 · · · 30 and found the the best performing value to be 23. However, more
sophisticated clustering algorithms can be applied on this data. The role of the parameter h is to
control the random under sampling of the clustered majority class samples.

Description of the classifier
We have selected the adaptive boosting algorithm (AdaBoost) [55] as our classification algorithm.
Adaptive boosting is a meta or ensemble classifier that uses several weak learning algorithms or
weak classifiers and improves over their performance. We choose decision tree classifiers as the
weak classifiers. AdaBoost is a meta-classifier of the following form:

g=

T
X

αt ht (x)

(10)

t=1

AdaBoost iteratively adds up a weak classifier ht (x) at each iteration of the algorithm weighted
by αt where αt is the weight achieved from the error function t for the weak classifier ht (x) at
iteration t. Each of these weak classifiers is chosen in a way so as to minimize the error on the

10

training sample weighted by the distribution Dt :

ht ∈ argmin Pr [ht (x) 6= yi ] = argmin
h∈H

i∼Dt

h∈H

m
X

Dt 1ht (x)6=yi

(11)

i=1

The algorithm of AdaBoost [55] is sketched in Algorithm 2 following the notations of [56].
Algorithm 2: AdaBoost(dataset = (X, Y ))
for i ← 1 to m do
2
D1 ← m1
3 end
4 for i ← 1 to T do
5
ht ← decision tree classifier with small error t = Pr[ht (x) 6= yi ]
t
6
αt ← 12 log 1−
t
1
7
Zt ← 2[t (1 − t )] 2
8
for i ← 1 to m do
9
Dt+1 (i) ← Z1t Dt e−αt yi ht (xi )
10
end
11 end
PT
12 g ←
t=1 αt ht
13 return h = sign(g)
1

Performance Evaluation
A large variety of performance metrics are used in the literature to compare the performance
of supervised learning methods [57]. The gold datasets that is used in the literature of drugtarget interaction prediction is largely imbalanced and the number of negative samples largely
outnumbers that of the positive samples. Therefore, the typical measures like accuracy does not
make much sense. Moreover, the output of the classifier generating probabilistic outputs depends
on the thresholds or the values predicted by it for each of the predicting classes. In such cases,
thresholds or values play and important role on the sensitivity and specificity of the classifiers.
Two measures that are independent of the values or thresholds set for decision making are area
under curve for Receiver Operating Characteristic (auROC) and area under precision recall curve
(auPR). These two measures are widely used in the literature of drug-target interaction prediction
[22, 30, 58, 24] and thus have become standard metrics for comparison.

11

Lets assume, P is the total number of positive samples in a dataset and N is the total number
of negative samples in a dataset. Let T N, T P, F N, F P denote the number of true positives, true
negatives, false negatives and false positives predicted by a classifier. True positives (negatives)
are correctly classified positive (negative) samples by the classifier. Conversely, false positives
(negatives) are negative (positive) samples incorrectly predicted as positives (negatives) by the
classifier. Following these notions, we can define sensitivity or true positive rate as follows:

Sensitivity =

TP
TP + FN

(12)

Therefore, sensitivity is the ratio of correctly predicted positive samples to the total number of
positive samples. Precision is defined as the positive predictive rate (PPV) as follows:

P recision =

TP
TP + FP

(13)

Therefore, precision shows the percentage of positive predictions by the classifiers that are
accurate. Another important measure is specificity (SPC) or true negative rate defined as follows:

SP C =

TN
TN + FP

(14)

Fall-out or false positive rate (FPR) is the ration of the number of wrongly classified negative
samples to the total number of negative samples defined as follows:

FPR =

FP
= 1 − SP C
FP + TN

(15)

F1 Score is the harmonic mean of the precision and sensitivity and defined as follows:

F1 =

2T P
2T P + F P + F N

(16)

All theses performance measures have values with in the range [0 · · · 1], 0 being the worst and
1 being the best.

12

Another score that is often used in comparison is called defined as follows:

M CC = p

(T P × T N ) − (F P × F N )
(T P + F P )(T P + F N )(T N + F P )(T N + F N )

(17)

Value of this coefficient ranges from −1 to +1, where +1 means a perfect predictor and −1 means
a total disagreement.
Receiver operating characteristic (ROC) curve plots true positive rate against false positive
rate at various threshold values. The performance of a predictor is calculated by the area under
the ROC curve (auROC). A perfect classifier have a auROC value of 1 and a random classifier
have a value of 0.5. However, for imbalanced datasets like ours, area under precision recall curve
(auPR) is of more significance [22] as follows: auPR curve plots the precision rate vs the recall rate
at different threshold values. This score penalizes the false positives more as compared to auROC
and thus more suitable for skewed datasets. The value of auPR ranges from 0 to 1 and the higher
the value is the better.
It is very important to test the methods to check and balance the bias-variance trade-off [59].
Various methods of sampling are used to measure the performance of supervised learning algorithms
[60]. Among them mostly used are k−fold cross validation and jack knife tests. Because of the high
imbalance, dimensionality and cardinality of the datasets, in most of the methods in the literature,
5-fold cross validation have been preferred and used as the sampling method [58, 24, 22, 30]. We
also use the 5-fold cross validation to test our method for the sake of fair comparison with the
other state-of-the-art methods.
In the 5-fold cross validations, first the dataset is randomly split into five equal parts retaining
the ratio of imbalance in each split same to the original dataset. Each time one part of the dataset
is used as test and the other four are used as training data. First the balancing techniques are
applied to the training data (clustered or random) and then the classifier is used to train the data
into a model. The model is then used to predict the labels for the test data. Thus all the drugtarget pairs in the datasets are used in testing the classifier performance using cross-validation.
The measures reported are the average of all 5-fold results.

13

Results and Discussion
In this section, we present the results of our experiments. All the methods were implemented
in Python language using Python3.4 version and Scikit-learn library [61] of Python was used for
the implementation of the machine learning algorithms. All experiments were conducted on a
Computing Machine hosted by CITS, United International University. Each of the experiments
was carried out 5 times and the average is reported as the results. We perform several types of
experiments. In particular, we conduct four different sets of experiments as follows. First we
investigate the effectiveness of the different feature groups as mentioned in Table 2. Recall that, in
Table 2, four different feature groups, namely, A, B, C and D, were formed. Secondly, we conduct
experiments to investigate the effectiveness of the classifiers used in our research. Subsequently,
we also experiment the effectiveness of the balancing methods applied on our highly imbalanced
datasets. Finally, we also conduct experiments to test our method, iDTI-ESBoost, against the
state-of-the-art.

Effectiveness of Feature Groups
We created four different feature groups to see the effects of the different sets of features on
the classifier performance. The feature groups have already been reported in Table 2. Group A
contains 1281 features and was previously used in [22]. We further added other groups, namely,
B, C and D, incrementally in that order with the base feature group i.e., Group A and achieve
features of size 1293, 1403 and 1476 respectively. We have performed two sets of experiments to
test the effectiveness of the feature groups. In both of experiments we varied the feature groups
and ran different classifiers and applied different balancing methods on the data to analyze the
effect. Results of these experiments are reported in Table 3 and Table 5.
Table 3 reports the performance of three different classifiers on the four datasets during our
experiments. Note that, though this experiment was intended for classifier selection, we clearly see
that the best results in terms of auPR and auROC were found only when the structural features are
added. For enzymes dataset, the best result in terms of auPR was 0.66 found with the combination
A,B,C which is using structural composition and structural auto-covariance groups with PSSM14

bigram and molecular fingerprint based features. It was slightly better then the case when we use
all the features A,B,C,D and got auPR of 0.66. In terms of auROC, the results were somewhat
comparable to each other; however, the best result was achieved when all the four feature groups
were used in combination. Thus enzyme dataset shows the effectiveness of structural information
based features.
Datasets ion channels and GPCRs showed similar performance in terms of auPR. Nuclear
receptors showed highest auPR value when only the composition features, i.e., Group B were
added with the base features. The increase in the value of auROC clearly reveals the effectiveness
of the structural features (Groups B,C,D) when added to the base feature (Group A).
The next set of experiments were run to show the performance of different balancing or under
sampling methods in the training data using various feature groups. These results are shown in
Table 5. These experiments were run using the AdaBoost classifier. The results in Table 5 clearly
shows that for all the datasets, the best results in terms of auPR and auROC were found when
structural features have been added. In case of the GPCRs, the auPR was found to be the highest
at 0.5 when three feature groups, namely, Groups A,B, and C have been combined. Apart from
this, in all other datasets, the all four groups combined have shown superior performance both in
terms of auPR and auROC. Our hypothesis that the added structural features play an important
role in the prediction of drug-target interaction is thus justified according to these experiments.

Effectiveness of the AdaBoost Classifier
To test and select the suitable classifier for our problem, we test three different classifiers: AdaBoost
ensemble classifier [55] with decision tree as the weak classifier, Random Forest [62] and Support
Vector Machines [63]. For these experiments, we used random under sampling as the balancing
method. As features, four different combinations were used as has been mentioned already. The
results in terms of auPR and auROC are presented in Table 3. Here for each of the datasets and
feature groups combinations bold faced values in the table represents the highest values achieved
for that combination. It is evident that except for one case in the enzymes dataset, AdaBoost
classifier has shown superior performance in terms of auPR across all feature groups combinations.

15

It is also worth-noting that for all datasets, the highest auPR value was achieved by AdaBoost. The
precision-recall curves for these experiments across all feature groups combinations are illustrated
in Figure 2.
In case of the ROC curve, the results are also in support of the selection of AdaBoost as
a classifier. AdaBoost provides the highest auROC values for all the four datasets and it gives
better auROC values for 11 out of 16 dataset-feature groups combinations. In other cases, SVM
has achieved the highest auROC values, but only marginally so. The ROC curves for different
classifiers across all feature groups combinations are illustrated in Figure 3.
Considering the values of auPR and auROC curves on different datasets as shown in Table 3
and illustrated through the curves in Figure 3 and Figure 2, we select AdaBoost as the classifier for
iDTI-ESBoost. Note that, because of the huge imbalance in the datasets, with positive samples
being much lower than the negative ones, the auPR curve is more important compared to the
auROC curve and AdaBoost clearly outperforms the other two classifiers in terms of auPR values.

Effectiveness of the Balancing Methods
The next set of experiments were run to test the effectiveness of the two different sampling methods
on the datasets. The parameters used with AdaBoost classifier for random and cluster based under
sampling are reported in Table 4.
For each of the datasets, we used four feature group combinations and used random and cluster
based under sampling and report auPR and auROC values from cross-validation experiments in
Table 5. We also show the ROC curves and auPR curves for all four datasets using all the features
in Figure 5 and Figure 4.
From the results reported in Table 5, it is worth-mentioning that in terms of auPR for all
four datasets, cluster based sampling significantly outperforms random under sampling method.
However, in terms of auROC curve, random sampling is slightly better than cluster based sampling
in enzymes and ion channel datasets but the situation is in favor of cluster based sampling in
GPCRs and nuclear receptors where it outperforms the random sampling method.

16

Comparison with Other Methods
Since the pioneering work of Yamanishi et al. [16], many supervised learning methods have been
applied to predict drug-target interactions on these standard benchmark gold standard datasets.
However, a few of these methods [24, 28] do not use cross validation techniques and others [23, 3]
do not use the same standard datasets. Our method uses molecular fingerprints and evolutionary
and structural features for this supervised classification problem. Similar methods, albeit without
utilizing the structural features and balancing techniques are reported in [64, 22]. Most of the
papers in the literature have used auROC curve as the main evaluation metric. We have compared
the performance of our method on these four datasets with that of DBSI [21], KBMF2K [29],
NetCBP [30], Yamanishi et al. [16], Yamanishi et al. [27], Wang et al. [18] and Mousavian et al.
[22] using auROC. The auROC values for all these methods along with iDTI-ESBoost are reported
in Table 6.
From the values shown in bold faced font in Table 6, we notice that for all the datasets iDTIESBoost is able to significantly outperform all other previous state-of-the-art methods in terms
of auROC. All the auROC values are greater than 90% which indicates the effectiveness of the
classifier, balancing methods and the novel features proposed in this paper.
Moreover, in [22] the authors argued in favor of auPR curve as a measure of evaluating the
performance of classifiers for skewed datasets, especially in drug-target interaction where negative
samples outnumber the positive samples. This argument does have merit as, logically, a misclassification of positive samples or false negative should be more penalized in the score. To
compare the performance of our method with that in [22], we reported the auPR values of the two
predictors in Table 7. The results clearly shows that our method iDTI-ESBoost outperforms the
predictor in [22] in terms of auPR as well.
In Table 8, we report specificity, sensitivity, precision, MCC and F1-Score for four datasets using
different feature group combinations as achieved by iDTI-ESBoost in experiments. Specificity and
sensitivity are very high as reported in this table.

17

Predicting New Interactions
In addition to these, we have analyzed the results produced by the classification algorithm. From
the false negatives predicted by iDTI-ESBoost, we noticed that there are a number of false negatives
for which the prediction probability is very high for it to be considered as a negative sample. Similar
approaches were adopted in [16, 27]. In this paper, we suggest that the false negative interactions
which are labeled as positive by our method with a very high prediction probability could be
potential candidates for finding new positive interactions. A list of such interactions for four group
of targets are added as supplementary information with this paper.

Web Server Implementation
We have also implemented our method as shown in Figure 1 as a separate web server. The web
server is freely available for use at: http://farshidrayhan.pythonanywhere.com/iDTI-ESBoost/.
The mechanism of the web-server is very simple. We also provide the pre-learned models for each
of the datasets. The interface of the web server easy to use. It requires an user first to select the
target group and provide the PSSM and SPD files for the target protein. These files can be easily
generated by PSI-BLAST and SPIDER2 software using their online available tool.
To specify drug, one can select from a drop down list. The drugs are pre-fetched in our
system from KEGG website. After selecting the drug and specifying target files, one can click
the prediction button to find the prediction for that drug-target pair. The web-server also have a
simple page with easy to-use instructions.

Conclusion
In this paper, we have presented iDTI-ESBoost, a novel method to predict and identify drugtarget interactions. iDTI-ESBoost is unique in its exploitation of structural features along with the
evolutionary features to predict drug-protein interactions. It also uses a novel balancing technique
and a boosting technique. We have conducted extensive experiments to test and analyze the
performance of iDTI-ESBoost. On four benchmark datasets known as the gold standard data

18

in the literature, iDTI-ESBoost outperforms the state-of-the-art methods in terms of area under
Receiver Operating Characteristic (auROC) curve.
Notably, the gold standard datasets used in the literature as benchmarks to analyze the performance of the methods for drug-target interactions prediction and identification are highly
imbalanced with negative samples far outnumbering the positive samples. In the literature it
has been argued that area under Precision Recall (auPR) curve is more appropriate as a metric for comparison for such imbalanced datasets. To this end, iDTI-ESBoost also outperforms
the latest and the best-performing method in the literature to-date in terms of area under precision recall (auPR) curve. We believe that the excellent performance of iDTI-ESBoost both in
terms of auROC and auPR would motivate the researchers and practitioners to use it to predict drug-target interactions. To facilitate that, iDTI-ESBoost is readily available for use at:
http://farshidrayhan.pythonanywhere.com/iDTI-ESBoost/.

Competing interests
The authors declare that they have no competing interests.

Author’s contributions
SS initiated the project with the idea of using structural features. FR, SA and DMF equally contributed to the idea of modified balancing method and boosting. FR and SA equally contributed
in the implementation and experimentation of the system. All the methods, algorithms and results have been analyzed and verified by SS, DMF, MSR, ZM and AD. All authors contributed
significantly in the preparation of the manuscript and approved the final version.

References
[1] Keiser, M.J., Setola, V., Irwin, J.J., Laggner, C., Abbas, A.I., Hufeisen, S.J., Jensen, N.H.,
Kuijer, M.B., Matos, R.C., Tran, T.B., et al.: Predicting new molecular targets for known

19

drugs. Nature 462(7270), 175–181 (2009)
[2] Cheng, F., Li, W., Wu, Z., Wang, X., Zhang, C., Li, J., Liu, G., Tang, Y.: Prediction of
polypharmacological profiles of drugs by the integration of chemical, side effect, and therapeutic space. Journal of chemical information and modeling 53(4), 753–762 (2013)
[3] Wu, Z., Cheng, F., Li, J., Li, W., Liu, G., Tang, Y.: Sdtnbi: an integrated network and
chemoinformatics tool for systematic prediction of drug–target interactions and drug repositioning. Briefings in bioinformatics 18(2), 333–347 (2017)
[4] Campillos, M., Kuhn, M., Gavin, A.-C., Jensen, L.J., Bork, P.: Drug target identification
using side-effect similarity. Science 321(5886), 263–266 (2008)
[5] Haggarty, S.J., Koeller, K.M., Wong, J.C., Butcher, R.A., Schreiber, S.L.: Multidimensional
chemical genetic analysis of diversity-oriented synthesis-derived deacetylase inhibitors using
cell-based assays. Chemistry & biology 10(5), 383–396 (2003)
[6] Kuruvilla, F.G., Shamji, A.F., Sternson, S.M., Hergenrother, P.J., Schreiber, S.L.: Dissecting
glucose signalling with diversity-oriented synthesis and small-molecule microarrays. Nature
416(6881), 653–657 (2002)
[7] Hopkins, A.L., Keserü, G.M., Leeson, P.D., Rees, D.C., Reynolds, C.H.: The role of ligand
efficiency metrics in drug discovery. Nature Reviews Drug Discovery 13(2), 105–121 (2014)
[8] Keiser, M.J., Roth, B.L., Armbruster, B.N., Ernsberger, P., Irwin, J.J., Shoichet, B.K.: Relating protein pharmacology by ligand chemistry. Nature biotechnology 25(2), 197–206 (2007)
[9] Ma, D.-L., Chan, D.S.-H., Leung, C.-H.: Drug repositioning by structure-based virtual screening. Chemical Society Reviews 42(5), 2130–2141 (2013)
[10] Pan, A.C., Borhani, D.W., Dror, R.O., Shaw, D.E.: Molecular determinants of drug–receptor
binding kinetics. Drug discovery today 18(13), 667–673 (2013)

20

[11] Mutowo, P., Bento, A.P., Dedman, N., Gaulton, A., Hersey, A., Lomax, J., Overington, J.P.:
A drug target slim: using gene ontology and gene ontology annotations to navigate proteinligand target space in chembl. Journal of biomedical semantics 7(1), 59 (2016)
[12] Plake, C., Schroeder, M.: Computational polypharmacology with text mining and ontologies.
Current pharmaceutical biotechnology 12(3), 449–457 (2011)
[13] Zhu, S., Okuno, Y., Tsujimoto, G., Mamitsuka, H.: A probabilistic model for mining implicit
chemical compound–generelations from literature. Bioinformatics 21(suppl 2), 245–251 (2005)
[14] Morris, G.M., Huey, R., Lindstrom, W., Sanner, M.F., Belew, R.K., Goodsell, D.S., Olson,
A.J.: Autodock4 and autodocktools4: Automated docking with selective receptor flexibility.
Journal of computational chemistry 30(16), 2785–2791 (2009)
[15] Mousavian, Z., Masoudi-Nejad, A.: Drug–target interaction prediction via chemogenomic
space: learning-based methods. Expert opinion on drug metabolism & toxicology 10(9), 1273–
1287 (2014)
[16] Yamanishi, Y., Araki, M., Gutteridge, A., Honda, W., Kanehisa, M.: Prediction of drug–
target interaction networks from the integration of chemical and genomic spaces. Bioinformatics 24(13), 232–240 (2008)
[17] Bleakley, K., Yamanishi, Y.: Supervised prediction of drug–target interactions using bipartite
local models. Bioinformatics 25(18), 2397–2403 (2009)
[18] Wang, W., Yang, S., Li, J.: Drug target predictions based on heterogeneous graph inference.
In: Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing, p. 53 (2013).
NIH Public Access
[19] Chen, X., Liu, M.-X., Yan, G.-Y.: Drug–target interaction prediction by random walk on the
heterogeneous network. Molecular BioSystems 8(7), 1970–1978 (2012)
[20] Alaimo, S., Pulvirenti, A., Giugno, R., Ferro, A.: Drug–target interaction prediction through
domain-tuned network-based inference. Bioinformatics 29(16), 2004–2008 (2013)
21

[21] Cheng, F., Liu, C., Jiang, J., Lu, W., Li, W., Liu, G., Zhou, W., Huang, J., Tang, Y.:
Prediction of drug-target interactions and drug repositioning via network-based inference.
PLoS Comput Biol 8(5), 1002503 (2012)
[22] Mousavian, Z., Khakabimamaghani, S., Kavousi, K., Masoudi-Nejad, A.: Drug–target interaction prediction from pssm based evolutionary information. Journal of pharmacological and
toxicological methods 78, 42–51 (2016)
[23] Keum, J., Nam, H.: Self-blm: Prediction of drug-target interactions via self-training svm.
PloS one 12(2), 0171839 (2017)
[24] Chan, K.C., You, Z.-H., et al.: Large-scale prediction of drug-target interactions from deep
representations. In: Neural Networks (IJCNN), 2016 International Joint Conference On, pp.
1236–1243 (2016). IEEE
[25] Xiao, X., Min, J.-L., Wang, P., Chou, K.-C.: icdi-psefpt: identify the channel–drug interaction
in cellular networking with pseaac and molecular fingerprints. Journal of theoretical biology
337, 71–79 (2013)
[26] He, Z., Zhang, J., Shi, X.-H., Hu, L.-L., Kong, X., Cai, Y.-D., Chou, K.-C.: Predicting drugtarget interaction networks based on functional groups and biological features. PloS one 5(3),
9603 (2010)
[27] Yamanishi, Y., Kotera, M., Kanehisa, M., Goto, S.: Drug-target interaction prediction from
chemical, genomic and pharmacological data in an integrated framework. Bioinformatics
26(12), 246–254 (2010)
[28] Hao, M., Wang, Y., Bryant, S.H.: Improved prediction of drug-target interactions using
regularized least squares integrating with kernel fusion technique. Analytica chimica acta
909, 41–50 (2016)
[29] Gönen, M.: Predicting drug–target interactions from chemical and genomic kernels using
bayesian matrix factorization. Bioinformatics 28(18), 2304–2310 (2012)

22

[30] Chen, H., Zhang, Z.: A semi-supervised method for drug-target interaction prediction with
consistency in networks. PloS one 8(5), 62975 (2013)
[31] Ba-Alawi, W., Soufan, O., Essack, M., Kalnis, P., Bajic, V.B.: Daspfind: new efficient method
to predict drug–target interactions. Journal of cheminformatics 8(1), 15 (2016)
[32] Yang, Y., Gao, J., Wang, J., Heffernan, R., Hanson, J., Paliwal, K., Zhou, Y.: Sixty-five years
of the long march in protein secondary structure prediction: the final stretch? Briefings in
Bioinformatics, 129 (2016)
[33] Yang, Y., Heffernan, R., Paliwal, K., Lyons, J., Dehzangi, A., Sharma, A., Wang, J., Sattar,
A., Zhou, Y.: Spider2: A package to predict secondary structure, accessible surface area,
and main-chain torsional angles by deep neural networks. Prediction of Protein Secondary
Structure, 55–63 (2017)
[34] López, Y., Dehzangi, A., Lal, S.P., Taherzadeh, G., Michaelson, J., Sattar, A., Tsunoda,
T., Sharma, A.: Sucstruct: Prediction of succinylated lysine residues by using structural
properties of amino acids. Analytical Biochemistry (2017)
[35] Chou, K.-C.: Some remarks on protein attribute prediction and pseudo amino acid composition. Journal of theoretical biology 273(1), 236–247 (2011)
[36] Knox, C., Law, V., Jewison, T., Liu, P., Ly, S., Frolkis, A., Pon, A., Banco, K., Mak, C.,
Neveu, V., et al.: Drugbank 3.0: a comprehensive resource for omics research on drugs. Nucleic
acids research 39(suppl 1), 1035–1041 (2011)
[37] Kanehisa, M., Goto, S.: Kegg: kyoto encyclopedia of genes and genomes. Nucleic acids
research 28(1), 27–30 (2000)
[38] Altschul, S.F., Madden, T.L., Schäffer, A.A., Zhang, J., Zhang, Z., Miller, W., Lipman, D.J.:
Gapped blast and psi-blast: a new generation of protein database search programs. Nucleic
acids research 25(17), 3389–3402 (1997)

23

[39] Wishart, D.S., Knox, C., Guo, A.C., Cheng, D., Shrivastava, S., Tzur, D., Gautam, B.,
Hassanali, M.: Drugbank: a knowledgebase for drugs, drug actions and drug targets. Nucleic
acids research 36(suppl 1), 901–906 (2008)
[40] Kanehisa, M., Araki, M., Goto, S., Hattori, M., Hirakawa, M., Itoh, M., Katayama, T.,
Kawashima, S., Okuda, S., Tokimatsu, T., et al.: Kegg for linking genomes to life and the
environment. Nucleic acids research 36(suppl 1), 480–484 (2008)
[41] Schomburg, I., Chang, A., Ebeling, C., Gremse, M., Heldt, C., Huhn, G., Schomburg, D.:
Brenda, the enzyme database: updates and major new developments. Nucleic acids research
32(suppl 1), 431–433 (2004)
[42] Günther, S., Kuhn, M., Dunkel, M., Campillos, M., Senger, C., Petsalaki, E., Ahmed, J.,
Urdiales, E.G., Gewiess, A., Jensen, L.J., et al.: Supertarget and matador: resources for
exploring drug-target relationships. Nucleic acids research 36(suppl 1), 919–922 (2008)
[43] Todeschini, R., Consonni, V.: Handbook of Molecular Descriptors vol. 11. John Wiley & Sons,
??? (2008)
[44] Tabei, Y., Yamanishi, Y.: Scalable prediction of compound-protein interactions using minwise
hashing. BMC systems biology 7(6), 3 (2013)
[45] Tabei, Y., Pauwels, E., Stoven, V., Takemoto, K., Yamanishi, Y.: Identification of chemogenomic features from drug–target interaction networks using interpretable classifiers. Bioinformatics 28(18), 487–494 (2012)
[46] Chen, B., Wild, D., Guha, R.: Pubchem as a source of polypharmacology. Journal of chemical
information and modeling 49(9), 2044–2055 (2009)
[47] Guha, R., et al.: Chemical informatics functionality in r. Journal of Statistical Software 18(5),
1–16 (2007)
[48] Sharma, R., Dehzangi, A., Lyons, J., Paliwal, K., Tsunoda, T., Sharma, A.: Predict grampositive and gram-negative subcellular localization via incorporating evolutionary information
24

and physicochemical features into chou’s general pseaac. IEEE Transactions on NanoBioscience 14(8), 915–926 (2015)
[49] Paliwal, K.K., Sharma, A., Lyons, J., Dehzangi, A.: A tri-gram based feature extraction technique using linear probabilities of position specific scoring matrix for protein fold recognition.
IEEE Transactions on Nanobioscience 13(1), 44–50 (2014)
[50] Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: Smote: synthetic minority oversampling technique. Journal of artificial intelligence research 16, 321–357 (2002)
[51] Yu, J., Guo, M., Needham, C.J., Huang, Y., Cai, L., Westhead, D.R.: Simple sequence-based
kernels do not predict protein–protein interactions. Bioinformatics 26(20), 2610–2614 (2010)
[52] Laurikkala, J.: Improving identification of difficult small classes by balancing class distribution. In: Conference on Artificial Intelligence in Medicine in Europe, pp. 63–66 (2001).
Springer
[53] Yen, S.-J., Lee, Y.-S.: Cluster-based under-sampling approaches for imbalanced data distributions. Expert Systems with Applications 36(3), 5718–5727 (2009)
[54] Rahman, M.M., Davis, D.: Cluster based under-sampling for unbalanced cardiovascular data.
In: Proceedings of the World Congress on Engineering, vol. 3, pp. 3–5 (2013)
[55] Freund, Y., Schapire, R.E.: A desicion-theoretic generalization of on-line learning and an
application to boosting. In: European Conference on Computational Learning Theory, pp.
23–37 (1995). Springer
[56] Mohri, M., Rostamizadeh, A., Talwalkar, A.: Foundations of Machine Learning. MIT press,
??? (2012)
[57] Powers, D.M.: Evaluation: from precision, recall and f-measure to roc, informedness, markedness and correlation (2011)

25

[58] Cao, D.-S., Liu, S., Xu, Q.-S., Lu, H.-M., Huang, J.-H., Hu, Q.-N., Liang, Y.-Z.: Large-scale
prediction of drug–target interactions using protein sequences and drug topological structures.
Analytica chimica acta 752, 1–10 (2012)
[59] Friedman, J.H.: On bias, variance, 0/1loss, and the curse-of-dimensionality. Data mining and
knowledge discovery 1(1), 55–77 (1997)
[60] Efron, B., Gong, G.: A leisurely look at the bootstrap, the jackknife, and cross-validation.
The American Statistician 37(1), 36–48 (1983)
[61] Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M.,
Prettenhofer, P., Weiss, R., Dubourg, V., et al.: Scikit-learn: Machine learning in python.
Journal of Machine Learning Research 12(Oct), 2825–2830 (2011)
[62] Ho, T.K.: The random subspace method for constructing decision forests. IEEE transactions
on pattern analysis and machine intelligence 20(8), 832–844 (1998)
[63] Cortes, C., Vapnik, V.: Support-vector networks. Machine learning 20(3), 273–297 (1995)
[64] Nanni, L., Lumini, A., Brahnam, S.: A set of descriptors for identifying the protein–drug
interaction in cellular networking. Journal of theoretical biology 359, 120–128 (2014)

Figures

26

Figure 1: 1Schematic Diagram. Schematic diagram of the training module of iDTI-ESBoost
showing the steps of the training phase.

27

(a)

(b)

(c)

(d)

Figure 2: 1Classifier auPR Analysis. Precision-Recall curves of different classifier algorithms using
random under sampling and all the feature combinations on four datasets: (a) enzymes (b) ion
channels (c) GPCRs (d) nuclear receptors.

28

(a)

(b)

(c)

(d)

Figure 3: 1Classifier auROC Analysis. Receiver operating characteristic curves of different classifier
algorithms using random under sampling and all the feature combinations on four datasets: (a)
enzymes (b) ion channels (c) GPCRs (d) nuclear receptors.

29

(a)

(b)

(c)

(d)

Figure 4: 1Balancing Method auPR Analysis. Precision vs Recall curves of AdaBoost classifier
showing differences between random under sampling and cluster based sampling using all the feature combinations on four datasets: (a) enzymes (b) ion channels (c) GPCRs (d) nuclear receptors.

30

(a)

(b)

(c)

(d)

Figure 5: 1Balancing Method auROC Analysis. Receiver operating characteristic curves of AdaBoost classifier showing differences between random under sampling and cluster based sampling
using all the feature combinations on four datasets: (a) enzymes (b) ion channels (c) GPCRs (d)
nuclear receptors.

31

Tables
Table 1: Description of the gold standard datasets [16]
Dataset
Enzyme
Ion Chanel
GPCR
Nuclear Receptor

Drugs
445
210
223
54

Proteins
664
204
95
26

Positive Interactions
2926
1476
635
90

Table 2: Summary of evolutionary and structural features used for protein targets and fingerprint
features for drugs. The “Group” column shows different feature groups used in our experiments
and will be discussed in a later section.
Feature Group
Number of Features Reference Group
Molecular finger print
881
[22]
A
PSSM bigram
400
[22]
Secondary Structure Composition
3
This paper
B
Accessible Surface Area Composition
1
This paper
Torsional Angles Composition
8
This paper
Torsional Angles Auto-Covariance
80
This paper
C
Structural Probabilities Auto-Covariance 30
This paper
Torsional Angles bigram
64
This paper
D
Structural Probabilities bigram
9
This paper
Total
1476

32

Table 3: Performance of different classifiers on the different datasets in terms of are under Receiver
Operating Characteristic (ROC) curve (auROC) and area under precision recall curve (auPR) using
different feature group combinations and random under sampling.
Dataset
enzymes

Feature Combination
A

A,B

A,B,C

A,B,C,D

ion channels

A

A,B

A,B,C

A,B,C,D

GPCRs

A

A,B

A,B,C

A,B,C,D

nuclear receptors

A

A,B

A,B,C

33

Classifier
auPR auROC
AdaBoost
0.54
0.9530
Random Forest 0.43
0.9457
SVM
0.64 0.9647
AdaBoost
0.51 0.9431
Random Forest 0.49
0.9445
SVM
0.48 0.9502
AdaBoost
0.66 0.9638
Random Forest 0.48
0.9334
SVM
0.41
0.9360
AdaBoost
0.65 0.9689
Random Forest 0.50
0.9493
SVM
0.63
0.9628
AdaBoost
0.36 0.9271
Random Forest 0.33
0.9232
SVM
0.25 0.9467
AdaBoost
0.33 0.9191
Random Forest 0.30
0.8898
SVM
0.23 0.9213
AdaBoost
0.34 0.9202
Random Forest 0.31
0.8734
SVM
0.23 0.9213
AdaBoost
0.43 0.9369
Random Forest 0.40
0.9234
SVM
0.14
0.6723
AdaBoost
0.29 0.8856
Random Forest 0.23
0.8743
SVM
0.18
0.7832
AdaBoost
0.29 0.8834
Random Forest 0.22
0.8698
SVM
0.15
0.7802
AdaBoost
0.35 0.9116
Random Forest 0.31
0.9034
SVM
0.15
0.7945
AdaBoost
0.31 0.9128
Random Forest 0.30 0.9168
SVM
0.21
0.7896
AdaBoost
0.41 0.8145
Random Forest 0.23
0.7519
SVM
0.19
0.7898
AdaBoost
0.43 0.7969
Random Forest 0.29
0.7723
SVM
0.20
0.6789
AdaBoost
0.36 0.7590
Random Forest 0.21
0.7234
SVM
0.21
0.6971

Table 4: Parameters of AdaBoost Algorithm used with decision tree as weak classifier along with
different balancing methods on four datasets
balancing
method
random

clustered

Max Min sample
Dataset
depth
split
enzymes
100
16
ion channels
8
4
GPCRs
6
3
nuclear receptors
5
7
enzymes
110
1
ion channels
9
2
GPCRs
6
3
nuclear receptors 150
2

34

Min samples
Leaf
1
1
1
2
1
1
1
1

Criterion
Gini impurity
Gini impurity
Gini impurity
Gini impurity
Gini impurity
Gini impurity
Gini impurity
Gini impurity

Table 5: Performance of Adaboost classifier on different datasets in terms of are under Receiver
Operating Characteristic (ROC) curve (auROC) and area under precision recall curve (auPR)
using different feature group combinations and balancing methods.
Dataset
enzymes

Feature Combination
A
A,B
A,B,C
A,B,C,D

ion channels

A
A,B
A,B,C
A,B,C,D

GPCRs

A
A,B
A,B,C
A,B,C,D

nuclear receptors

A
A,B
A,B,C
A,B,C,D

35

Balancing Method
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered
random
clustered

auPR auROC
0.54
0.9530
0.58
0.9493
0.51
0.9431
0.59
0.9353
0.66
0.9638
0.63
0.9577
0.65 0.9689
0.68 0.9598
0.36
0.9271
0.38
0.8982
0.33
0.9191
0.41
0.8902
0.34
0.9202
0.45
0.9021
0.43 0.9369
0.48 0.9051
0.29
0.8856
0.48
0.9189
0.29
0.8834
0.49
0.8968
0.35
0.9116
0.50 0.8890
0.31
0.9128
0.48 0.9322
0.41
0.8145
0.79
0.9270
0.43
0.7969
0.32
0.8715
0.36
0.7590
0.57
0.8935
0.33
0.7946
0.79 0.9285

Table 6: Comparison of the performance of iDTI-ESBoost on the four bechmark gold datasets in
terms on area under receiver operating characteristic curve (auROC) with other state-of-the-art
methods.
Dataset

DBSI KBMF2K NetCBP Yamanishi
[21]
[29]
[30]
et al. [16]
enzymes
0.8075
0.8320
0.8251
0.904
ion channels
0.8029
0.7990
0.8034
0.8510
GPCRs
0.8022
0.8570
0.8235
0.8990
0.8240
0.8394
0.8430
nuclear receptors 0.7578

Yamanishi
et al. [27]
0.8920
0.8120
0.8270
0.8350

Wang
et al. [18]
0.8860
0.8930
0.8730
0.8240

Mousavian iDTI-E
et al. [22]
0.9480
0.9
0.8890
0.9
0.8720
0.9
0.8690
0.9

Table 7: Comparison of the performance of iDTI-ESBoost on the four benchmark gold datasets in
terms on area under precision-recall curve (auPR) with the state-of-the-art method in [22].
Predictor
Mousavian et al. [22]
iDTI-ESBoost

enzymes ion channels
0.546
0.390
0.680
0.480

GPCRs nuclear receptors
0.282
0.411
0.500
0.790

Table 8: Specificity, Sensitivity, Precision, MCC and F1 score for four
iDTI-ESBoost using different feature groups.
dataset
Feature Group Specificity Sensitivity Precision
enzymes
A
0.83
0.9
0.05
A,B
0.82
0.89
0.05
A,B,C
0.83
0.87
0.05
A,B,C,D
0.85
0.85
0.15
ion channels
A
0.78
0.81
0.13
A,B
0.78
0.84
0.14
A,B,C
0.8
0.86
0.12
A,B,C,D
0.78
0.84
0.13
GPCRs
A
0.78
0.84
0.12
A,B
0.8
0.85
0.11
A,B,C
0.79
0.89
0.11
A,B,C,D
0.8
0.84
0.11
nuclear receptors A
0.85
0.91
0.16
A,B
0.77
0.88
0.11
A,B,C
0.81
0.88
0.12
A,B,C,D
0.92
0.87
0.14

36

datasets as achieved by
MCC
0.1962
0.1812
0.1762
0.1889
0.2615
0.256
0.2980
0.2913
0.254
0.2760
0.2797
0.2647
0.2141
0.2154
0.1798
0.2253

F1 score
0.10
0.09
0.09
0.10
0.22
0.24
0.20
0.20
0.20
0.20
0.19
0.19
0.27
0.19
0.20
0.24

Additional Files
Additional file 1 — AdditionalFile1.xlsx
AdditionalFile1.xlsx contains the new drug-target predictions from each of the datasets. For each
dataset, 10 top predictions from the false negatives with highest probability scores are reported.

37

