arXiv:1803.04839v2 [] 2 Apr 2018

Optimal Estimators in Misspecified Linear Regression Model with an
Application to Real World Data
Manickavasagar Kayanana,b∗ and Pushpakanthie Wijekoonc
a

Postgraduate Institute of Science, University of Peradeniya, Peradeniya, Sri Lanka;
Deparment of Physical Science, Vavuniya Campus of the University of Jaffna, Vavuniya, Sri
Lanka; c Department of Statistics and Computer Science, University of Peradeniya,
Peradeniya, Sri Lanka
b

ARTICLE HISTORY
Compiled April 3, 2018
ABSTRACT
In this article, we propose the Sample Information Optimal Estimator (SIOE) and
the Stochastic Restricted Optimal Estimator (SROE) for misspecified linear regression model when multicollinearity exists among explanatory variables. Further, we
obtain the superiority conditions of proposed estimators over some other existing
estimators in the Mean Square Error Matrix (MSEM) criterion in a standard form
which can apply to all estimators considered in this study. Finally, a real world example and a Monte Carlo simulation study are presented for the proposed estimators
to illustrate the theoretical results.
KEYWORDS
Sample Information Optimal Estimator; Stochastic Restricted Optimal Estimator;
Mean Square Error Matrix

1. Introduction
The multiple linear regression model defined as
y = Xβ + ǫ

(1)

where y is the n × 1 vector of observations on the predictor variable, X is the n × p
matrix of observations on p non stochastic regressor variables, β is a p × 1 vectors of
unknown parameters, ǫ is the n × 1 vector of disturbances, such that E(ǫ) = 0 and
E(ǫǫ′ ) = Ω = σ 2 I.
The estimator for β considered commonly in practical situations is the ordinary
least squares estimator (OLSE)
β̂ OLSE = (X ′ X)−1 X ′ y

(2)

which is unbiased and has the minimum variance among all linear unbiased estimators.
Two of the significant problems suggesting that the OLSE is not a desirable estima∗ Corresponding

author. Email: mgayanan@vau.jfn.ac.lk

tor which are multicollinearity among the regressor variables and exclusion of some
relevant regressor variables in the model (1).
If the columns of the X matrix are nearly linearly dependent, i.e., multicollinear,
then the matrix X ′ X is almost singular. Consequently, the numerical computation of
(2) will be unstable, and the variance of the OLSE will be huge.
The biased estimators based on the sample model (1) or by combining sample model
with the exact or stochastic linear restrictions (prior information) have been considered
by many researchers to combat the problem of multicollinearity. The performance of
these estimators was compared with the OLSE with respect to the Mean Square Error
Matrix (MSEM) criterion, and Scalar Mean Square Error (SMSE) sense.
Exclusion of some relevant explanatory variables in linear regression models is quite
common in econometric research, which leads to the biased and inconsistent estimation
of parameters. For example, suppose the correct model (1) written as
y = X 1 β1 + X 2 β2 + ǫ

(3)

where X 1 and X 2 are the n × l and n × p matrices of observations on the m = l + p
regressors, β 1 and β 2 are the l × 1 and p × 1 vectors of unknown coefficients. If the
researcher misspecifies the regression model by excluding p regressors as
y = X 1 β1 + u

(4)

where u = X 2 β 2 + ǫ, then model (5) is a misspecified regression model.
The stochastic linear restrictions on β 1 may be in the form of
r = Rβ 1 + g + v

(5)

where r is the q×1 vector, R is the given q×l matrix with rank q, g is the q×1 unknown
fixed vector, v is the q × 1 vector of disturbances, such that E(v) = 0,E(vv ′ ) = Ψ =
σ 2 W with W is positive definite and E(vu′ ) = 0. Here, equation (5) represents exact
linear restriction when the random error term v vanishes.
The regressor variables in the misspecified linear regression model (4) may also be
multicollinear, and several researchers have examined the consequences of the estimation procedure in this situation. Sarkar [1] compared the performance of OLSE, Ridge
Estimator (RE) and Principal Component Regression Estimator (PCRE) when multicollinearity exists in a misspecified regression model. Şiray [2] and Wu [3] examined
the efficiency of the r-d class estimator and r-k class estimator over some existing estimators in the misspecified regression model, and Chandra and Tyagi [4] considered the
consequence of misspecification of the r-(k,d) class estimator. Recently, Kayanan and
Wijekoon [5] studied the performance RE, Almost Unbiased Ridge Estimator (AURE),
Liu Estimator (LE), Almost Unbiased Liu Estimator (AULE), PCRE, r-k class estimator and r-d class estimator in the misspecified linear regression model. The above
mentioned RE, PCRE, AURE, LE, AULE, r-k class estimator, r-d class estimator and
the r-(k,d) class estimator are all based on the sample information (1).
The performance of estimators by combining the model (4) with prior information also considered by several researchers. Teräsvirta [6], Mittelhmmer [7], Ohtani
and Honda [8], Kadiyala [9], Trenkler and Wijekoon [10] and Wijekoon and Trenkler [11] have discussed the dominance of Mixed Regression Estimator (MRE) under misspecified regression model due to excluding relevant variable. Further, Hubert
and Wijekoon [12] discussed the performance of Stochastic Restricted Liu estimator
2

(SRLE), and Kayanan and Wijekoon [13] examined the performance of Stochastic Restricted Ridge Estimator (SRRE), Stochastic Restricted Almost Unbiased Ridge Estimator (SRAURE), Stochastic Restricted Almost Unbiased Liu Estimator (SRAULE),
Stochastic Restricted Principal Component Regression Estimator (SRPCR), Stochastic Restricted r-k class estimator (SRrk) and Stochastic Restricted r-d class estimator
(SRrd) in the misspecified regression model.
In this article, we introduce the Sample Information Optimal Estimator (SIOE) and
the Stochastic Restricted Optimal Estimator (SROE) for misspecified linear regression
model based on Generalized Optimal Estimator (GOE) proposed by Arumairajan and
Wijekoon [14]. Further, we obtain a common form of superiority conditions between
the proposed estimators and some existing estimators in the Mean Square Error Matrix
(MSEM) criterion. Finally, we employ a Monte Carlo simulation study and a numerical
example to illustrate the theoretical results.
The rest of the article is organized as follows. The canonical form of the misspecified
model and estimators are written in section 2. The proposed optimal estimators and
MSEM comparisons are presented in section 3. In section 4, a Monte Carlo simulation
study and a real world example to illustrate the theoretical results are given. Section
5 includes concluding remarks. References and Appendix are given at the end of this
article.

2. Misspecified Regression model and Generalized estimators
Suppose the correct regression model is given in (3), and further, it is misspecifed
as (4). According to Singh et al. [15], we apply spectral decomposition to the symmetric matrix X ′1 X 1 (since X ′1 X 1 is a positive definite matrix) then we have
T ′ X ′1 X 1 T = Λ = diag(λ1 , ......, λl ), where T = (t1 , t2 , ......, tl ) is the orthogonal
matrix and λi > 0 being the ith eigenvalue of X ′1 X 1 . Let T h = (t1 , t2 , ......, th )
be the remaining column of T having deleted l − h columns where h ≤ l. Hence,
T h X ′1 X 1 T h = Λh = diag(λ1 , ......, λh ).
Let Z = X 1 T and γ = T ′ β 1 then models (3) and (4) can be written in canonical
form as

y =Zγ + δ + ǫ
y =Zγ + u

(6)
(7)

respectively, where δ = X 2 β 2 .
The OLSE of model (7) is given by
γ̂ OLSE = (Z ′ Z)−1 Z ′ y = Λ−1 Z ′ y

(8)

According to Kayanan and Wijekoon [5], the generalized form to represent the
estimators RE, AURE, LE, AULE, PCR, r−k class estimator and r−d class estimator
for model (7) is given by
γ̂ G = Gγ̂ OLSE

3

(9)

where


γ̂ RE





γ̂ AU RE





γ̂ LE
γ̂ G = γ̂ AU LE



γ̂ P CRE





γ̂ rk



γ̂ rd

if
if
if
if
if
if
if

G = (Λ + kI)−1 Λ

G = I − k2 (Λ + kI)−2
G = (Λ + I)−1 (Λ + dI)

G = I − (1 − d)2 (Λ + I)−2
G = T h T ′h
G = T h T ′h (Λ + kI)−1 Λ
G = T h T ′h (Λ + I)−1 (Λ + dI)

having the shrinkage parameters k > 0 and 0 < d < 1.
According to Kadiyala [9], now we apply the simultaneous decomposition for the
symmetric matrices X ′1 X 1 and R′ Ψ−1 R where X ′1 X 1 is a positive definite matrix
and R′ Ψ−1 R is a positive semi-definite matrix. Then we have
B ′ X ′1 X 1 B = I

B ′ R′ Ψ−1 RB = Λ∗

and

where B is a l × l nonsingular matrix, Λ∗ is a l × l diagonal matrix with eigenvalues
λ∗i > 0 for i = 1, 2, ......, q and λ∗i = 0 for i = q + 1, ......, l.
Let Z ∗ = X 1 B, R∗ = RB, γ ∗ = B −1 β 1 , Z ′∗ Z ∗ = I and R′∗ Ψ−1 R∗ = Λ∗ then
models (3), (4) and (5) can be written as
y =Z ∗ γ ∗ + δ + ǫ
y =Z ∗ γ ∗ + u
r =R∗ γ ∗ + g + v

(10)
(11)
(12)

respectively. Now the MRE can be written as
γ M RE =(Z ′∗ Z ∗ + R′∗ Ψ−1 R∗ )−1 (Z ′∗ y + R′∗ W −1 r)
=(I + σ 2 Λ∗ )−1 (Z ′∗ y + R′∗ W −1 r)

(13)

By following Kayanan and Wijekoon [13], the generalized form to represent the
stochastic restricted biased estimators SRRE, SRAURE, SRLE, SRAULE, SRPCR,
SRrk and SRrd for the model (11) is given by
γ̂ ∗G = G∗ γ̂ M RE
where


γ̂ SRRE





γ̂ SRAU RE




γ̂ SRLE

∗
γ̂ G = γ̂ SRAU LE



γ̂ SRP CRE





γ̂

SRrk


γ̂ SRrd

if
if
if
if
if
if
if

G∗
G∗
G∗
G∗
G∗
G∗
G∗

4

= (1 + k)−1
= (1 + k)−2 (1 + 2k)
= 2−1 (1 + d)
= 2−2 (1 + d)(3 − d)
= T h T ′h
= (1 + k)−1 T h T ′h
= 2−1 (1 + d)T h T ′h

(14)

having the shrinkage parameters k > 0 and 0 < d < 1.
According to Kayanan and Wijekoon [5,13], the bias vector, dispersion matrix and
∗ can be presented in the common form as
MSEM for each γ̂G and γ̂G
Bias(γ̂ G̃ ) =G̃(γ̃ + τ A) − γ̃
D(γ̂ G̃ ) =σ 2 G̃τ G̃

(15)

′
′

(16)



M SEM (γ̂ G̃ ) =σ 2 G̃τ G̃ + G̃(γ̃ + τ A) − γ̃



G̃(γ̃ + τ A) − γ̃

′

(17)

respectively. Note that, equations (15), (16) and (17) give the bias vector, dispersion
matrix and MSEM for the
(i) RE, AURE, LE, AULE, PCR, r-k class estimator and r-d class estimator when
γ̂ G̃ = γ̂ G , G̃ = G, γ̃ = γ, τ = Λ−1 and A = Z ′ δ, and
(ii) SRRE, SRAURE, SRLE, SRAULE, SRPCR, SRrk and SRrd when γ̂ G̃ = γ̂ ∗G ,
G̃ = G∗ , γ̃ = γ ∗ , τ = (I + σ 2 Λ∗ )−1 and A = (Z ′∗ δ + R′∗ W −1 g).
The respective expressions for the each estimator are summarized in Tables C1 and
C2 in Appendix C.
3. Optimal estimators
Note that the SMSE of γ̂ G̃ can be written as


SM SE(γ̂ G̃ ) =tr M SEM (γ̂ G̃ )

 
′ 

′
=σ 2 tr G̃τ G̃ + G̃(γ̃ + τ A) − γ̃
G̃(γ̃ + τ A) − γ̃


′
′
′
=σ 2 tr G̃τ G̃ + (γ̃ + τ A)′ G̃ G̃(γ̃ + τ A) − (γ̃ + τ A)′ G̃ γ̃

(18)

− γ̃ ′ G̃(γ̃ + τ A) + γ̃ ′ γ̃
Now by differentiating (18) with respect to G̃ we obtain
∂ (SM SE(γ̂ G ))
=σ 2 G̃(τ + τ ′ ) + 2G̃(γ̃ + τ A)(γ̃ + τ A)′ − (γ̃ + τ A)γ̃ ′ − γ̃(γ̃ + τ A)′
∂ G̃

=2G̃ σ 2 τ + (γ̃ + τ A)(γ̃ + τ A)′ − (γ̃ + τ A)γ̃ ′ − γ̃(γ̃ + τ A)′
(19)
Since τ is symmetric and positive definite matrix, then σ 2 τ + (γ̃ + τ A)(γ̃ + τ A)′ is
positive definite [see 16, p.366].
Equating (19) to null matrix, we can find the optimum G̃, which is
G̃opt = 2−1 (γ̃ + τ A)γ̃ ′ + γ̃(γ̃ + τ A)′



σ 2 τ + (γ̃ + τ A)(γ̃ + τ A)′

−1

(20)

Note that, the only unknown parameter in the above equation is γ̃.
The proposed Sample Information Optimal estimator (SIOE) is now defined as
γ̂ SIOE = Gopt γ̂ OLSE
5

(21)

by substituting γ̃ = γ, τ = Λ−1 and A = Z ′ δ in equation (20), where

−1
Gopt = 2−1 (γ + Λ−1 Z ′ δ)γ ′ + γ(γ + Λ−1 Z ′ δ)′ σ 2 Λ−1 + (γ + Λ−1 Z ′ δ)(γ + Λ−1 Z ′ δ)′
.
Further, the proposed Stochastic Restricted Optimal estimator (SROE) can be defined as
γ̂ SROE = G∗opt γ̂ M RE

(22)

by substituting γ̃ = γ ∗ , τ = (I + σ 2 Λ∗ )−1 and A = (Z ′∗ δ + R′∗ W −1 g) in equation
(20), where
G∗opt = 2−1 {(γ ∗ + (I + σ 2 Λ∗ )−1 (Z ′∗ δ + R′∗ W −1 g))γ ′∗ + γ ∗ (γ ∗ + (I + σ 2 Λ∗ )−1 (Z ′∗ δ +
R′∗ W −1 g))′ }(σ 2 (I + σ 2 Λ∗ )−1 + (γ ∗ + (I + σ 2 Λ∗ )−1 (Z ′∗ δ + R′∗ W −1 g))(γ ∗ + (I +
σ 2 Λ∗ )−1 (Z ′∗ δ + R′∗ W −1 g))′ )−1 .
Note that, γ = T ′ β 1 and γ ∗ = B −1 β 1 , where β 1 is an unknown parameter in the
model (4). Therefore, it is necessary to identify an estimated value for β 1 to substitute
Gopt and G∗opt when estimating SIOE and SROE. According to the method suggested
by Newhouse and Oman [17], if the MSEM is a function of true regression coefficient
vector β, the error variance σ 2 and shrinkage parameter k,then the MSEM can be minimized when β is the normalized eigenvectors corresponding to the largest eigenvalue
of X ′ X matrix which satisfy the constraint β ′ β = 1, where X is the standardized
matrix of regressor variables. To select the vector β 1 following this approach first we
have to standardize the regressor variables before estimating SIOE and SROE. The
bias vector, dispersion matrix and mean square error matrix (MSEM) of SIOE and
SROE can be obtained by substituting
(i) γ̂ G̃ = γ̂ SIOE , G̃ = Gopt , γ̃ = γ, τ = Λ−1 and A = Z ′ δ, and
(ii) γ̂ G̃ = γ̂ SROE , G̃ = G∗opt , γ̃ = γ ∗ , τ = (I + σ 2 Λ∗ )−1 and A = (Z ′∗ δ + R′∗ W −1 g),
respectively, to equations (15), (16) and (17).

−1
Remark 3.1. Note that when δ = 0 in equation (21), Gopt = γ̃ γ̃ ′ σ 2 Λ−1 + γ̃ γ̃ ′
.
This is the SIOE for the correctly specified model introduced by Arumairajan and Wijekoon [14].
Remark 3.2. When δ = 0 and g = 0 in equation (22), we can obtain the SROE for
the correctly specified model.
3.1. Mean Square Error Matrix (MSEM) comparison
Now we state the following theorems which present the superiority conditions between
γ̂ G and γ̂ SIOE , and γ̂ ∗G and γ̂ SROE with respect to the MSEM criterion .
Theorem 3.1. If the largest eigenvalue of the matrix Gopt τ G′opt (Gτ G′ )−1
is less than one, γ̂ SIOE is superior to γ̂ G if and only if (Gopt (γ + τ A) −
−1
γ)′ σ 2 (Gτ G′ − Gopt τ G′opt ) + (G(γ + τ A) − γ)(G(γ + τ A) − γ)′
(Gopt (γ
+
τ A) − γ) ≤ 1, where τ = Λ−1 and A = Z ′ δ.
Proof. Based on (16) now we obtain
D(γ̂ G ) − D(γ̂ SIOE ) = σ 2 Gτ G′ − Gopt τ G′opt

6



(23)

Note that Gτ G′ > 0 and Gopt τ G′opt > 0 [see 16, p.366]. According to Lemma
B.2 in Appendix B, Gτ G′ − Gopt τ G′opt > 0 if the largest eigenvalue of the matrix
Gopt τ G′opt (Gτ G′ )−1 is less than one. Then according to Lemma B.1 in Appendix
B, M SEM (γ̂ G ) − M SEM (γ̂ SIOE ) is nonnegative definite if (Gopt (γ + τ A) −
−1
γ)′ σ 2 (Gτ G′ − Gopt τ G′opt ) + (G(γ + τ A) − γ)(G(γ + τ A) − γ)′
(Gopt (γ
+
τ A) − γ) ≤ 1, where τ = Λ−1 and A = Z ′ δ. This completes the proof.
Theorem 3.2. If the largest eigenvalue of the matrix G∗opt τ G∗opt (G∗ τ G′∗ )−1
is less than one, γ̂ SROE is superior to γ̂ G if and only if (G∗opt (γ ∗ + τ A) −
−1 ∗
′
γ ∗ )′ σ 2 (G∗ τ G′∗ − G∗opt τ G∗opt ) + (G∗ (γ∗ + τ A) − γ ∗ )(G∗ (γ ∗ + τ A) − γ ∗ )′
(Gopt (γ ∗ +
−1
′
2
−1
′
τ A) − γ ∗ ) ≤ 1, where τ = (I + σ Λ∗ ) and A = (Z ∗ δ + R∗ W g).
′

Proof. Note that



′
D(γ̂ G ) − D(γ̂ SROE ) = σ 2 G∗ τ G′∗ − G∗opt τ G∗opt

(24)

Since G∗ τ G′∗ > 0 and G∗opt τ G∗opt > 0 [see 16, p.366], G∗ τ G′∗ − G∗opt τ G∗opt > 0
′
if the largest eigenvalue of the matrix G∗opt τ G∗opt (G∗ τ G′∗ )−1 is less than one
(see Lemma B.2 in Appendix B). Then according to Lemma B.1 in Appendix
B, M SEM (γ̂ G ) − M SEM (γ̂ SROE ) is nonnegative definite if (G∗opt (γ ∗ + τ A) −
−1 ∗
′
γ ∗ )′ σ 2 (G∗ τ G′∗ − G∗opt τ G∗opt ) + (G∗ (γ∗ + τ A) − γ ∗ )(G∗ (γ ∗ + τ A) − γ ∗ )′
(Gopt (γ ∗ +
−1
′
2
−1
′
τ A) − γ ∗ ) ≤ 1, where τ = (I + σ Λ∗ ) and A = (Z ∗ δ + R∗ W g). This completes
the proof.
′

′

Note that the superiority conditions between SIOE and the biased estimators RE,
AURE, LE, AULE, PCRE, r-k class estimator and r-d class estimator can obtain by
substituting appropriate expressions in Theorem 3.1 (see Table C1 in Appendix C).
Similarly, the superiority conditions between SROE and the biased estimators SRRE,
SRAURE, SRLE, SRAULE, SRPCRE, SRrk and SRrd can obtain by substituting
appropriate expressions in Theorem 3.2 (Refer Table C2 in Appendix C).

4. Simulation Study
4.1. Monte Carlo simulation study
According to McDonald and Galarneau [18], now we generate the regressor variables
as follows:
p
; i = 1, 2, ......, n. j = 1, 2, 3, 4, 5.
(25)
xi,j = (1 − α2 )zi,j + αzi,6
where zi,j is an independent standard normal pseudo random number, and α is specified so that the theoretical correlation between any two explanatory variables is given
by α2 . A predictor variable is generated by using the following equation
yi = β1 xi,1 + β2 xi,2 + β3 xi,3 + β4 xi,4 + β5 xi,5 + ǫi

; i = 1, 2, ......, n.

(26)

where ǫi is a normal pseudo random number with mean zero and variance one. Also,
we choose β = (β1 , β2 , β3 , β4 , β5 ) as the normalized eigenvector corresponding to the
7

OLSE
RE
AURE
LE
AULE
PCR
r−k
r−d
SIOE

15

Estimated SMSE values

Estimated SMSE values

20

OLSE
RE
AURE
LE
AULE
PCR
r−k
r−d
SIOE

12

10

9

6

3

5

0

0
0.1

0.3

0.5

0.7

0.9

0.1

Shrinkage parameter (k/d) values

0.3

0.5

0.7

0.9

Shrinkage parameter (k/d) values

(a) Under correctly specified model.

(b) Under misspecified model.

Figure 1. SMSE values of the OLSE, RE, AURE, LE, AULE, PCRE, r-k class estimator, r-d class estimator
and SIOE when α = 0.9.

largest eigenvalue of X ′ X for which β ′ β = 1. Further, we choose R = (1, 1, 1, 1, 1) and
g = (0, 0, 0, 0, 0). To investigate the effects of different degrees of multicollinearity on
the estimators, we choose α = (0.9, 0.99, 0.999), and to study effect of misspecification,
we choose X 1 = (x1 , x2 , x3 ) and X 2 = (x4 , x5 ). For simplicity, we select values k and
d in the range(0,1).
The simulation is repeated 2000 times by generating new pseudo random numbers
and the simulated SMSE values of the estimators are obtained using the following
equation:
SM SE(γ) =

2000
1 X
tr (M SEM (γ r ))
2000

(27)

r=1

The results are displayed in Figures 1-6 and further summarized in Tables C3-C8 in
Appendix C.
Figures 1-3 show the estimated SMSE values of the OLSE, RE, AURE, LE, AULE,
PCRE, r-k class estimator, r-d class estimator and SIOE when α = 0.9, α = 0.99 and
α = 0.999 for the selected values of shrinkage parameters (k/d), respectively. According
to the results shown in Figures 1-3, we can observe that SIOE always outperforms the
OLSE, RE, AURE, LE, AULE, PCRE, r-k class estimator, and r-d class estimator
based on the sample information in both correctly specified model and misspecified
model for all the given values of α.
Figures 4-6 show the estimated SMSE values of the MRE, SRRE, SRAURE, SRLE,
SRAULE, SRPCRE, SRrk, SRrd and SROE when α = 0.9, α = 0.99 and α = 0.999 for
the selected values of shrinkage parameters (k/d), respectively. According to the results
shown in Figures 4-6, it is clear that SROE always outperforms the other estimators
based on the sample information with stochastic restrictions in the correctly specified
model under all given values of α.When we consider misspecified model SROE always
outperforms over the MRE, SRRE, SRAURE, SRLE, SRAULE, SRPCRE, SRrk, and
SRrd estimators based on the sample information with stochastic restrictions when
8

20

20
OLSE
RE
AURE
LE
AULE
PCR
r−k
r−d
SIOE

12

16
Estimated SMSE values

Estimated SMSE values

16

OLSE
RE
AURE
LE
AULE
PCR
r−k
r−d
SIOE

8

4

12

8

4

0

0
0.1

0.3

0.5

0.7

0.9

0.1

Shrinkage parameter (k/d) values

0.3

0.5

0.7

0.9

Shrinkage parameter (k/d) values

(a) Under correctly specified model.

(b) Under misspecified model.

Figure 2. SMSE values of the OLSE, RE, AURE, LE, AULE, PCRE, r-k class estimator, r-d class estimator
and SIOE when α = 0.99 (where lines of OLSE, LE, AULE, PCRE and r-d class estimator are disappeared
due to high SMSE values compared to others (refer Table C4 in Appendix C)).

5

5
OLSE
RE
AURE
LE
AULE
PCR
r−k
r−d
SIOE

3

4
Estimated SMSE values

Estimated SMSE values

4

OLSE
RE
AURE
LE
AULE
PCR
r−k
r−d
SIOE

2

1

3

2

1

0

0
0.1

0.3

0.5

0.7

0.9

0.1

Shrinkage parameter (k/d) values

0.3

0.5

0.7

0.9

Shrinkage parameter (k/d) values

(a) Under correctly specified model.

(b) Under misspecified model.

Figure 3. SMSE values of the OLSE, RE, AURE, LE, AULE, PCRE, r-k class estimator, r-d class estimator
and SIOE when α = 0.999 (where lines of OLSE, LE, AULE, PCRE and r-d class estimator are disappeared
due to high SMSE values compared to others ((refer Table C5 in Appendix C))).

9

1.5

2.9

Estimated SMSE values

2.7

2.5

2.3

2.1

MRE
SRRE
SRAURE
SRLE
SRAULE
SRPCR
SRrk
SRrd
SROE

1.4
Estimated SMSE values

MRE
SRRE
SRAURE
SRLE
SRAULE
SRPCR
SRrk
SRrd
SROE

1.3
1.2
1.1
1.0
0.9
0.8

1.9
0.1

0.3

0.5

0.7

0.9

0.1

Shrinkage parameter (k/d) values

0.3

0.5

0.7

0.9

Shrinkage parameter (k/d) values

(a) Under correctly specified model.

(b) Under misspecified model.

Figure 4. SMSE values of the MRE, SRRE, SRAURE, SRLE, SRAULE, SRPCRE, SRrk, SRrd and SROE
when α = 0.9.

3.0

Estimated SMSE values

2.8
2.6
2.4
2.2

Estimated SMSE values

1.5
MRE
SRRE
SRAURE
SRLE
SRAULE
SRPCR
SRrk
SRrd
SROE

MRE
SRRE
SRAURE
SRLE
SRAULE
SRPCR
SRrk
SRrd
SROE

1.3

1.1

0.9

2.0
0.7

1.8
0.1

0.3

0.5

0.7

0.9

0.1

Shrinkage parameter (k/d) values

0.3

0.5

0.7

0.9

Shrinkage parameter (k/d) values

(a) Under correctly specified model.

(b) Under misspecified model.

Figure 5. SMSE values of the MRE, SRRE, SRAURE, SRLE, SRAULE, SRPCRE, SRrk, SRrd and SROE
when α = 0.99.

10

1.5
MRE
SRRE
SRAURE
SRLE
SRAULE
SRPCR
SRrk
SRrd
SROE

Estimated SMSE values

2.7
2.5
2.3
2.1

Estimated SMSE values

2.9

MRE
SRRE
SRAURE
SRLE
SRAULE
SRPCR
SRrk
SRrd
SROE

1.3

1.1

0.9

1.9
0.7
1.7
0.1

0.3

0.5

0.7

0.9

0.1

Shrinkage parameter (k/d) values

0.3

0.5

0.7

0.9

Shrinkage parameter (k/d) values

(a) Under correctly specified model.

(b) Under misspecified model.

Figure 6. SMSE values of the MRE, SRRE, SRAURE, SRLE, SRAULE, SRPCRE, SRrk, SRrd and SROE
when α = 0.999.

α = 0.9. SROE has the same performance with SRRE and SRLE for a specific range
of shrinkage parameter values when α = 0.99 and α = 0.999.
4.2. Real World example
To illustrate the theoretical results, we further analyse the dataset shown in Table
C9 in Appendix C. This data set gives the total National Research and Development
Expenditures as a Percent of Gross National Product by Country from 1972 to 1986.
The dependent variable y of this dataset is the percentage spent by the United States,
and the regressor variables are x1 is the percent spent by former Soviet Union, x2 that
spent by France, x3 that spent by West Germany, and x4 that spent by the Japan.
The data was discussed in Gruber [19], and the data has been analysed by Akdeniz
and Erol [20], Li and Yang [21] and among others.
Variance Inflation Factor (VIF) values of the regressor variables are 6.91, 21.58,
29.75, and 1.79, which indicate that the multicollinearity exists in the dataset. Further,
we consider R = (1, −2, −2, −2) and g = (0, 0, 0, 0). To study effect of misspecification,
we partition the regressor matrix as X 1 = (x1 , x2 , x3 ) and X 2 = (x4 ). The results are
displayed in Figures 7-8 and further summarized in Tables C10-C11 in Appendix C.
Figure 7 shows the estimated SMSE values of the OLSE, RE, AURE, LE, AULE,
PCRE, r-k class estimator, r-d class estimator and SIOE for the selected values of
shrinkage parameters (k/d). The results in Figure 7 demonstrate that SIOE always
outperforms the OLSE, RE, AURE, LE, AULE, PCRE, r-k class estimator, and r-d
class estimator based on the sample information in both correctly specified model and
misspecified model.
Figure 8 shows the estimated SMSE values of the MRE, SRRE, SRAURE, SRLE,
SRAULE, SRPCRE, SRrk, SRrd and SROE for the selected values of shrinkage parameters (k/d). According to this Figure, we can observe that SROE always outperforms
the MRE, SRRE, SRAURE, SRLE, SRAULE, SRPCRE, SRrk, and SRrd estimators
based on the sample information with stochastic restrictions in both correctly specified
11

2.9

Estimated SMSE values

2.7

2.5

2.3

OLSE
RE
AURE
LE
AULE
PCR
r−k
r−d
SIOE

2.8

Estimated SMSE values

OLSE
RE
AURE
LE
AULE
PCR
r−k
r−d
SIOE

2.1

2.6

2.4

2.2

2.0

1.9

1.8
0.1

0.3

0.5

0.7

0.9

0.1

Shrinkage parameter (k/d) values

0.3

0.5

0.7

0.9

Shrinkage parameter (k/d) values

(a) Under correctly specified model.

(b) Under misspecified model.

Figure 7. SMSE values of the OLSE, RE, AURE, LE, AULE, PCRE, r-k class estimator, r-d class estimator
and SIOE.

1.6

Estimated SMSE values

1.3

1.0

0.7

2.5

Estimated SMSE values

MRE
SRRE
SRAURE
SRLE
SRAULE
SRPCR
SRrk
SRrd
SROE

0.4

MRE
SRRE
SRAURE
SRLE
SRAULE
SRPCR
SRrk
SRrd
SROE

2.0

1.5

1.0

0.5

0.1

0.0
0.1

0.3

0.5

0.7

0.9

0.1

Shrinkage parameter (k/d) values

0.3

0.5

0.7

0.9

Shrinkage parameter (k/d) values

(a) Under correctly specified model.

(b) Under misspecified model.

Figure 8. SMSE values of the MRE, SRRE, SRAURE, SRLE, SRAULE, SRPCRE, SRrk, SRrd and SROE.

12

model and misspecified model.

5. Conclusion
In this article, we proposed SIOE for the misspecified regression model based on sample
information, and SROE for the misspecified regression model based on sample information with stochastic restrictions. Theorem 3.1 and Theorem 3.2 provide a common
form of superiority conditions to compare SIOE and the estimators based on sample
information, and to compare SROE and the estimators based on sample information
with stochastic restrictions, respectively.
The simulation study revealed that SIOE is the best estimator for the correctly
specified model and misspecified model based on sample information under all degrees
of multicollinearity. Further, the SROE is the best estimator for correctly specified
model based on sample information with stochastic restrictions. However, when the
model is misspecified, the SROE, SRRE, and SRLE achieve higher performance with
extreme multicollinearity.

References
[1] Sarkar N. Comparisons Among Some Estimators In Misspecified Linear Models With
Multicollinearity. Ann. Inst. Statist. Math. 1989;41(4):717–724.
[2] Şiray G. r-d Class Estimator under misspecification. Communications in Statistics-Theory
and Methods. 2015;44(22):4742–4756.
[3] Wu J. Superiority of the r-k class estimator over some estimators in a misspecified linear
model. Communication in Statistics-Theory and Methods. 2016;45:1453–1458.
[4] Chandra S, Tyagi G. On the performance of some biased estimators in a misspecified
model with correlated regressors. STATISTICS IN TRANSITION new series. 2017;27–
52.
[5] Kayanan M, Wijekoon P. Performance of Existing Biased Estimators and the respective Predictors in a Misspecified Linear Regression Model. Open Journal of Statistics.
2017;876–900.
[6] Teräsvirta T. Linear restrtctions in misspecified linear models and polynomial distributed
lag estimation. Finland : Departntent of Statistics University of Helsinki; 1980.
[7] Mittelhammer RC. On specification error in the general linear model and weak mean
square error superiority of the mixed estimator. Communications in Statistics-Theory
and Methods. 1981;167–176.
[8] Ohtani K, Honda Y. On small sample properties of the mixed regression predictor under
misspecification. Communications in Statistics-Theory and Methods. 1984;2817–2825.
[9] Kadiyala K. Mixed Regression Estimator under misspecification. Economic Letters.
1986;21:27–30.
[10] Trenkler G, Wijekoon P. Mean square error matrix superiority of the mixed regression
estimator under misspecification. Statistica.anno. 1989;49(1):65–71.
[11] Wijekoon P, Trenkler G. Mean Square Error Matrix Superiority of Estimators under
Linear Restrictions and Misspecification. Economics Letters. 1989;30:141–149.
[12] Hubert M, Wijekoon P. Superiority of the stochastic restricted Liu estimator under misspecification. Statistica. 2004;64(1):153–162.
[13] Kayanan M, Wijekoon P. Stochastic Restricted Biased Estimators in misspecified regression model with incomplete prior information. arXiv preprint. 2017;arXiv:1712.03358.
[14] Arumairajan S, Wijekoon P. Optimal Generalized Biased Estimator in Linear Regression
Model. Open Journal of Statistics. 2015;5:403–411.

13

[15] Singh B, Chaubey YP, Dwivedi TD. An Almost Unbiased Ridge Estimator. The Indian
Journal of Statistics. 1986;48(3):342-346.
[16] Rao CR, Toutenburg H. Linear Models :Least Squares and Alternatives. 2nd ed. New
York (NY): Springer-Verlag; 1995.
[17] Newhouse JP, Oman SD. An Evaluation of Ridge Estimators. Santa Monica(CA): RAND
Corporation; 1971.
[18] McDonald GC, Galarneau DI. A Monte Carlo Evaluation of Some Ridge-Type Estimators.
Journal of the American Statistical Association. 1975;70:407–416.
[19] Gruber M. Improving Efficiency by Shrinkage: The James-Stein and Ridge Regression
Estimators. New York (NY): CRC Press; 1998.
[20] Akdeniz F, Erol H. Mean Squared Error Matrix Comparisons of Some Biased Estimators
in Linear Regression. Communications in Statistics-Theory and Methods. 2003;2389–2413.
[21] Li Y, Yang H. A new stochastic mixed ridge estimator in linear regression model. Statistical Papers. 2010;315-323.
[22] Trenkler G, Toutenburg H. Mean square error matrix comparisons between biased estimators an overview of recent results. Statistical Papers. 1990;31:165-179.

6. Appendices
Appendix A. Matrix Operations
• Let M and N be any two matrixes with proper order, then
∂BM B ′
= B(M + M ′ )
∂B
• Let x is a n × 1 vector, y is a m × 1 vector and B is an n × m matrix, then
∂x′ By
= xy ′
∂B
• Let x be a m × 1 vector, M a n × n symmetric matrix and B a n × m matrix,
then
∂x′ B ′ M Bx
= 2M Bxx′
∂B
Appendix B. Lemmas
Lemma B.1. (Trenkler and Toutenburg [22])
Let β̂1 and β̂2 be two linear estimator of β. Suppose that D(β̂1 ) − D(β̂2 ) is
positive definite, then M SEM (β̂1 ) − M SEM (β̂2 ) is non negative if and only if

−1
b′2 D(β̂1 ) − D(β̂2 ) + b1 b′1
b2 ≤ 1, where D(β̂j ), M SEM (β̂j ) and bj denote dispersion matrix, mean square error matrix and bias vector of β̂j respectively, j = 1, 2.
Lemma B.2. (Rao and Toutenburg [16])
Let n × n matrices M > 0, N ≥ 0, then M > N if and only if largest eigenvalue of
the matrix N M −1 is less than one.

14

Table C1. Bias vector, Dispersion matrix and MSEM of the biased estimators
Estimators
γ̂OLSE

γ̂RE

γ̂AU RE

Stochastic Properties
Bias(γ̂OLSE ) = τ A
D(γ̂OLSE ) = σ2 τ
M SEM (γ̂OLSE ) = σ2 τ + (τ A)(τ A)′
Bias(γ̂RE ) = (Λ + kI)−1 (A − kγ)
D(γ̂RE ) = σ2 (Λ + kI)−2 Λ
M SEM (γ̂RE ) = (Λ + kI)−1 {σ2 Λ + ((A − kγ))((A − kγ))′ }(Λ + kI)−1
Bias(γ̂AU RE ) = (Λ + kI)−2 ((Λ + 2kI)A − k 2 γ)
D(γ̂AU RE ) = σ2 (Λ + kI)−4 (Λ + 2kI)2 Λ
M SEM (γ̂AU RE ) =(Λ + kI)−2 {σ2 (Λ + 2kI)2 Λ
+ ((Λ + 2kI)A − k 2 γ)((Λ + 2kI)A − k 2 γ)′ }(Λ + kI)−2

γ̂LE

Bias(γ̂LE ) = (Λ + I)−1 ((I + dτ )A − (1 − d)γ)
D(γ̂LE ) = σ2 (Λ + I)−2 (Λ + dI)2 τ
M SEM (γ̂LE ) =(Λ + I)−1 {σ2 (Λ + dI)2 τ
+ ((I + dτ )A − (1 − d)γ)((I + dτ )A − (1 − d)γ)′ }(Λ + I)−1

γ̂AU LE

Bias(γ̂AU LE ) = (Λ + I)−2 ((Λ + (2 − d)I)(I + dτ )A − (1 − d)2 γ)
D(γ̂AU LE ) = σ2 (Λ + I)−4 (Λ + dI)2 (Λ + (2 − d)I)2 τ
M SEM (γ̂AU LE ) =(Λ + I)−2 {σ2 (Λ + dI)2 (Λ + (2 − d)I)2 τ + ((Λ + (2 − d)I)(I + dτ )A
− (1 − d)2 γ)((Λ + (2 − d)I)(I + dτ )A − (1 − d)2 γ)′ }(Λ + I)−2

γ̂P CRE

γ̂rk

Bias(γ̂P CRE ) = (Th Th′ − I)γ + Th Th′ τ A
D(γ̂P CRE ) = σ2 Th Th′ τ Th′ Th
′

M SEM (γ̂P CRE ) = σ2 Th Th′ τ Th′ Th + (Th Th′ − I)γ + Th Th′ τ A (Th Th′ − I)γ + Th Th′ τ A
Bias(γ̂rk ) = (Th Th′ (Λ + kI)−1 Λ − I)γ + Th Th′ (Λ + kI)−1 A
D(γ̂rk ) = σ2 Th Th′ (Λ + kI)−2 ΛTh′ Th
M SEM (γ̂rk ) =σ2 Th Th′ (Λ + kI)−2 ΛTh′ Th + ((Th Th′ (Λ + kI)−1 Λ − I)γ
+ Th Th′ (Λ + kI)−1 A)((Th Th′ (Λ + kI)−1 Λ − I)γ + Th Th′ (Λ + kI)−1 A)′

γ̂rd

Bias(γ̂rd ) = (Th Th′ (Λ + I)−1 (Λ + dI) − I)γ + Th Th′ (Λ + I)−1 (I + dτ )A
D(γ̂rd ) = σ2 Th Th′ (Λ + I)−2 (Λ + dI)2 τ Th′ Th
M SEM (γ̂rd ) =σ2 Th Th′ (Λ + I)−2 (Λ + dI)2 τ Th′ Th + ((Th Th′ (Λ + I)−1 (Λ + dI) − I)γ + Th Th′ (Λ
+ I)−1 (I + dτ )A)((Th Th′ (Λ + I)−1 (Λ + dI) − I)γ + Th Th′ (Λ + I)−1 (I + dτ )A)′

Appendix C. Tables

15

Table C2. Bias vector, Dispersion matrix and MSEM of the stochastic restricted estimators
Estimators

Stochastic Properties

γ̂M RE

Bias(γ̂M RE ) = τ A
D(γ̂M RE ) = σ2 τ
M SEM (γ̂M RE ) = σ2 τ + (τ A)(τ A)′

γ̂SRRE

Bias(γ̂SRRE ) = (1 + k)−1 (τ A − kγ)
D(γ̂SRRE ) = (1 + k)−2 σ2 τ

M SEM (γ̂SRRE ) = (1 + k)−2 σ2 τ + (τ A − kγ)(τ A − kγ)′

γ̂SAU RRE

γ̂SRLE

γ̂SRAU LE

Bias(γ̂SRAU RE ) = (1 + k)−2 ((1 + 2k)τ A − k 2 γ)
D(γ̂SRAU RE ) = (1 + k)−4 (1 + 2k)2 σ2 τ

M SEM (γ̂SRAU RE ) = (1 + k)−4 (1 + 2k)2 σ2 τ + ((1 + 2k)τ A − k 2 γ)((1 + 2k)τ A − k 2 γ)′
Bias(γ̂SRLE ) = 2−1 ((1 + d)τ A − (1 − d)γ)
D(γ̂SRLE ) = 2−2 (1 + d)2 σ2 τ

M SEM (γ̂SRLE ) = 2−2 (1 + d)2 σ2 τ + ((1 + d)τ A − (1 − d)γ)((1 + d)τ A − (1 − d)γ)′
Bias(γ̂SRAU LE ) = 2−2 ((1 + d)(3 − d)τ A − (1 − d)2 γ)
D(γ̂SRAU LE ) = 2−4 (1 + d)2 (3 − d)2 σ2 τ
M SEM (γ̂SRAU LE ) =2−4 {(1 + d)2 (3 − d)2 σ2 τ
+ ((1 + d)(3 − d)τ A − (1 − d)2 γ)((1 + d)(3 − d)τ A − (1 − d)2 γ)′ }

γ̂SRP CRE

γ̂SRrk

γ̂SRrd

Bias(γ̂SRP CRE ) = (Th Th′ − I)γ + Th Th′ τ A
D(γ̂SRP CRE ) = σ2 Th Th′ τ Th′ Th
′

M SEM (γ̂SRP CRE ) = σ2 Th Th′ τ Th′ Th + (Th Th′ − I)γ + Th Th′ τ A (Th Th′ − I)γ + Th Th′ τ A
Bias(γ̂SRrk ) = (1 + k)−1 ((Th Th′ − (1 + k)I)γ + Th Th′ τ A)
D(γ̂SRrk ) = (1 + k)−2 σ2 Th Th′ τ Th′ Th
M SEM (γ̂SRrk ) =(1 + k)−2 {σ2 Th Th′ τ Th′ Th

′
+ (Th Th′ − (1 + k)I)γ + Th Th′ τ A (Th Th′ − (1 + k)I)γ + Th Th′ τ A }
Bias(γ̂SRrd ) = 2−1 (1 + d)((Th Th′ − 2(1 + d)−1 I)γ + Th Th′ τ A)
D(γ̂SRrd ) = 2−2 (1 + d)2 σ2 Th Th′ τ Th′ Th
M SEM (γ̂SRrd ) =2−2 (1 + d)2 {σ2 Th Th′ τ Th′ Th
′

+ (Th Th′ − 2(1 + d)−1 I)γ + Th Th′ τ A (Th Th′ − 2(1 + d)−1 I)γ + Th Th′ τ A }

Table C3. Estimated SMSE values of the biased estimators when n = 50 and ρ = 0.9
k/d

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

Under
correctly
specified
model

γ̂ OLSE
γ̂ RE
γ̂ AU RE
γ̂ LE
γ̂ AU LE
γ̂ P CRE
γ̂ rk
γ̂ rd
γ̂ SIOE

23.714
9.012
16.779
1.451
4.084
18.936
7.325
1.347
0.207

23.714
4.956
11.262
2.531
6.788
18.936
4.120
2.200
0.207

23.714
3.201
8.026
3.959
9.799
18.936
2.732
3.328
0.207

23.714
2.273
6.018
5.736
12.882
18.936
1.998
4.731
0.207

23.714
1.720
4.695
7.861
15.834
18.936
1.561
6.410
0.207

23.714
1.363
3.778
10.335
18.483
18.936
1.279
8.364
0.207

23.714
1.119
3.116
13.157
20.690
18.936
1.086
10.594
0.207

23.714
0.945
2.624
16.328
22.344
18.936
0.948
13.099
0.207

23.714
0.817
2.247
19.847
23.368
18.936
0.847
15.880
0.207

Under misspecified
model

γ̂ OLSE
γ̂ RE
γ̂ AU RE
γ̂ LE
γ̂ AU LE
γ̂ P CRE
γ̂ rk
γ̂ rd
γ̂ SIOE

12.335
5.118
9.131
0.890
2.484
8.557
3.668
0.799
0.127

12.335
2.965
6.361
1.465
3.864
8.557
2.209
1.189
0.127

12.335
1.997
4.679
2.214
5.385
8.557
1.552
1.697
0.127

12.335
1.467
3.616
3.137
6.933
8.557
1.192
2.323
0.127

12.335
1.140
2.906
4.234
8.410
8.557
0.969
3.067
0.127

12.335
0.920
2.406
5.506
9.732
8.557
0.820
3.929
0.127

12.335
0.764
2.041
6.952
10.831
8.557
0.714
4.909
0.127

12.335
0.648
1.763
8.572
11.654
8.557
0.635
6.007
0.127

12.335
0.560
1.547
10.366
12.163
8.557
0.575
7.223
0.127

16

Table C4. Estimated SMSE values of the biased estimators when n = 50 and ρ = 0.99
k/d

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

Under
correctly
specified
model

γ̂ OLSE
γ̂ RE
γ̂ AU RE
γ̂ LE
γ̂ AU LE
γ̂ P CRE
γ̂ rk
γ̂ rd
γ̂ SIOE

226.39
5.478
17.734
3.195
10.907
181.31
4.605
2.761
0.179

226.39
1.793
5.958
10.507
33.147
181.31
1.643
8.613
0.179

226.39
0.954
3.035
22.190
62.911
181.31
0.968
17.962
0.179

226.39
0.634
1.886
38.246
96.398
181.31
0.710
30.808
0.179

226.39
0.478
1.318
58.674
130.31
181.31
0.584
47.151
0.179

226.39
0.390
0.996
83.474
161.85
181.31
0.513
66.990
0.179

226.39
0.335
0.796
112.64
188.76
181.31
0.469
90.326
0.179

226.39
0.299
0.663
146.19
209.24
181.31
0.440
117.15
0.179

226.39
0.274
0.570
184.10
222.04
181.31
0.420
147.48
0.179

Under misspecified
model

γ̂ OLSE
γ̂ RE
γ̂ AU RE
γ̂ LE
γ̂ AU LE
γ̂ P CRE
γ̂ rk
γ̂ rd
γ̂ SIOE

113.54
3.303
9.806
1.776
5.902
75.658
2.418
1.385
0.108

113.54
1.319
3.602
5.466
17.048
75.658
1.085
3.843
0.108

113.54
0.835
2.062
11.337
31.931
75.658
0.759
7.750
0.108

113.54
0.627
1.450
19.391
48.659
75.658
0.618
13.105
0.108

113.54
0.510
1.141
29.627
65.591
75.658
0.539
19.909
0.108

113.54
0.433
0.960
42.045
81.338
75.658
0.487
28.161
0.108

113.54
0.377
0.841
56.646
94.764
75.658
0.449
37.863
0.108

113.54
0.333
0.757
73.428
104.98
75.658
0.419
49.012
0.108

113.54
0.298
0.693
92.393
111.37
75.658
0.395
61.611
0.108

Table C5. Estimated SMSE values of the biased estimators when n = 50 and ρ = 0.999
k/d

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

Under
correctly
specified
model

γ̂ OLSE
γ̂ RE
γ̂ AU RE
γ̂ LE
γ̂ AU LE
γ̂ P CRE
γ̂ rk
γ̂ rd
γ̂ SIOE

2253.5
0.964
3.176
23.418
83.976
1786.3
0.965
18.746
0.172

2253.5
0.393
0.980
91.567
295.85
1786.3
0.512
72.748
0.172

2253.5
0.280
0.558
204.62
590.22
1786.3
0.422
162.35
0.172

2253.5
0.237
0.407
362.60
926.79
1786.3
0.388
287.55
0.172

2253.5
0.215
0.336
565.48
1270.6
1786.3
0.371
448.35
0.172

2253.5
0.202
0.297
813.28
1592.2
1786.3
0.361
644.75
0.172

2253.5
0.194
0.272
1105.9
1867.5
1786.3
0.355
876.76
0.172

2253.5
0.188
0.256
1443.6
2077.5
1786.3
0.350
1144.3
0.172

2253.5
0.184
0.244
1826.1
2208.9
1786.3
0.347
1447.5
0.172

Under misspecified
model

γ̂ OLSE
γ̂ RE
γ̂ AU RE
γ̂ LE
γ̂ AU LE
γ̂ P CRE
γ̂ rk
γ̂ rd
γ̂ SIOE

1126.1
0.937
2.142
11.880
42.398
754.33
0.821
8.122
0.106

1126.1
0.590
0.997
45.956
148.26
754.33
0.589
30.920
0.106

1126.1
0.486
0.769
102.46
295.30
754.33
0.520
68.747
0.106

1126.1
0.424
0.681
181.39
463.41
754.33
0.479
121.60
0.106

1126.1
0.378
0.632
282.76
635.16
754.33
0.448
189.48
0.106

1126.1
0.340
0.598
406.56
795.79
754.33
0.423
272.40
0.106

1126.1
0.308
0.571
552.79
933.24
754.33
0.401
370.34
0.106

1126.1
0.280
0.548
721.45
1038.1
754.33
0.382
483.31
0.106

1126.1
0.256
0.526
912.54
1103.7
754.33
0.366
611.31
0.106

Table C6. Estimated SMSE values of the stochastic restricted estimators when n = 50 and ρ = 0.9
k/d

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

Under
correctly
specified
model

γ̂ M RE
γ̂ SRRE
γ̂ SRAU RE
γ̂ SRLE
γ̂ SRAU LE
γ̂ SRP CRE
γ̂ SRrk
γ̂ SRrd
γ̂ SROE

2.497
2.375
2.484
2.441
2.302
2.834
2.734
2.783
1.883

2.497
2.316
2.454
2.379
2.320
2.834
2.685
2.734
1.883

2.497
2.297
2.419
2.335
2.346
2.834
2.669
2.698
1.883

2.497
2.302
2.385
2.307
2.376
2.834
2.672
2.676
1.883

2.497
2.324
2.356
2.296
2.407
2.834
2.689
2.668
1.883

2.497
2.355
2.332
2.303
2.437
2.834
2.714
2.674
1.883

2.497
2.392
2.315
2.326
2.462
2.834
2.744
2.693
1.883

2.497
2.433
2.303
2.366
2.481
2.834
2.777
2.726
1.883

2.497
2.476
2.297
2.423
2.493
2.834
2.811
2.774
1.883

Under misspecified
model

γ̂ M RE
γ̂ SRRE
γ̂ SRAU RE
γ̂ LE
γ̂ SRAU LE
γ̂ SRP CRE
γ̂ SRrk
γ̂ SRrd
γ̂ SROE

1.349
1.164
1.331
0.833
0.992
1.438
1.313
1.088
0.751

1.349
1.040
1.288
0.841
1.050
1.438
1.230
1.094
0.751

1.349
0.959
1.236
0.861
1.109
1.438
1.174
1.108
0.751

1.349
0.905
1.181
0.893
1.165
1.438
1.138
1.130
0.751

1.349
0.870
1.128
0.938
1.217
1.438
1.114
1.161
0.751

1.349
0.849
1.080
0.995
1.262
1.438
1.100
1.199
0.751

1.349
0.838
1.036
1.065
1.299
1.438
1.092
1.247
0.751

1.349
0.833
0.999
1.147
1.327
1.438
1.088
1.302
0.751

1.349
0.834
0.966
1.242
1.344
1.438
1.088
1.366
0.751

17

Table C7. Estimated SMSE values of the stochastic restricted estimators when n = 50 and ρ = 0.99
k/d

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

Under
correctly
specified
model

γ̂ M RE
γ̂ SRRE
γ̂ SRAU RE
γ̂ SRLE
γ̂ SRAU LE
γ̂ SRP CRE
γ̂ SRrk
γ̂ SRrd
γ̂ SROE

1.891
1.853
1.885
2.318
1.893
2.504
2.476
2.848
1.800

1.891
1.870
1.873
2.195
1.867
2.504
2.490
2.750
1.800

1.891
1.918
1.861
2.091
1.855
2.504
2.529
2.667
1.800

1.891
1.984
1.854
2.005
1.853
2.504
2.582
2.599
1.800

1.891
2.060
1.854
1.939
1.858
2.504
2.642
2.545
1.800

1.891
2.140
1.860
1.891
1.866
2.504
2.707
2.507
1.800

1.891
2.222
1.872
1.863
1.876
2.504
2.772
2.484
1.800

1.891
2.303
1.890
1.853
1.883
2.504
2.837
2.476
1.800

1.891
2.383
1.912
1.862
1.889
2.504
2.900
2.483
1.800

Under misspecified
model

γ̂ M RE
γ̂ SRRE
γ̂ SRAU RE
γ̂ SRLE
γ̂ SRAU LE
γ̂ SRP CRE
γ̂ SRrk
γ̂ SRrd
γ̂ SROE

1.238
1.018
1.216
0.676
0.822
1.440
1.290
1.050
0.688

1.238
0.876
1.165
0.674
0.887
1.440
1.192
1.050
0.688

1.238
0.785
1.103
0.687
0.955
1.440
1.129
1.060
0.688

1.238
0.729
1.038
0.717
1.020
1.440
1.090
1.082
0.688

1.238
0.695
0.977
0.763
1.081
1.440
1.066
1.114
0.688

1.238
0.678
0.921
0.826
1.135
1.440
1.054
1.157
0.688

1.238
0.673
0.872
0.904
1.178
1.440
1.049
1.212
0.688

1.238
0.675
0.829
0.999
1.211
1.440
1.050
1.277
0.688

1.238
0.683
0.793
1.110
1.231
1.440
1.054
1.353
0.688

Table C8. Estimated SMSE values of the stochastic restricted estimators when n = 50 and ρ = 0.999
k/d

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

Under
correctly
specified
model

γ̂ M RE
γ̂ SRRE
γ̂ SRAU RE
γ̂ SRLE
γ̂ SRAU LE
γ̂ SRP CRE
γ̂ SRrk
γ̂ SRrd
γ̂ SROE

1.813
1.752
1.804
2.195
1.773
2.453
2.405
2.761
1.736

1.813
1.754
1.787
2.068
1.752
2.453
2.408
2.659
1.736

1.813
1.795
1.768
1.962
1.747
2.453
2.440
2.574
1.736

1.813
1.857
1.755
1.877
1.752
2.453
2.490
2.506
1.736

1.813
1.931
1.748
1.813
1.763
2.453
2.550
2.455
1.736

1.813
2.012
1.748
1.771
1.777
2.453
2.615
2.421
1.736

1.813
2.096
1.755
1.750
1.791
2.453
2.681
2.404
1.736

1.813
2.180
1.769
1.749
1.802
2.453
2.749
2.403
1.736

1.813
2.263
1.789
1.770
1.810
2.453
2.815
2.420
1.736

Under misspecified
model

γ̂ M RE
γ̂ SRRE
γ̂ SRAU RE
γ̂ SRLE
γ̂ SRAU LE
γ̂ SRP CRE
γ̂ SRrk
γ̂ SRrd
γ̂ SROE

1.209
0.991
1.186
0.661
0.797
1.419
1.273
1.049
0.679

1.209
0.850
1.136
0.656
0.861
1.419
1.179
1.046
0.679

1.209
0.761
1.074
0.667
0.928
1.419
1.119
1.055
0.679

1.209
0.706
1.010
0.695
0.992
1.419
1.082
1.074
0.679

1.209
0.675
0.950
0.740
1.053
1.419
1.060
1.104
0.679

1.209
0.660
0.894
0.801
1.106
1.419
1.049
1.145
0.679

1.209
0.655
0.846
0.878
1.150
1.419
1.046
1.198
0.679

1.209
0.659
0.804
0.972
1.182
1.419
1.048
1.261
0.679

1.209
0.669
0.769
1.082
1.202
1.419
1.054
1.334
0.679

Table C9. Total National Research
and Development Expendituresas a
Percent of Gross National Product by
Country: 1972-1986
Year

y

x1

x2

x3

x4

1972
1975
1979
1980
1981
1982
1983
1984
1985
1986

2.3
2.2
2.2
2.3
2.4
2.5
2.6
2.6
2.7
2.7

1.9
1.8
1.8
1.8
2.0
2.1
2.1
2.2
2.3
2.3

2.2
2.2
2.4
2.4
2.5
2.6
2.6
2.6
2.8
2.7

1.9
2.0
2.1
2.2
2.3
2.4
2.6
2.6
2.8
2.8

3.7
3.8
3.6
3.8
3.8
3.7
3.8
4.0
3.7
3.8

18

Table C10. Estimated SMSE values of the biased estimators
k/d

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

Under
correctly
specified
model

γ̂ OLSE
γ̂ RE
γ̂ AU RE
γ̂ LE
γ̂ AU LE
γ̂ P CRE
γ̂ rk
γ̂ rd
γ̂ SIOE

2.782
2.457
2.585
2.077
2.395
2.540
2.330
2.033
1.964

2.782
2.371
2.521
2.131
2.449
2.540
2.285
2.072
1.964

2.782
2.310
2.486
2.191
2.509
2.540
2.243
2.115
1.964

2.782
2.259
2.462
2.258
2.570
2.540
2.202
2.163
1.964

2.782
2.212
2.442
2.330
2.628
2.540
2.164
2.215
1.964

2.782
2.170
2.423
2.408
2.680
2.540
2.127
2.271
1.964

2.782
2.131
2.405
2.492
2.723
2.540
2.092
2.332
1.964

2.782
2.095
2.387
2.583
2.755
2.540
2.059
2.397
1.964

2.782
2.061
2.369
2.679
2.775
2.540
2.028
2.466
1.964

Under misspecified
model

γ̂ OLSE
γ̂ RE
γ̂ AU RE
γ̂ LE
γ̂ AU LE
γ̂ P CRE
γ̂ rk
γ̂ rd
γ̂ SIOE

2.769
2.421
2.575
2.014
2.343
2.709
2.407
1.977
1.880

2.769
2.323
2.492
2.072
2.404
2.709
2.300
2.032
1.880

2.769
2.255
2.448
2.136
2.471
2.709
2.227
2.094
1.880

2.769
2.200
2.418
2.207
2.538
2.709
2.169
2.163
1.880

2.769
2.152
2.393
2.285
2.601
2.709
2.118
2.238
1.880

2.769
2.108
2.372
2.368
2.658
2.709
2.073
2.319
1.880

2.769
2.067
2.351
2.459
2.705
2.709
2.032
2.407
1.880

2.769
2.030
2.331
2.555
2.740
2.709
1.995
2.501
1.880

2.769
1.995
2.312
2.659
2.761
2.709
1.960
2.602
1.880

Table C11. Estimated SMSE values of the stochastic restricted estimators
k/d

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

Under
correctly
specified
model

γ̂ M RE
γ̂ SRRE
γ̂ SRAU RE
γ̂ SRLE
γ̂ SRAU LE
γ̂ SRP CRE
γ̂ SRrk
γ̂ SRrd
γ̂ SROE

1.026
1.061
1.028
1.473
1.142
1.017
1.053
1.469
0.108

1.026
1.111
1.034
1.389
1.106
1.017
1.104
1.385
0.108

1.026
1.169
1.043
1.314
1.079
1.017
1.163
1.309
0.108

1.026
1.230
1.056
1.247
1.060
1.017
1.224
1.242
0.108

1.026
1.291
1.072
1.189
1.047
1.017
1.286
1.183
0.108

1.026
1.350
1.092
1.139
1.038
1.017
1.346
1.133
0.108

1.026
1.408
1.113
1.098
1.032
1.017
1.404
1.091
0.108

1.026
1.463
1.137
1.066
1.029
1.017
1.460
1.058
0.108

1.026
1.515
1.162
1.042
1.027
1.017
1.512
1.033
0.108

Under misspecified
model

γ̂ M RE
γ̂ SRRE
γ̂ SRAU RE
γ̂ SRLE
γ̂ SRAU LE
γ̂ SRP CRE
γ̂ SRrk
γ̂ SRrd
γ̂ SROE

0.536
0.598
0.541
1.105
0.710
2.489
2.497
2.549
0.016

0.536
0.669
0.552
1.009
0.662
2.489
2.505
2.540
0.016

0.536
0.745
0.569
0.921
0.625
2.489
2.513
2.531
0.016

0.536
0.820
0.590
0.841
0.597
2.489
2.521
2.523
0.016

0.536
0.893
0.615
0.770
0.576
2.489
2.528
2.515
0.016

0.536
0.964
0.643
0.707
0.560
2.489
2.535
2.509
0.016

0.536
1.030
0.672
0.652
0.549
2.489
2.542
2.503
0.016

0.536
1.093
0.704
0.605
0.542
2.489
2.548
2.497
0.016

0.536
1.153
0.737
0.567
0.538
2.489
2.554
2.493
0.016

19

