arXiv:1705.00058v2 [cs.NA] 29 Jan 2018

Simultaneous diagonalisation of the covariance and
complementary covariance matrices in quaternion
widely linear signal processing
Min Xianga,∗, Shirin Enshaeifarb, Alexander E. Stotta , Clive Cheong Tookb ,
Yili Xiac , Sithan Kannaa , Danilo P. Mandica
a Department

of Electrical and Electronic Engineering, Imperial College London, London
SW7 2BT, UK
b Department of Computer Science, the University of Surrey, Surrey GU2 7XH, UK
c School of Information Science and Engineering, Southeast University, Nanjing 210018,
China

Abstract
Recent developments in quaternion-valued widely linear processing have established that the exploitation of complete second-order statistics requires consideration of both the standard covariance and the three complementary covariance
matrices. Although such matrices have a tremendous amount of structure and
their decomposition is a powerful tool in a variety of applications, the noncommutative nature of the quaternion product has been prohibitive to the development of quaternion uncorrelating transforms. To this end, we introduce
novel techniques for a simultaneous decomposition of the covariance and complementary covariance matrices in the quaternion domain, whereby the quaternion version of the Takagi factorisation is explored to diagonalise symmetric
quaternion-valued matrices. This gives new insights into the quaternion uncorrelating transform (QUT) and forms a basis for the proposed quaternion approximate uncorrelating transform (QAUT) which simultaneously diagonalises
all four covariance matrices associated with improper quaternion signals. The
effectiveness of the proposed uncorrelating transforms is validated by simulations on both synthetic and real-world quaternion-valued signals.
∗ Corresponding

author
Email address: m.xiang13@ic.ac.uk (Min Xiang)

Preprint submitted to Elsevier

January 30, 2018

Keywords: Quaternion matrix diagonalisation, complementary covariance,
pseudo-covariance, widely linear processing, quaternion non-circularity,
improperness.

1. Introduction
Advances in sensing technology have enabled widespread recording from 3-D
and 4-D data sources, such as measurements from seismometers [1], ultrasonic
anemometers [2], and inertial body sensors [3]. It is convenient to express such
measurements as vectors in the R3 and R4 fields of reals, however, the real vector
algebra is not a division algebra and is therefore inadequate when modelling
orientation and rotation [4]. Quaternions have advantages in representing 3-D
and 4-D data, owing to their division algebra, a generic extension of the real and
complex algebras. Quaternions also naturally account for mutual information
between multiple data channels, provide a compact representation, and have
proven to offer a physically meaningful interpretation for real-world applications
in the fields of navigation, communication, and image processing [5, 6]. A recent
resurgence in research on quaternion signal processing spans the areas of filtering
[7], independent component analysis (ICA) [8, 9], neural networks [10, 11], and
Fourier transforms [12].
Diagonalisable matrices play a fundamental role in engineering applications,
whereby the related uncorrelating transforms greatly simplify the analysis of
complex problems, both in terms of enabling a solution and providing a methodological framework (e.g. performance bounds). Computational advantages associated with matrix diagonalisation include a reduction in the size of the parameter space from N2 to N, while the statistical advantages include the possibility
to match source properties (e.g. orthogonality) in blind source separation. In
addition, joint diagonalisation of matrices in some blind source separation applications has a close link with the canonical decomposition problem for tensors
[13, 14]. The real linear algebra is a mature area, however, covariance matrices
in widely linear signal processing [15] in the complex and quaternion division

2

algebras and their structures [16] have recently received significant attention
[17, 18, 19, 20, 21].
In the context of complex-valued signal processing, for a complex random
vector z, both its covariance, C = E{zzH }, and pseudo-covariance, P =
E{zzT }, matrices are necessary to capture complete second-order statistical
information [22]. To extract the statistical information embedded in the two
covariance matrices, simultaneous diagonalisation of C and P is a prerequisite, while their respective individual diagonalisations can be performed via the
eigendecomposition and the Takagi factorisation. Such decorrelations exist in
their general forms in mathematics [23]. De Lathauwer and De Moor [15] and
Eriksson and Koivunen [16] have given them a practical value through an important engineering contribution called the strong uncorrelating transform (SUT),
together with its extension, the generalised uncorrelating transform [24]. Our
own recent contributions include a computationally efficient approximate uncorrelating transform (AUT) [25], while to preserve the integrity of the original
bivariate sources in the decorrelation process, we have proposed the correlation
preserving transform [26]. These transforms have been used in performance
analysis of complex-valued adaptive filters [27, 28, 29, 30], blind separation of
non-circular complex-valued sources [31, 32], complex-valued subspace tracking
[33], and separation of signal and noise components in subbands of harmonic
signals [34].
Real- and complex-valued signal processing have benefited greatly from making sophisticated use of real- and complex-valued matrix algebras [35, 36]. However, quaternion-valued signal processing, which is advantageous for 3-D and
4-D data, has been hindered by the underdevelopment of quaternion-valued
matrix algebra [37], compared to the well-established real- and complex-valued
matrix algebras [23, 36]. This is due to the non-commutativity nature of quaternion multiplication and the enhanced degrees of freedom provided by quaternions. For example, a quaternion square matrix has right and left eigenvalues;
the right eigenvalues have been well studied, while the left eigenvalues are less
known and are not computationally well-posed [37, 38]. The recent theory of
3

quaternion matrix derivatives provides a systematic framework for the calculation of derivatives of quaternion matrix functions with respect to quaternion
matrix variables [39]. Advances in structural quaternion matrix decompositions include tools to diagonalise quaternion matrices [40, 41], while in the
context of quaternion widely linear processing, it was shown that for a quaternion random vector x, the diagonalisation of the Hermitian covariance matrix
Cx = E{xxH } can be performed straightforwardly using the quaternion eigendecomposition, whereas the diagonalisation of the complementary covariance
matrices (Cxı = E{xxıH }, Cx = E{xxH }, Cxκ = E{xxκH }) can be computed via the quaternion singular value decomposition (SVD) [42]. Furthermore, the quaternion uncorrelating transform (QUT), a quaternion analogue
of the SUT for complex data, was proposed in [43] to jointly diagonalise the
covariance matrix and one of the three complementary covariance matrices.
However, the simultaneous diagonalisation of all the four covariance matrices is
still an open problem. It is important to notice that the relationship between
the quaternion covariance matrices in the widely linear model is governed by
[21]
Px =

1
(Cxı + Cx + Cxκ − Cx )
2

(1)

which demonstrates that the diagonalisation of the pseudo-covariance matrix,
Px = E{xxT }, requires us to address the following issues:
• There is no closed-form solution1 to perform a simultaneous diagonalisation of the covariance matrix and the three complementary covariance
matrices.
• Given the dimensionality of the problem and numerous practical applications, a simple approximate diagonalising transform which would apply to
both the covariance and pseudo-covariance matrices would be beneficial.
In this paper, we therefore set out to propose solutions to these open problems,
and support the analysis with illustrative examples.
1 Iterative

solutions were proposed in the context of quaternion ICA [8].

4

The rest of this paper is organised as follows. Section 2 provides an overview
of quaternion algebra and statistics. Section 3 proposes novel techniques for the
diagonalisation of symmetric quaternion matrices and a simultaneous diagonalisation of two quaternion covariance matrices. Section 4 proposes an approximate simultaneous diagonalisation of the four quaternion covariance matrices.
Simulation results are given in Section 5, and Section 6 concludes the paper.
Throughout the paper, we use boldface capital letters to denote matrices, A,
boldface lowercase letters for vectors, a, and standard letters for scalar quantities, a. Superscripts (·)T , (·)∗ and (·)H denote the transpose, conjugate, and
Hermitian (i.e. transpose and conjugate), respectively, I the identity matrix,
and E {·} the statistical expectation operator.

2. Background
2.1. Quaternion algebra
The quaternion domain H is a 4-D vector space over the field of reals,
spanned by the basis {1, ı, , κ}, where ı = (1, 0, 0),  = (0, 1, 0) and κ = (0, 0, 1)
are three unit vectors in R3 . A quaternion vector2 This does not affect the
generality of our results. x ∈ HL×1 consists of a real (scalar) part R[·] and an
imaginary (vector) part I[·] which comprises ı−, −, and κ− imaginary components, so that
x =R[x] + I[x]
=R[x] + Iı [x]ı + I [x] + Iκ [x]κ

(2)

=xa + xb ı + xc  + xd κ
where R[x] = xa , Iı [x] = xb , I [x] = xc , Iκ [x] = xd are L × 1 real vectors, and
ı, , κ are orthogonal imaginary units with properties
ı = −ı = κ

κ = −κ = ı

κı = −ıκ = 

ı2 = 2 = κ2 = −1

2 Throughout

this paper, the quaternion vector is assumed to be zero-mean.

5

(3)

A quaternion variable x is called a pure quaternion if it satisfies R[x] = 0. The
modulus of a quaternion variable x ∈ H is defined as
|x| =

q
x2a + x2b + x2c + x2d

A quaternion variable x is called a unit quaternion if it satisfies |x| = 1. The
product of two quaternions x, y ∈ H are defined as
xy = R[x]R[y] − I[x] · I[y] + R[x]I[y] + R[y]I[x] + I[x] × I[y]
where “·” denotes the scalar product and “×” the vector product. Notice that
the presence of the vector product in the above expression causes the noncommutativity of the quaternion product, that is, xy 6= yx.
Another important notion in the quaternion domain is the so-called “quaternion involution” [44], which defines a self-inverse mapping analogous to the complex conjugate. The general involution of the quaternion vector x is defined as
xα = −αxα, and represents the rotation of the vector part of x by π about a
unit pure quaternion α. The special cases of involutions about the ı,  and κ
imaginary axes are given by [44]
xı = −ıxı = xa + xb ı − xc  − xd κ
x = −x = xa − xb ı + xc  − xd κ

(4)

xκ = −κxκ = xa − xb ı − xc  + xd κ
This set of involutions, together with the original quaternion, x, forms the most
frequently used basis for augmented quaternion statistics [21, 20]. While an
involution represents a rotation along a single imaginary axis, the quaternion
conjugate operator (·)∗ rotates the quaternion along all three imaginary axes,
and is given by
x∗ = R[x] − I[x] = xa − xb ı − xc  − xd κ

(5)

A useful algebraic operation which conjugates only one imaginary component

6

is given by
xı∗ = (xı )∗ = (x∗ )ı = xa − xb ı + xc  + xd κ
x∗ = (x )∗ = (x∗ ) = xa + xb ı − xc  + xd κ

(6)

xκ∗ = (xκ )∗ = (x∗ )κ = xa + xb ı + xc  − xd κ
Since the only difference between x and xα∗ , for α ∈ {ı, , κ}, is the sign of
the α-imaginary component, a quaternion vector x is called (·)α∗ invariant if
Iα [x] = 0. For example, if x has a vanishing ı-imaginary part, then xı∗ = x.
For rigour, the structure and general properties of quaternion matrices are given
in Appendix A.
2.2. Quaternion covariance matrices: Structural insights
The recent success of complex augmented statistics is largely due to the
simplicity and physical meaningfulness of the statistical descriptors in the form
of the standard covariance, Cx = E{xxH }, and the pseudo-covariance, Px =
E{xxT }. In particular, the pseudo-covariance enables us to account for the
improperness (channel power imbalance or correlation) of complex variables,
while the symmetry of Px implies that its decomposition can be computed
using the Takagi factorisation as Px = QΣQT , where Q is a complex unitary
matrix and Σ a real non-negative diagonal matrix [23]. However, the pseudocovariance of a quaternion random vector x = [x1 , x2 , . . . , xL ]T does not exhibit
symmetry, owing to the non-commutativity of the quaternion product, whereby
xm xn 6= xn xm (m 6= n), yield an asymmetric matrix


E{x1 x1 }

E{x1 x2 }

...

E{x1 xL }







E{x
x
}
E{x
x
}
.
.
.
E{x
x
}


2
1
2
2
2
L
T


Px= E{xx }=
..
..
..

..


.
.
.
.


E{xL x1 } E{xL x2 } . . . E{xL xL }

(7)

The quaternion involution basis in (4) is at the core of the recently proposed
widely linear processing [20, 45], which provides theoretical and practical performance gains over traditional strictly linear processing [46]. For example, the
7

widely linear minimum mean square error (MMSE) estimation of the quaternion
signal y in terms of the observation x is performed as
ŷ = E{y|x, xı , x , xκ }

(8)

which is analogous to the complex widely linear MMSE estimation [22], given
by
ŷ = E{y|x, x∗ }
Then, the involution basis for the quaternion widely linear processing provides
a useful description of quaternion second-order statistics, represented by the
standard covariance matrix and the ı−, −, and κ− complementary covariance
matrices, which are given by [21]




E{x1 xα∗
1 }

E{x1 xα∗
2 }

···

E{x1 xα∗
L }


 E{x xα∗ }
2 1

αH
α
Cx =E{xx }=
..


.

E{xL xα∗
1 }

E{x2 xα∗
2 }
..
.

···
..
.

E{xL xα∗
2 }

···



E{x2 xα∗
L }

..


.


(9)

E{xL xα∗
L }

where α ∈ {ı, , κ}. The α-complementary covariance matrix is α-Hermitian,
that is, Cxα = (Cxα )αH , which stems from the fact that its diagonal entries are
(·)α∗ invariant, whereas its off-diagonal entries are governed by the relationship
Cxα [m, n] = (Cxα [n, m])α∗ , where Cxα [m, n] denotes the entry of Cxα in row
m, column n. The relationship between the pseudo-covariance and the three
complementary covariances is given in (1).
Remark 1. The knowledge of both the standard covariance matrix and the three
complementary covariance matrices is necessary to ensure the exploitation of
complete second-order statistical information in the quaternion domain.
2.3. Quaternion properness
The notion of non-circularity (improperness) is unique to division algebras.
While non-circularity refers to probability distributions which are not rotationinvariant, a proper complex random vector z = zr + zı ı (zr , zı ∈ RL×1 ) has a

8

vanishing pseudo-covariance E{zzT } = 0. In other words, its real and imaginary parts are uncorrelated and have equal variance, that is, E{zr zTı } = 0
and E{zr zTr } = E{zı zTı }. Similarly, improperness in the quaternion domain
is characterised by the degree of correlation and/or power imbalance between
imaginary components relative to the real component. The additional degrees
of freedom in the quaternion domain allow for two types of properness: Hproperness and Cα -properness [47].
Definition 1 (H-properness). A quaternion random vector x is H-proper if it
is uncorrelated with its vector involutions, xı , x , and xκ , so that
Cx = E{xxH } = 0

Cxı = E{xxıH } = 0
Cxκ = E{xxκH } = 0

(10)

Definition 2 (Cα -properness). A quaternion random vector x is Cα -improper3
with respect to α = ı,  or κ if it is correlated only with the involution xα , so
that all the complementary covariances except for Cxα vanish.
As shown in Appendix B, a Cα -improper quaternion random vector can be
generated from two proper complex random vectors.

3. Diagonalisation of quaternion covariance matrices
Prior to introducing the diagonalisation of the quaternion pseudo-covariance
matrix and the simultaneous diagonalisation of two quaternion covariance matrices, the following two observations establish results essential for subsequent
analyses.
Observation 1. The eigendecomposition applied to the Herimitian quaternion
covariance matrix, Cx , gives Cx = QH Λx Q, where Q is a quaternion unitary matrix and Λx a real-valued diagonal matrix for which the entries are the
3 It

is called Cα -proper in some literature, but we consider the term Cα -improper is more

intuitive.

9

eigenvalues4 of Cx [48].
Observation 2. The α-complementary covariance matrix, Cxα , α ∈ {ı, , κ},
α
can be factorised as Cxα = QH
α Λα Qα , where Qα is a quaternion unitary matrix

and Λα is a real-valued non-negative diagonal matrix for which the diagonal
entries are the singular values of Cxα [42].
Observation 1 provides an algebraic tool to diagonalise the quaternion covariance matrix. Observation 2 enables the diagonalisation of quaternion complementary covariance matrices, and degenerates into the Takagi factorisation
of complex symmetric matrices if the quaternion vector x has two vanishing
imaginary parts [49].
3.1. Diagonalisation of symmetric matrices
The tools for the decomposition of quaternion pseudo-covariance matrices
are still in their infancy, because:
• The tools for the analysis of the symmetric matrices in C cannot be readily
generalised to H.
• It is required to simultaneously diagonalise all the three complementary
covariance matrices, a task with prohibitively many degrees of freedom.
We shall start our analysis with the diagonalisation of 2 × 2 symmetric quaternion matrices.
Proposition 1: A 2 × 2 symmetric quaternion matrix A admits the factorisation A = UΛUT if either its diagonal elements or off-diagonal elements are
real-valued, where U is a quaternion unitary matrix and Λ is a real diagonal
matrix with the singular values of A on the diagonal.
4 They

are both right and left eigenvalues, but are simply termed eigenvalues for conciseness

in this paper.

10

Proof. Based on the SVD of quaternion matrices [37], A = UΛVH , the matrix
products AA∗ and A∗ A can be expressed as
AA∗ = AAH = (UΛVH )(UΛVH )H = UΛ2 UH
A∗ A = AH A = (UΛVH )H (UΛVH ) = VΛ2 VH
The result in Appendix C shows that (AA∗ )∗ = A∗ A if either the diagonal or
off-diagonal elements of A are real-valued. It then follows that U∗ Λ2 (U∗ )H =
VΛ2 VH , where the commutativity of the product is valid because of the condition that the diagonal or off-diagonal elements of A are real-valued. Thus, we
can obtain V = U∗ , whereby the Takagi factorisation5 of quaternion symmetric
matrices is identical to that of complex symmetric matrices, A = UΛUT .
A consequence of Proposition 1 is that the Takagi factorisation of a quaternion symmetric matrix A is possible if (AA∗ )∗ = A∗ A holds. However, in
general, (AA∗ )∗ 6= A∗ A, indicating that such a Takagi factorisation does not
exist for general quaternion symmetric matrices.
3.2. Simultaneous diagonalisation of two covariance matrices
We next proceed to introduce a simultaneous diagonalisation of the covariance and complementary covariance matrices. The finding that a non-singular
transform is sufficient to diagonalise6 both Cx and Cxα will form a basis for
the quaternion uncorrelating transform [43]. First, we shall clarify that the unitary transform which can simultaneously diagonalise Cx and Cxα for a general
quaternion random vector x does not exist.
Proposition 2: If Cx Cxα 6= (Cx Cxα )αH , then there is no quaternion unitary
matrix U such that both UH Cx U and UH Cxα Uα are diagonal.
Proof. Define Λx = UH Cx U, Λα = UH Cxα Uα , where U is a quaternion
unitary matrix. It is then obvious that Λx is a Hermitian matrix, so that if Λx
5 The

Takagi factorisation is a special case of the complex/quaternion SVD when A = AT .
4.5.18 (c) in [23] is the corresponding result in the complex domain.

6 Corollary

11

is diagonal, then Λx is real diagonal. Furthermore, if Λα is also diagonal, we
can obtain
Cx Cxα = UΛxUHUΛαUαH =UΛαUαHUαΛxUαH = Cxα Cα
x

(11)

Because Cx is Hermitian and Cxα is α-Hermitian, we can readily obtain
αH αH
Cx α Cα
= (Cx Cxα )αH
x = Cx α Cx

(12)

Combining (11) and (12) yields Cx Cxα = (Cx Cxα )αH .
Although a unitary transform for the simultaneous diagonalisation of Cx
and Cxα is inapplicable, a non-unitary transform can be derived in a similar
manner to the SUT in the complex domain. On the basis of Observation 1, Cx
can be factorised as Cx = VΛx VH where V is a quaternion unitary matrix,
−1

and Λx is a real diagonal matrix. Define a whitening transform D = VΛx 2 VH ,
and denote s = Dx, to obtain the covariance matrix of s as
−1

−1

Cs = DCx DH = VΛx 2 VH VΛx VH VΛx 2 VH = I
Based on Observation 2, the α-complementary covariance matrix of s can be
factorised as Csα = WΛα WαH , where W is a quaternion unitary matrix, and
Λα is a real diagonal matrix. Now, the non-singular uncorrelating transform,
Q = WH D, and its application in the form y = Qx yield the simultaneous
diagonalisation
Cy = WH Cs W = WH IW = I
Cyα =WH Csα Wα = WHWΛα WαHWα = Λα
We refer to the transform Q as the quaternion uncorrelating transform (QUT),
which is summarised in Proposition 3 and Algorithm 1.
Proposition 3 (QUT): For a random quaternion vector x with finite secondorder statistics, there exists a quaternion non-singular matrix Q for which the
transformed vector y = Qx has the following covariance and α-complementary
covariance matrices:

12

Algorithm 1. Quaternion Uncorrelating Transform (QUT).
1. Compute the eigendecomposition of the covariance matrix
Cx = E{xxH } = VΛx VH .
−1

2. Compute the whitening matrix D = VΛx 2 VH .
3. Calculate the α-complementary covariance of the whitened data, s = Dx,
as Csα = E{ssαH }.
4. Compute the factorisation of the α-complementary covariance matrix,
Csα = WΛα WαH , where W is a quaternion unitary matrix and Λα
a real diagonal matrix.
5. The QUT matrix is then Q = WH D.

Cy = I

Cy α = Λ α ,

where

α ∈ {ı, , κ}.

Recall that for a Cα -improper vector x, only the α-complementary covariance is non-vanishing while the other two complementary covariances vanish.
Thus, the QUT of Cα -improper signals, for example, for the case α = κ, satisfies
Cy = I

Cy ı = Λ ı

Cy  = Λ 

Cy κ = Λ κ

where Λκ is a diagonal matrix and Λı = Λ = 0. In other words, for a Cα improper quaternion vector, the QUT can be regarded as the quaternion version of SUT [15, 16]. For a general improper quaternion vector, however, the
remaining two complementary covariance matrices are still not diagonalised by
the QUT. In fact, so far there is no closed-form solution to joint diagonalisation of four covariance matrices for general improper quaternion vectors. To
circumvent this problem, we shall next introduce an approximate way to simultaneously diagonalise all four covariance matrices, a practically useful tool in
most applications of quaternions, considering the effectiveness of the AUT in
complex-valued signal processing [28, 29, 30].

13

4. Simultaneous diagonalisation of all four covariance matrices
Following the approach in Section 3, we next propose the quaternion analogue of our proposed approximate uncorrelating transform (AUT) for complexvalued data [25]. This will enable the simultaneous diagonlistion of the covariance matrix and three complementary covariance matrices.
4.1. Univariate QAUT
T

Consider first the univariate quaternion random vector x = (x1 , . . . , xL ) .
Our aim is to find a unitary transform y = Φx which simultaneously diago
nalises the covariance matrix, Cy = E yyH = ΦCx ΦH , and the three com
plementary covariance matrices, Cyα = E yyαH = ΦCxα ΦαH , α ∈ {ı, , κ}.
H
H
H
Notice that if Cx CH
x = Cxα Cxα , we have Cy Cy = Cyα Cyα .

For N samples of x, N > L, the covariance matrix, and the α-complementary
covariance matrix can be estimated as
N

Cx =

1X
x (n1 ) xH (n1 )
N n =1

(13)

1

N

Cx α =

1X
x (n1 ) xαH (n1 )
N n =1
1

H
Their quadratic forms Cx CH
x and Cxα Cxα are calculated as

Cx CH
x
#" N
#
" N
1 X
1 X
x (n1 ) xH (n1 )
x (n2 ) xH (n2 )
=
N n =1
N n =1
1
2
#
"
L
N
N
X ∗
1 X X
= 2
xl (n1 ) xl (n2 ) xH (n2 )
x (n1 )
N n =1n =1
l=1
1

2

Cxα CH
xα
#" N
#
" N
1X α
1X
αH
H
x (n1 ) x (n1 )
x (n2 ) x (n2 )
=
Nn =1
Nn =1
1
2
#α
" L
N
N
X ∗
1 X X
= 2
xl (n1 ) xl (n2 ) xH (n2 )
x (n1 )
N n =1n =1
l=1
1

2

14

(14)

Upon applying the approximation
L
X

x∗l

"

(n1 ) xl (n2 )≈

l=1

L
X

x∗l

#α

(n1 ) xl (n2 )

l=1

(15)

H
H
H
we obtain Cx CH
x ≈ Cxα Cxα , and hence Cy Cy ≈ Cyα Cyα , which implies that

if Cy is diagonal, so too is Cyα , and vice versa. Furthermore, if
L
X

x∗l (n1 )xl (n2 ) ∈ R

(16)

l=1

holds approximately, then (15) holds for all α ∈ {ı, , κ}, and thus the simultaneous diagonalisation applies to all of the three complementary covariance
matrices, producing the following quaternion approximate uncorrelating transform (QAUT).
Proposition 4 (QAUT): If any of Cx , Cxı , Cx and Cxκ is diagonalised by
the unitary matrix Φ, the structural similarity between the four covariance matrices, displayed in (15), makes possible the approximate diagonalisation of the
other three covariance matrices by Φ. From (1), the pseudo-covariance matrix
is also approximately diagonalised in this way.
The transformation matrix Φ can take the form of Q in Observation 1 or
Qα in Observation 2. For example, the implementation of the transform Q,
obtained from the eigendecomposition of Cx , yields
Cx = Q H Λ x Q
Cx ı ≈ Q H Λ ı Q ı

(17)

Cx  ≈ Q H Λ  Q 
Cx κ ≈ Q H Λ κ Q κ
4.2. Principle of QAUT
The QAUT is based on the approximation in (16). To examine the validity of
this approximation for highly improper quaternion signals, assume that the four
components of the quaternion variable xl are perfectly correlated and consider
the Cayley-Dickson construction [50]
xl = xa + xb ı + xc  + xd κ = c1 + c2 
15

where c1 = xa + xb ı and c2 = xc + xd ı are complex variables defined in the plane
spanned by {1, ı}. This gives
x∗l (n1 ) xl (n2 ) = c∗1 (n1 ) c1 (n2 ) + c2 (n1 ) c∗2 (n2 ) +

(18)

[c∗1 (n1 ) c2 (n2 ) − c2 (n1 ) c∗1 (n2 )] 
Upon applying the statistical expectation operator, we have
E {x∗l (n1 ) xl (n2 )} =

E {c∗1 (n1 ) c1 (n2 )} + E {c2 (n1 ) c∗2 (n2 )}

(19)

+E {c∗1 (n1 ) c2 (n2 ) − c2 (n1 ) c∗1 (n2 )} 
where
E{c∗1 (n1 ) c1 (n2 )} =E{xa (n1 ) xa (n2 ) + xb (n1 ) xb (n2 )}+
E{xa (n1 ) xb (n2 ) − xa (n2 ) xb (n1 )}ı
≈E{xa (n1 ) xa (n2 ) + xb (n1 ) xb (n2 )}+
E{xb (n1 ) xb (n2 ) − xb (n2 ) xb (n1 )}ı
=E{xa (n1 ) xa (n2 ) + xb (n1 ) xb (n2 )}
∈R

(20)

and likewise for E{c2 (n1 ) c∗2 (n2 )} ∈ R. Moreover, if c1 and c2 are highly correlated, they can be expressed as c2 (t) ≈ kc1 (t) + g, where k and g are complexvalued constants, to give
E {c∗1 (n1 ) c2 (n2 ) − c2 (n1 ) c∗1 (n2 )}
≈ E {c∗1 (n1 ) [kc1 (n2 ) + g] − [kc1 (n1 ) + g] c∗1 (n2 )}
= 2kE {I [c∗1 (n1 ) c1 (n2 )]} + E{g}E {c∗1 (n1 )}
− E{g}E {c∗1 (n2 )}
≈0

(21)

Therefore, we obtain approximately
E {x∗l (n1 ) xl (n2 )} ∈ R
and the approximation (16) holds given the assumption
L

E {x∗l (n1 ) xl (n2 )} ≈

1X ∗
xl (n1 )xl (n2 )
L
l=1

16

(22)

From the above analysis, the QAUT holds exactly when the four components of the quaternion variable are perfectly correlated (a maximally improper
x). For general quaternion signals, however, these components are not perfectly correlated, causing the approximation error impacted by the correlation
coefficients, given by
cov[xa , xb ]
cov[xa , xc ]
cov[xa , xd ]
, ρac =
,
, ρad =
σxa σxb
σxa σxc
σxa σxd
cov[xb , xc ]
cov[xc , xd ]
cov[xb , xd ]
=
, ρcd =
, ρbd =
σxb σxc
σxb σxd
σxc σxd

ρab =
ρbc

with the range [−1, 1], where ‘cov’ denotes the covariance and σ the standard
deviation. From the diagonalisation condition in (15), the diagonalisation error
of Cxα arises from and is positively correlated with
x∗l (n1 ) xl (n2 ) − [x∗l (n1 ) xl (n2 )]

α

= 2Iβ [x∗l (n1 ) xl (n2 )] β + 2Iγ [x∗l (n1 ) xl (n2 )] γ

(23)

for distinct α, β, γ ∈ {ı, , κ}
Note that the imaginary part of x∗l (n1 ) xl (n2 ) is given by
I [x∗l (n1 ) xl (n2 )]
=[xa (n1 ) xb (n2 ) − xa (n2 ) xb (n1 ) + xc (n2 ) xd (n1 ) − xc (n1 ) xd (n2 )] ı
+ [xa (n1 ) xc (n2 ) − xa (n2 ) xc (n1 ) + xb (n1 ) xd (n2 ) − xb (n2 ) xd (n1 )] 
+ [xa (n1 ) xd (n2 ) − xa (n2 ) xd (n1 ) + xb (n2 ) xc (n1 ) − xb (n1 ) xc (n2 )] κ
(24)
Similarly to the AUT for complex-valued data [25], equation (24) can be rewritten as
  p

 p
p
p
I[x∗l (n1 ) xl (n2 )] = ξab 1 − ρ2ab + ξcd 1 − ρ2cd ı+ ξac 1 − ρ2ac + ξbd 1 − ρ2bd 

 p
p
+ ξad 1 − ρ2ad + ξbc 1 − ρ2bc κ
(25)

where ξab , ξcd , ξac , ξbd , ξad , ξbc are real-valued coefficients dependent on the statistics of xl .
It is now obvious that when the components of quaternion data become
more correlated, (25) decreases and the diagonalisation error hence decreases.
17

Owing to the cumulative nature of the error in (16), the approximation error
also increases with the data segment length L.
4.3. Multivariate QAUT
We next extend the univariate QAUT to the multivariate case when an M iT
h
,
variate quaternion signal is represented by a data matrix X = x1 , . . . , xM
h
iT
where the m-th column random vector xm = xm (1), . . . , xm (N )
(N >

M ≥ m) represents N samples of the m-th variate. The covariance and αcovariance matrices of the M variates are then given by CX =
CXα =

1
αH
}.
N E{XX

1
H
N E{XX }

and

Our aim is to find a unitary transform
Y = ΦX

(26)

which simultaneously diagonalises the covariance matrix, CY = E{YYH } =
ΦCX ΦH , and the three complementary covariance matrices, CYα = E{YYαH } =
H
H
ΦCXα ΦαH , α ∈ {ı, , κ}. Notice that if CX CH
X = CXα CXα , then CY CY =

CY α CH
Yα .
The covariance and α-complementary covariance matrices can be estimated
from X as
CX =

1
XXH
N

(27)

CXα =

1
XXαH
N

(28)

H
Their quadratic forms CX CH
X and CXα CXα are calculated as

CX CH
X =
CXα CH
Xα =

M
P
1
x∗m xTm )XH
N 2 X(
m=1
M
P
1
αH α H
X X = N12 X(
x∗m xTm )α XH
N 2 XX
m=1
1
H
H
N 2 XX XX

=

Following the analysis in (18)-(21), we can prove that the [n1 , n2 ] element of the
matrix E{x∗m xTm }, E{x∗m (n1 )xm (n2 )}, is real-valued, for all n1 , n2 ∈ {1, . . . , N },
whereby E{x∗m xTm } ∈ RN ×N and
M
X
x∗m xTm ∈ RN ×N

m=1

18

H
H
H
Under this condition, we obtain Cx CH
x ≈ Cxα Cxα , so that CY CY ≈ CY α CY α ,

which implies if CY is diagonal, so too is CYα , and vice versa. This means that
the four covariance matrices of multivariate quaternion data can be simultaneously diagonalised via the QAUT, such as in (17).
Similarly to the univariate case, the diagonalisation error of the multivariate
QAUT decreases with an increase in the correlation between the components of
quaternion data, and increases with the number of variates, M .
Remark 2. The QAUT becomes exact for quaternion signals with special secondorder statistical properties, such as H-proper signals, the signals with fully correlated components, and the signals for which the covariance and complementary
covariance matrices have the same singular vectors. This can be verified by
exploring the underlying matrix structures.

5. Simulation studies
The effectiveness of the proposed QUT and QAUT techniques is illustrated
via simulations on both synthetic and real-world quaternion signals. In the
experiments, the covariance and complementary covariance matrices were estimated based on (13), (14), (27) and (28).
5.1. Performance of QUT for Cη -improper signals
In the first experiment, the QUT was applied to the decorrelation of multivariate Cκ -improper quaternion signals. First, three uncorrelated Cκ -improper
quaternion signals were generated through the approach introduced in Appendix
B and were subsequently mixed through a 3 × 3 matrix for which the elements
were drawn from a standard normal distribution. The mixed Cκ -improper signals, x1 , x2 and x3 , were correlated in terms of the κ-complementary covariance,
with the correlation coefficients 0.69 (between x1 and x2 ), 0.34 (between x1 and
x3 ), and 0.91 (between x2 and x3 ). Fig. 1 shows 3-D scatter plots of the mixed
signals, x1 , x2 and x3 , illustrating their high correlation, as indicated by elliptical shapes of the scatter plots at an angle to the coordinate axes. The QUT

19

was used to decorrelate x1 , x2 and x3 into y1 , y2 and y3 , as illustrated in Fig.
2, which shows much more circular nature of y1 , y2 and y3 , as desired.
5.2. Performance of QAUT for synthetic improper signals
To assess the performance of QAUT, the squared diagonal error of the complementary covariance matrix Cxα was measured by an average power ratio
of the off-diagonal, λα,ij , versus diagonal, λα,ii , elements of the approximately
diagonal matrix Λα , given by

ε2α =

L
P

|λα,ij |

2

i,j=1

(N − 1)

L
P

i=1

× 100%,

i 6= j

λ2α,ii

Synthetic quaternion signals with a varying degree of correlation between
the real, ı,  and κ components were considered. For simplicity, we assumed
the six correlation coefficients of the four components to be equally distributed
in (0, 1] and denoted by ρ, where ρ = 1 indicates full correlation and ρ = 0 no
correlation.
In the univariate simulations, a synthetic quaternion data vector with a
varying ρ was generated from a quaternion white Gaussian signal. Then, the
performance of the univariate QAUT was assessed comprehensively against the
degree of correlation present in the data components, ρ ∈ [0.5, 1], and the length
of data segment, L ∈ [5, 20]. Conforming with the analysis, Fig. 3 shows that
the diagonalisation error increased as ρ or L increased. The performance was
excellent, for example, for a moderate correlation degree, ρ = 0.5, and a long
data segment, L = 20, where the squared diagonalisation error was less than
1%, while for a high correlation degree, ρ is close to unit, where the error was
negligible.
In the multivariate simulations, multiple channels of quaternion signals with
a varying ρ were generated and then mixed using a matrix the elements of
which were drawn from a standard normal distribution, to generate multivariate
quaternion data. The performance of the multivariate QAUT was assessed

20

against the degree of correlation present in the data components, ρ ∈ [0.5, 1],
and the number of variates, M ∈ [5, 20]. Fig. 4 shows that the diagonalisation
error increased as ρ or M increased. Similarly to the univariate case, for a
moderate correlation degree, ρ = 0.5, and a large number of data variates,
M = 20, the squared diagonalisation error was less than 1%, while for a high
correlation degree, ρ is close to unit, the error was negligible.
5.3. Performance of QAUT for real-world signals
The QAUT was also applied to 4-D real-world electroencephalogram (EEG)
signals by combining four adjacent channels of real-valued EEG signals into
a quaternion-valued signal. The four channels measuring adjacent brain regions exhibited strong correlation with each other while the channels measuring
distant brain regions were relatively weakly correlated [51, 52]. We tested the
QAUT on such quaternion EEG signals with low, medium and high correlations
between the four dimensions, with the data segment length L varying between
5 and 20. Fig. 5 illustrates that the diagonalisation error increased with either
an increase in L or a decrease in the degree of correlation present in the data.
The squared diagonal error was less than 0.2%.
5.4. QAUT for rank reduction
In many practical applications the acquired data are highly correlated or
even collinear, with redundant elements that do not contribute to the accuracy of processing but require excessive computational resources and may affect
stability of algorithms through the associated singular correlation matrices. It
is therefore desirable to use the minimum number of variables to describe the
information within a data set; this is typically achieved through a low-rank matrix approximation. For data requiring rank reduction, the assumption that the
components of variables are highly correlated is sensible, that is, the approximation conditions for the QAUT hold. The multivariate QAUT in (26) can be
therefore rearranged to decompose the data matrix X into a sum of uncorrelated

21

rank one vector outer products
X = ΦH Y =

M
X

φH
m ym

m=1

where φm and ym are rows in the matrices Φ and Y, respectively, and the
transformed variables, ym , are monotonically non-increasing in the variance.
The use of variables for which the variance is above a defined threshold and
the disposal of the remaining variables, which account for noise, provides the
reduced rank approximation of X in the form
X̂ =

P
X

φH
m ym ,

where P < M

m=1

which is illustrated in Fig. 6. This is analogous to the real domain where the
SVD provides a change of coordinates to yield uncorrelated variables for which
the variance is monotonically non-increasing.
To illustrate the potential of the QAUT in rank reduction of quaternion
data, a 2-D quaternion process, x1 , x2 , was generated where x1 and x2 were
highly correlated as shown in Fig. 7, which plots the component relationship
in the real, ı,  and κ planes. The QAUT decorrelated x1 , x2 into y1 and y2 .
Fig. 8 shows significant variation only in the y2 axis while the y1 variation
corresponds to noise, indicating that the true dimensionality of the process is
one rather than two.
Rank reduction is commonly used in chemometrics where many sets of measurements are required to examine a process and the important information may
not be directly observable. For example, Near Infrared Spectra (NIR) are used
to examine the chemical content of a data sample and are often highly correlated or collinear. We applied the QAUT to the NIR obtained from 80 samples
of corn using three different spectrometers [53]. A pure quaternion variable was
formed for each corn sample by combining its spectra from the three spectrometers. The QAUT diagonalised the data covariance matrices successfully to show
that one quaternion variable was sufficient to express most of the information,
as the largest diagonal element was 39 compared to 0.01 for the next largest, as
22

shown in Fig. 9, which displays the logarithm of the ratio of variance explained
by each variable, compared to the total variance in the data. The insert plot
in Fig. 9 shows the cumulative ratio of variance explained by including further
variables for the original and transformed data. Observe that the transformed
data with much fewer variables explain the same information as the original,
thus verifying the QAUT.
5.5. QAUT for imbalance detection in three-phase power systems
As shown in Section 4, when the components of data are highly correlated,
the QAUT diagonalises all complementary covariance matrices at the expense of
a small error, however, this error increases for lower degrees of correlation. We
now show a way to exploit this data dependence of the QAUT and the structure
of the complementary covariance matrices to detect imbalance in a three-phase
power system.
In general, the instantaneous voltages of a three-phase power system are
given by [54]
v1 (n)

= A1 sin(2πf ∆T n + ϕ1 )

v2 (n)

= A2 sin(2πf ∆T n + ϕ2 )

v3 (n)

= A3 sin(2πf ∆T n + ϕ3 )

(29)

where A1 , A2 , A3 are the instantaneous amplitudes, ϕ1 , ϕ2 , ϕ3 the instantaneous
phases, f the system frequency, and ∆T the sampling interval. In a balanced
three-phase system, A1 = A2 = A3 , ϕ2 − ϕ1 =

2π
3 ,

ϕ3 − ϕ2 =

2π
3 ,

and the

correlation between each component is equivalent [55]. The power grid is usually
designed to operate optimally under balanced conditions; however, faults in
the power system can cause imbalanced operating conditions that propagate
through the network, threatening its stability. Therefore, it is important in
fault detection and mitigation applications to identify the incidences when the
power grid is operating in an unbalanced fashion [56].
Pure quaternions have been used to deal with data recordings from all three
phases simultaneously as x(n) = v1 (n)ı + v2 (n) + v3 (n)κ [54]. Here we organise

23

the recorded data into a pure quaternion vector, x = v1 ı + v2  + v3 κ, where
vm = [vm (1), vm (2), . . . , vm (n)]T , m = 1, 2, 3. We can then apply the univariate QAUT to x and employ the diagonalisation errors of the complementary
covariance matrices as an indicator of power imbalance. This can be explained
by the overall diagonalisation error given by
I [x∗l (n1 ) xl (n2 )]=[v2 (n2 ) v3 (n1 )−v2 (n1 ) v3 (n2 )] ı
+[v1 (n1 ) v3 (n2 )−v1 (n2 ) v3 (n1 )]

(30)

+[v1 (n2 ) v2 (n1 )−v1 (n1 ) v2 (n2 )]κ
which is a reduced form of (24) and is positively correlated with the diagonalisation error. When the system is balanced, the covariances E{vp vqT } are equivalent for all phases p, q ∈ {1, 2, 3}, so the three imaginary parts of x∗l (n1 ) xl (n2 )
in (30) are equal in absolute value, leading to equal diagonalisation errors of the
three complementary covariance matrices. On the other hand, when the system
becomes unbalanced, the correlation degrees between the three phase voltages
are different, and hence the three imaginary parts of x∗l (n1 ) xl (n2 ) differ, resulting in different diagonalisation errors of the three complementary covariance
matrices. This allows the QAUT to be used in an imbalance detection application. To this end, we applied the QAUT to a sliding window of 0.04 seconds of
a three-phase power system for which a fault occurred at 0.25s lasting for 0.25s
before the system returned to a balanced state. During this fault, v1 decreased
significantly in amplitude whereas v2 and v3 increased in amplitude (v2 > v3 ).
Fig. 10 shows that the diagonalisation error for Cx and Cxκ increased while
the error for Cxı decreased and therefore analysing the difference between the
errors is an appropriate detection method for the power imbalance. This can
be explained via (30) and (23). The decrease in the amplitude of v1 and the
increase in the amplitudes of v2 and v3 induced an increased ı-imaginary part
and decreased -imaginary and κ-imaginary parts of x∗l (n1 ) xl (n2 ), so that the
diagonalisation error of Cxı declined and the diagonalisation errors of Cx and
Cxκ rose.

24

6. Conclusion
Novel simultaneous matrix factorisation techniques for the covariance and
complementary covariance matrices, which arise in widely linear quaternion algebra, have been introduced. The diagonalisation of quaternion symmetric matrices has been first addressed, as the Takagi factorisation of complex symmetric
matrices cannot be readily extended to the quaternion domain. We have shown
that the symmetry is insufficient for a quaternion matrix A to be diagonalisable,
and instead the condition (AA∗ )∗ = A∗ A must also hold, which in general is
not the case. The simultaneous diagonalisation of two quaternion covariance
matrices, quaternion uncorrelating transform (QUT), has then been introduced
as an analogue to the strong uncorrelating transform (SUT) in the complex domain. It has also been shown that for improper quaternion data, a typical case
in quaternion signal processing applications, a single eigendecomposition of the
covariance matrix is sufficient to diagonalise approximately the three complementary matrices. The analysis of the so introduced quaternion approximate
uncorrelating transform (QAUT) has demonstrated its usefulness for improper
quaternion signals, a typical case in practical applications. Simulation studies on synthetic and real-world signals support the proposed QUT and QAUT
techniques.

Appendix A. Properties of quaternion matrices
For two general quaternion matrices, A and B, the following properties hold
[42]:
P1. AT ∗ = (A∗ )T = (AT )∗ and Aα∗ = (A∗ )α = (Aα )∗ ,
P2. AαT = (Aα )T = (AT )α and AαH = (Aα )H = (AH )α ,
P3. (Aα )β = (Aβ )α = Aγ

for distinct α, β, γ ∈ {ı, , κ},

P4. (AB)∗ 6= A∗ B∗ ,
P5. (AB)T 6= BT AT ,
P6. (AB)H = BH AH ,
25

P7. (AB)α = Aα Bα ,
P8. (AB)αH = BαH AαH .

Appendix B. Cα -improper quaternion random vectors
For distinct α, β ∈ {ı, , κ}, the Cayley-Dickson construction allows for the
complex representation of a quaternion random vector x, as
x = z1 + z2 β
where z1 and z2 are complex random vectors defined in the plane spanned by
{1, α}. The quaternion random vector x is Cα -improper if and only if both of
the following two conditions are fulfilled [47]:
1) z1 and z2 are proper complex vectors, which is achieved when their real
and imaginary parts are uncorrelated and with the same variance,
2) z1 and z2 have different variances.

Appendix C. Symmetric quaternion matrices
Consider a 2 × 2 symmetric quaternion matrix A, whereby




a11

a12

a21

a22



a11 a∗11 + a12 a∗21

a11 a∗12 + a12 a∗22

a21 a∗11 + a22 a∗21

a21 a∗12 + a22 a∗22



a∗11

a∗12

a∗21

a∗22



a∗11 a11 + a∗12 a21

a∗11 a12 + a∗12 a22

a∗21 a11 + a∗22 a21

a∗21 a12 + a∗22 a22

AA∗ = 

=
A∗ A = 

=







a∗11

a∗12

a∗21

a∗22

a11

a12

a21

a22

26












By considering the symmetry A = AT (a12 = a21 ), the matrices (AA∗ )∗ and
A∗ A can be structured as


|a11 |2 + |a12 |2

(AA∗ )∗ = 
a11 a∗12 + a12 a∗22

|a11 |2 + |a12 |2
A∗ A = 
a∗12 a11 + a∗22 a12

a12 a∗11 + a22 a∗12
|a12 |2 + |a22 |2
a∗11 a12 + a∗12 a22
|a12 |2 + |a22 |2







Note that (AA∗ )∗ = A∗ A if their off-diagonal elements are commutative, implying that either the diagonal or off-diagonal elements of A are real-valued.

References
References
[1] L. Krieger, F. Grigoli, Optimal reorientation of geophysical sensors: A
quaternion-based analytical solution, Geophysics 80 (2) (2015) F19–F30.
[2] C. Cheong Took, G. Strbac, K. Aihara, D. P. Mandic, Quaternion-valued
short-term joint forecasting of three-dimensional wind and atmospheric parameters, Renewable Energy 36 (6) (2011) 1754–1760.
[3] H. Fourati, N. Manamanni, L. Afilal, Y. Handrich, Complementary observer for body segments motion capturing by inertial and magnetic sensors, IEEE/ASME Transactions on Mechatronics 19 (1) (2014) 149–157.
doi:10.1109/TMECH.2012.2225151.
[4] J. B. Kuipers, Quaternions and Rotation Sequences: A Primer with Applications to Orbits, Aerospace and Virtual Reality, Princeton University
Press, 2002.
[5] J. Tao, W. Chang, Adaptive beamforming based on complex quaternion
processes, Mathematical Problems in Engineering 2014.

27

[6] B. Chen, Q. Liu, X. Sun, X. Li, H. Shu, Removing Gaussian noise for
color images by quaternion representation and optimisation of weights in
non-local means filter, IET Image Processing 8 (10) (2014) 591–600.
[7] C. Cheong Took, D. P. Mandic, The quaternion LMS algorithm for adaptive
filtering of hypercomplex processes, IEEE Transactions on Signal Processing 57 (4) (2009) 1316–1327. doi:10.1109/TSP.2008.2010600.
[8] J. Vı́a, D. Palomar, L. Vielva, I. Santamarı́a, Quaternion ICA from secondorder statistics, IEEE Transactions on Signal Processing 59 (4) (2011)
1586–1600. doi:10.1109/TSP.2010.2101065.
[9] S. Javidi, C. Took, D. P. Mandic, Fast independent component analysis
algorithm for quaternion valued signals, IEEE Transactions on Neural Networks 22 (12) (2011) 1967–1978. doi:10.1109/TNN.2011.2171362.
[10] Y. Xia, C. Jahanchahi, D. P. Mandic, Quaternion-valued echo state networks, IEEE Transactions on Neural Networks and Learning Systems 26 (4)
(2015) 663–673.
[11] T. Minemoto, T. Isokawa, H. Nishimura, N. Matsui, Feedforward neural
network with random quaternionic neurons, Signal Processing 136 (2017)
59–68.
[12] T. A. Ell, N. Le Bihan, S. J. Sangwine, Quaternion Fourier Transforms for
Signal and Image Processing, John Wiley & Sons, 2014.
[13] L. De Lathauwer, A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization, SIAM Journal on
Matrix Analysis and Applications 28 (3) (2006) 642–666.
[14] A. Cichocki, D. P. Mandic, G. Zhou, Q. Zhao, C. Caiafa, H. Phan,
L. De Lathauwer, Tensor decompositions for signal processing applications:
From two-way to multiway component analysis, IEEE Signal Processing
Magazine 32 (2) (2015) 145–163.

28

[15] L. De Lathauwer, B. De Moor, On the blind separation of non-circular
sources, in: Proceedings of European Signal Processing Conference, 2002,
pp. 1–4.
[16] J. Eriksson, V. Koivunen, Complex random vectors and ICA models: Identifiability, uniqueness, and separability, IEEE Transactions on Information
Theory 52 (3) (2006) 1017–1029. doi:10.1109/TIT.2005.864440.
[17] P. J. Schreier, L. L. Scharf, Statistical Signal Processing of Complex-Valued
Data: The Theory of Improper and Noncircular Signals, Cambridge University Press, 2010.
[18] T. Adalı, S. Haykin, Adaptive Signal Processing: Next Generation Solutions, Wiley-IEEE Press, 2010.
[19] A. Yeredor, Performance analysis of the strong uncorrelating transformation in blind separation of complex-valued sources, IEEE Transactions on
Signal Processing 60 (1) (2012) 478–483.
[20] J. Vı́a, D. Ramı́rez, I. Santamarı́a, Properness and widely linear processing
of quaternion random vectors, IEEE Transactions on Information Theory
56 (7) (2010) 3502–3515.
[21] C. Cheong Took, D. P. Mandic, Augmented second-order statistics of
quaternion random signals, Signal Processing 91 (2) (2011) 214–224.
[22] D. P. Mandic, V. S. L. Goh, Complex Valued Nonlinear Adaptive Filters:
Noncircularity, Widely Linear and Neural Models, Wiley-Blackwell, 2009.
[23] R. A. Horn, C. R. Johnson, Matrix Analysis, Cambridge University Press,
1990.
[24] E. Ollila, V. Koivunen, Complex ICA using generalized uncorrelating transform, Signal Processing 89 (4) (2009) 365–377.

29

[25] C. Cheong Took, S. Douglas, D. P. Mandic, On approximate diagonalization of correlation matrices in widely linear signal processing, IEEE Transactions on Signal Processing 60 (3) (2012) 1469–1473.
[26] C. Cheong Took, S. Douglas, D. P. Mandic, Maintaining the integrity of
sources in complex learning systems: Intraference and the correlation preserving transform, IEEE Transaction on Neural Networks and Learning
Systems 26 (3) (2015) 500–509.
[27] S. C. Douglas, D. P. Mandic, Performance analysis of the conventional
complex LMS and augmented complex LMS algorithms, in: Proceedings of
IEEE International Conference on Acoustics, Speech and Signal Processing
(ICASSP), 2010, pp. 3794–3797.
[28] D. P. Mandic, S. Kanna, S. C. Douglas, Mean square analysis of the
CLMS and ACLMS for non-circular signals: The approximate uncorrelating transform approach, in: Proceedings of IEEE International Conference
on Acoustics, Speech and Signal Processing (ICASSP), IEEE, 2015, pp.
3531–3535.
[29] Y. Xia, D. P. Mandic, Complementary mean square analysis of augmented
CLMS for second-order noncircular gaussian signals, IEEE Signal Processing Letters 24 (9) (2017) 1413–1417.
[30] Y. Xia, D. P. Mandic, A full mean square analysis of CLMS for secondorder noncircular inputs, IEEE Transactions on Signal Processing 65 (21)
(2017) 5578–5590.
[31] H. Shen, M. Kleinsteuber, Complex blind source separation via simultaneous strong uncorrelating transform, in: Latent Variable Analysis and Signal
Separation. LVA/ICA 2010. Lecture Notes in Computer Science, Vol. 6365,
Berlin, Heidelberg, 2010, pp. 287–294.
[32] D. Ramı́rez, P. J. Schreier, J. Vı́a, I. Santamarı́a, GLRT for testing separability of a complex-valued mixture based on the strong un30

correlating transform, in:

Proceedings of IEEE International Work-

shop on Machine Learning for Signal Processing, 2012, pp. 1–6.
doi:10.1109/MLSP.2012.6349785.
[33] S. C. Douglas, J. Eriksson, V. Koivunen, Adaptive estimation of the
strong uncorrelating transform with applications to subspace tracking, in: Proceedings of IEEE International Conference on Acoustics,
Speech and Signal Processing (ICASSP), Vol. IV, 2006, pp. 941–944.
doi:10.1109/ICASSP.2006.1661125.
[34] G. Okopal, S. Wisdom, L. Atlas, Speech analysis with the strong uncorrelating transform, IEEE/ACM Transactions on Audio, Speech, and Language
Processing 23 (11) (2015) 1858–1868. doi:10.1109/TASLP.2015.2456426.
[35] A. Bojanczyk, G. Cybenko, Linear Algebra for Signal Processing, Springer
Science & Business Media, 1995.
[36] A. Hjørungnes, Complex-Valued Matrix Derivatives: With Applications
in Signal Processing and Communications, Cambridge University Press,
Cambridge, UK, 2011.
[37] F. Zhang, Quaternions and matrices of quaternions, Linear Algebra and its
Applications 251 (1997) 21–57.
[38] L. Zou, Y. Jiang, J. Wu, Location for the right eigenvalues of quaternion
matrices, Journal of Applied Mathematics and Computing 38 (1) (2012)
71–83.
[39] D. Xu, D. P. Mandic, The theory of quaternion matrix derivatives, IEEE
Transactions on Signal Processing 63 (3) (2015) 1543–1556.
[40] S. Sangwine, N. L. Bihan, Quaternion singular value decomposition based
on bidiagonalization to a real or complex matrix using quaternion Householder transformations, Applied Mathematics and Computation 182 (2006)
727–738.

31

[41] N. L. Bihan, S. Sangwine, Jacobi method for quaternion matrix singular
value decomposition, Applied Mathematics and Computation 187 (2007)
1265–1271.
[42] C. Cheong Took, D. P. Mandic, F. Zhang, On the unitary diagonalisation of
a special class of quaternion matrices, Applied Mathmatics Letters 24 (11)
(2011) 1806–1809.
[43] S. Enshaeifar, C. Cheong Took, S. Sanei, D. P. Mandic, Novel quaternion
matrix factorisations, in: Proceedings of IEEE International Conference on
Acoustics, Speech and Signal Processing (ICASSP), 2016, pp. 3946–3950.
[44] T. A. Ell, S. J. Sangwine, Quaternion involutions and anti-involutions,
Computers and Mathematics with Applications 53 (1) (2007) 137–143.
[45] C. Cheong Took, D. P. Mandic, A quaternion widely linear adaptive filter,
IEEE Transactions on Signal Processing 58 (8) (2010) 4427–4431.
[46] Y. Xia, C. Jahanchahi, T. Nitta, D. P. Mandic, Performance bounds of
quaternion estimators, IEEE Transactions on Neural Networks and Learning Systems 26 (12) (2015) 3287–3292.
[47] P. O. Amblard, N. Le Bihan, On properness of quaternion valued random
variables, in: Proceedings of IMA International Conference on Mathematics
in Signal Processing, 2004, pp. 23–26.
[48] L. Rodman, Topics in Quaternion Linear Algebra, Princeton University
Press, 2014.
[49] F. Zhang, The Schur Complement and Its Applications, Springer, 2006.
[50] J. P. Ward, Quaternions and Cayley numbers: Algebra and Applications,
Springer, 1997.
[51] C. Park, C. Cheong Took, D. P. Mandic, Augmented complex common
spatial patterns for classification of noncircular EEG from motor imagery

32

tasks, IEEE Transactions on Neural Systems and Rehabilitation Engineering 22 (1) (2014) 1–10. doi:10.1109/TNSRE.2013.2294903.
[52] S. Enshaeifar, C. Cheong Took, C. Park, D. P. Mandic, Quaternion common
spatial patterns, IEEE Transactions on Neural Systems and Rehabilitation
Engineering 25 (8) (2017) 1278–1286.
[53] NIR

of

corn

samples

for

standardization

benchmarking,

http://www.eigenvector.com/data/Corn/ (June 2005).
[54] S. P. Talebi, D. P. Mandic, A quaternion frequency estimator for threephase power systems, in: Proceedings of IEEE International Conference on
Acoustics, Speech and Signal Processing (ICASSP), 2015, pp. 3956–3960.
[55] Y. Xia, S. C. Douglas, D. P. Mandic, Adaptive frequency estimation in
smart grid applications: Exploiting noncircularity and widely linear adaptive estimators, IEEE Signal Processing Magazine 29 (5) (2012) 44–54.
doi:10.1109/MSP.2012.2183689.
[56] S. Kanna, D. H. Dini, Y. Xia, S. Y. Hui, D. P. Mandic, Distributed widely
linear Kalman filtering for frequency estimation in power networks, IEEE
Transactions on Signal and Information Processing over Networks 1 (1)
(2015) 45–57.

33

10
ℑi(x3)

ℜ(x3)

10
0
−10
10
0
ℜ(x ) −10 −10
2

−10
10

10
0
ℜ(x1)

10

0
ℑ (x ) −10 −10

0
ℑi(x1)

0
ℑk(x2) −10 −10

0
ℑk(x1)

i

2

10
ℑk(x3)

10
ℑj(x3)

0

0
−10
10
0
ℑj(x2) −10 −10

10
0
ℑj(x1)

0
−10
10

10

Figure 1: Scatter plots, indicating the high correlation (improperness) of the three correlated
Cκ -improper quaternion signals, x1 , x2 and x3 .

34

2
ℑi(y3)

ℜ(y3)

2
0
−2
2
0
ℜ(y2)

−2
2

2
−2 −2

0
ℜ(y1)

2

2

0
ℑi(y2)

−2 −2

0
ℑi(y1)

0
ℑk(y2)

−2 −2

0
ℑk(y1)

2
ℑk(y3)

ℑj(y3)

0

0
−2
2
0
ℑj(y2)

−2
2

2
−2 −2

0

0
ℑj(y1)

2

Figure 2: Scatter plots, indicating the low correlation (properness) of the three Cκ -improper
quaternion signals, y1 , y2 and y3 , decorrelated via the QUT.

35

Diagonal Error ε2i

1

0.5

0
20
15
10
5 0.5

Data Segment Length L

0.6

0.7

0.8

0.9

1

Correlation Coefficient ρ

Diagonal Error ε2j

(a) Squared diagonal error of Cxı

1

0.5

0
20
15
10
5 0.5

Data Segment Length L

0.6

0.7

0.8

0.9

1

Correlation Coefficient ρ

Diagonal Error ε2k

(b) Squared diagonal error of Cx

1

0.5

0
20
15
10

Data Segment Length L

5 0.5

0.6

0.7

0.8

0.9

1

Correlation Coefficient ρ

(c) Squared diagonal error of Cxκ
Figure 3: Squared diagonal error [in %] against the correlation degree and the data segment
length for synthetic univariate data.

36

Diagonal Error ε2i

1

0.5

0
20
15
10
5

Number of Variates M

0.5

0.6

0.7

0.8

0.9

1

Correlation Coefficient ρ

Diagonal Error ε2j

(a) Squared diagonal error of Cxı

1

0.5

0
20
15
10
5

Number of Variates M

0.5

0.6

0.7

0.8

0.9

1

Correlation Coefficient ρ

Diagonal Error ε2k

(b) Squared diagonal error of Cx

1

0.5

0
20
15
10

Number of Variates M

5

0.5

0.6

0.7

0.8

0.9

1

Correlation Coefficient ρ

(c) Squared diagonal error of Cxκ
Figure 4: Squared diagonal error [in %] against the correlation degree and the number of
variates for synthetic multivariate data.

37

Diagonal Error ε2i

0.2

Low correlation
Medium correlation
High correlation

0.15

0.1

0.05

0
5

10
15
Data Segment Length L

20

(a) Squared diagonal error of Cxı

Diagonal Error ε2j

0.2

Low correlation
Medium correlation
High correlation

0.15

0.1

0.05

0
5

10
15
Data Segment Length L

20

(b) Squared diagonal error of Cx

Diagonal Error ε2k

0.2

Low correlation
Medium correlation
High correlation

0.15

0.1

0.05

0
5

10
15
Data Segment Length L

20

(c) Squared diagonal error of Cxκ
Figure 5: Squared diagonal error [in %] against the correlation degree and the data segment
length for EEG data.

38

H

H

H

H

Figure 6: Rank reduction using the QAUT.

5
ℑi(x2)

ℜ(x2)

5
0
−5
−5

0
ℜ(x1)

−5
−5

5

0
ℑi(x1)

5

0
ℑk(x1)

5

5
ℑk(x2)

ℑj(x2)

5
0
−5
−5

0

0
ℑj(x1)

0
−5
−5

5

Figure 7: Scatter plots showing high correlation between the correlated x1 and x2 variables.

39

5
ℑi(y2)

ℜ(y2)

5
0
−5
−5

0
ℜ(y )

0
−5
−5

5

1

0
ℑk(y1)

5

1

5
ℑk(y2)

ℑj(y2)

5

i

5
0
−5
−5

0
ℑ (y )

0
ℑj(y1)

0
−5
−5

5

Figure 8: Scatter plots showing no correlation between the transformed y1 and y2 variables.

Original variables

QAUT variables

0

Cumulative
Variance Ratio

Ratio of Total Variance

10

−5

10

1
0.5
0
0

40

80

Number of Variables
−10

10

0

20

40
60
Number of Variables

80

Figure 9: The logarithm of the ratio of the variance explained by each variable to the total
variance. Insert diagram: The cumulative ratio of variance against the number of variables
for the original and decorrelated corn data.

40

v1 (kV)
v2 (kV)
v3 (kV)
Diagonal Error (%)

20
0
−20
0

0.2

0.4

0.6

0.8

1

0.2

0.4

0.6

0.8

1

0.2

0.4

0.6

0.8

1

20
0
−20
0
20
0
−20
0
100

C i error
x

C j error
x

50
0
0

Cxk error

0.2

0.4

0.6

0.8

1

Time (s)
Figure 10: Three-phase power signal and imbalance detection.

41

