1

On the Existence of a Solution to a Spectral
Estimation Problem à la Byrnes-Georgiou-Lindquist

arXiv:1709.09012v2 [] 31 Jan 2018

Bin Zhu and Giacomo Baggio

Abstract—A parametric spectral estimation problem in the
style of Byrnes, Georgiou, and Lindquist was posed in [1], but the
existence of a solution was only proved in a special case. Based
on their results, we show that a solution indeed exists given an
arbitrary matrix-valued prior density. The main tool in our proof
is the topological degree theory.
Index Terms—Approximation of spectral densities, spectral
estimation, generalized moment problems, topological degree
theory, covariance extension.

I. I NTRODUCTION
This note concerns a spectral estimation problem subjected
to a generalized moment constraint. The setup of the problem
(scalar version) was first introduced by Byrnes, Georgiou, and
Lindquist in [2], and then further elaborated in [3] in order
to allow for an a priori information. This formulation, known
under the name of THREE-like spectral estimation, has now
become nearly standard and includes as special cases some
important problems in the field of systems and control such
as covariance extension (cf. e.g., [4]–[9]) and Nevanlinna–Pick
interpolation (cf. [10]–[12] and references therein).
It is worth pointing out that moment problems [13], [14]
form a special class of inverse problems that are typically
not well-posed in the sense of Hadamard. To remedy this,
the mainstream approach today is to first define an entropylike distance index d(Φ, Ψ) between two bounded and coercive spectral densities, and then to find the “best” Φ given
the prior Ψ by minimizing the distance index subjected to
the generalized moment constraint. Still, it is not trivial to
solve such an optimization problem. Indeed, although the
dual problem is typically convex, the dual variable (i.e., the
Lagrange multiplier) is a Hermitian matrix that lives in an
open, unbounded domain and this usually gives rise to a
number of numerical issues. With reference to the scalar case,
results in this direction include the aforecited [3], in which
the chosen distance index is the Kullback–Leibler divergence
(cf. also [15]–[18]), and [19], where a general family of
divergences (the Alpha divergence family) is considered. In
the multivariate case, the problem becomes much more challenging and its feasibility strongly depends on the selected
distance. We mention, in particular, the papers [20], where a
The first author was supported by the China Scholarship Council (CSC)
under File No. 201506230140.
B. Zhu and G. Baggio are with the Department of Information Engineering,
University of Padova, via Gradenigo 6/B, 35131 Padova, Italy; e-mail:
zhubin@dei.unipd.it, baggio@dei.unipd.it

multivariate extension of the Kullback–Leibler divergence, the
quantum relative entropy, is considered; [21], [22], which deal
with a sensible generalization of the Hellinger distance; and
[23], [24], where the selected distance index coincides with
the multivariate Itakura–Saito distance. It is worth remarking
that the latter two approaches lead to rational solutions with
bounded McMillan degrees when the prior is rational. Finally,
[25] and [26] introduce two more general frameworks based
on the notion of Beta and Tau divergence families, wherein
the multivariate Kullback–Leibler and Itakura–Saito distance
can be recovered as particular cases.
There are a few attempts in directions different from optimization; see [1], [27], [28]. In particular, a parametric family
of spectral densities was introduced in [1], and a certain
map from the parameter space to the space of (generalized)
moments was studied in the light of a Hadamard-type global
inverse function theorem [29]. The proposed parametrization
has been shown to be amenable for the implementation of a
matricial version of an extremely simple and efficient fixedpoint algorithm introduced in [15], whose convergence properties have been investigated in [16]–[18]. However, the result
in [1] was not satisfactory because the authors only showed
that a solution exists when the prior Ψ has a very special
structure. In fact, this is the motivation of the current note. As
a continuation of the work in [1], here we will show that a
solution to the parametric spectral estimation problem exists
given any fixed matrix-valued prior density that is bounded
and coercive. Of course the problem is still open to a large
extent since uniqueness of the solution (and, a fortiori, wellposedness of the problem) is not known, and the convergence
properties of the algorithm proposed in [1] to compute a
solution are yet to be examined.
The main machinery behind our existence proof is the topological degree theory from nonlinear analysis. As a historical
remark, Georgiou was the first to apply the degree theory to
rational covariance extension [5], [6], [10] to show existence of
a solution, and it was further developed by Byrnes, Lindquist,
and coworkers [7] to prove the uniqueness and well-posedness.
These theories were established before the discovery of the
cost function in the optimization framework [8], [9], [11],
which was later called generalized entropy criterion.
The outline of this note is as follows. In Section II, we
first set up some notations before reviewing the problem
formulation. The important special case of multivariate covariance extension is detailed for illustration. Our main result
is presented in Section III. A part of the degree theory is

2

reviewed in order to carry out our proof. We conclude with
some open questions on the uniqueness of the solution and
convergence of an algorithm leading to such a solution.
List of symbols
•
•
•
•
•
•
•
•

•

•

•

•

E, mathematical expectation.
Z, the set of integers.
C, the complex plane.
D, the open complex unit disk {z ∈ C : |z| < 1}.
T ≡ ∂D, the unit circle, where ∂ stands for the boundary.
GL(n, C), group of n × n invertible complex matrices.
Hn , the vector space of n × n Hermitian matrices.
H+,n , the subset of Hn that contains positive definite
matrices.
C(T; Hm ), the space of Hm -valued continuous functions
on T.
Sm , the family of H+,m -valued functions defined on T
that are bounded and coercive.
(·)∗ , complex conjugate transpose. When considering a
rational matrix-valued function G(z), G∗ (z) stands for
the analytic continuation of the function that for z ∈ T
equals the complex conjugate transpose of G(z).
(·)−∗ , shorthand for [(·)−1 ]∗ .

II. A

MULTIVARIATE SPECTRAL ESTIMATION PROBLEM

Consider a linear system with a state-space representation
x(t + 1) = Ax(t) + By(t),

(1)

where A ∈ Cn×n is Schur stable, i.e., has all its eigenvalues in
D, B ∈ Cn×m is of full column rank (n ≥ m). Moreover, the
pair (A, B) is assumed to be reachable. The input process y(t)
is zero-mean wide-sense stationary with an unknown spectral
density matrix Φ(z). The transfer function of (1) is just
G(z) = (zI − A)−1 B,

(2)

which can be interpreted as a bank of filters. An estimate of
the steady-state covariance matrix Σ := E{x(t)x(t)∗ } of the
state vector x(t) is assumed to be known. (For the problem
of estimating covariance matrices in this setting, we refer to
[30]–[32]). Hence we have
Z
GΦG∗ = Σ,
(3)
where the function is integrated on T with respect to the nordθ
. This notation will be adopted
malized Lebesgue measure 2π
throughout the note.
Given the matrix Σ ∈ H+,n , we want to estimate the spectral
density Φ such that the generalized moment constraint (3) is
satisfied. For example, consider the following choice of the
matrix pair (A, B):

 

0
0 Im 0 · · ·
0

0
0 0 Im · · ·
0

 


..  , B =  ..  .
..
..
(4)
A =  ...

 . 
.
. 
.
 




0 0
0
0 · · · Im
Im
0 0
0 ···
0

Here each block in A or B is of m × m and A is a (p + 1) ×
(p+ 1) block matrix while B is a (p+ 1)-block column vector.
It is easy to verify that in this case
 −p−1 
z
Im
 z −p Im 


G(z) = (zI − A)−1 B = 
(5)
,
..


.
z −1 Im
Symbolically, the steady state vector


y(t − p − 1)


..


.
x(t) = G(z)y(t) = 
,
 y(t − 2) 
y(t − 1)
and the covariance matrix Σ
i.e.,

Σ0
Σ∗1
 Σ1
Σ0

 Σ2
Σ
1
Σ=
 .
..
 ..
.
Σp

Σp−1

(6)

has a block-Toeplitz structure,
Σ∗2
Σ∗1
Σ0
..
.

···
···
···
..
.

···

Σ1


Σ∗p
Σ∗p−1 

Σ∗p−2 
,
.. 
. 
Σ0

(7)

where Σk := E{y(t + k)y(t)∗ } ∈ Cm×m with a slight abuse
of notation. In fact, the constraint (3) is equivalent to the set
of moment equations
Z π
dθ
ejkθ Φ(ejθ )
= Σk , k = 0, 1, . . . , p.
(8)
2π
−π
To find a spectral density Φ satisfying (8) is the classical
covariance extension problem [14].
In general, existence of Φ ∈ Sm satisfying (3) is not trivial.
Such feasibility problem was addressed in [33], [34], see also
[1], [16], [21]–[23], [30], [31], [35]. In order for Σ > 0 to be
a state covariance, a certain Lyapunov-like equation has to be
solvable or an equivalent rank condition must hold. Interested
readers can consult the references for details. Here we shall
take the feasibility as a standing assumption. More precisely,
let us define the linear operator Γ : C(T; Hm ) → Hn as
Z
Γ : Φ 7→ GΦG∗ .
(9)
Then we assume that the covariance matrix Σ ∈ Range Γ.
Various properties of the set Range Γ are elaborated in e.g.,
[31, Sec. III]. In particular, by Proposition 3.1 of that paper,
Range Γ ⊂ Hn is a linear space with real dimension m(2n −
m).
Moreover, define the set
L+ := {Λ ∈ Hn : G∗ (z)ΛG(z) > 0, ∀z ∈ T}.

(10)

By the continuous dependence of eigenvalues on the matrix
entries, one can verify that L+ is an open subset of Hn . For
Λ ∈ L+ , take WΛ as the unique stable and minimum phase
(right) spectral factor of G∗ ΛG [1, Lemma 11.4.1], i.e.,
G∗ ΛG = WΛ∗ WΛ .
Our problem is formulated as follows.

(11)

3

Problem 1. Given the filter bank G(z) in (2), let Σ ∈
Range+ Γ := Range Γ ∩ H+,n and Ψ ∈ Sm . Find Λ ∈ L+
such that
ΦΛ := WΛ−1 ΨWΛ−∗
(12)
satisfies

Z

GΦΛ G∗ = Σ.

(13)

Define L+Γ := L+ ∩ Range Γ, and consider the map
ω : L+Γ → Range+ Γ given by
Z
ω : Λ 7→ GΦΛ G∗ .
(14)
As indicated in [1] and will be clear in Subsection III-B,
this is a continuous map between open subsets of the linear
space Range Γ, and Problem 1 is feasible if and only if ω is
surjective. Theorem 11.4.3 in [1] guarantees such surjectivity
when the prior is a scalar density times a positive definite
matrix. In the next section, we shall extend that result to
accommodate an arbitrary matrix spectral density Ψ.
III. E XISTENCE OF

A SOLUTION

The proof of our main result relies on the notion of topological degree of a continuous map. The degree theory forms an
important part of differential topology and is closely related
to fixed-point theory, cf. [36, Ch. I] for a rather informative
historical account. In particular, the degree theory is a powerful
tool to prove existence of a solution to a system of nonlinear
equations. There are several versions of the theory for different
types of maps. Although the maps that we consider in this
note are between open subsets of the Euclidean space, we
shall use the more general degree theory for continuous maps
between smooth, connected, boundary-less manifolds. Some
main points of the theory are reviewed below.
A. A short review of the degree theory
We mainly follow the lines of [36, Ch. III]. Suppose U, V ⊂
Rn are open and connected, and f : U → V is a proper C 1
function. Recall that f is called proper if the preimage of
every compact set in V is compact in U . Our major concern
is solvability of the equation
f (x) = y.

(15)

A point y ∈ V is called a regular value of f if either
(i) for any x ∈ f −1 (y), det f ′ (x) 6= 0 or
(ii) f −1 (y) is empty.
Here f −1 (y) denotes the preimage of y under f , i.e., the set
{x ∈ U : f (x) = y},
′

and f (x) denotes the Jacobian matrix of f evaluated at x.
Let y be a regular value of type (i), and the degree of f at y
is defined as
X
sign det f ′ (x),
(16)
deg(f, y) :=
f (x)=y

where the sign function
sign(x) =



1
if x > 0
−1 if x < 0

and not defined at 0.
Throughout this note, properness will be a crucial property
of our function. Since f is proper, one can show that the
preimage f −1 (y) is finite following the classical inverse
function theorem, and hence the sum above is well defined. For
regular values of type (ii), we set deg(f, y) = 0. Moreover, the
set of regular values is dense in V by Sard–Brown Theorem
[36, p. 63]. Further properties of the degree related to our
problem are listed below:
•

•

•

The degree of f at y does not depend on the choice of
regular value. Therefore, we can define the degree of f
as
deg(f ) = deg(f, y)
for any regular value y.
If deg(f ) 6= 0, then for any y ∈ V , there exists x ∈ U
such that f (x) = y, that is, the map f is surjective. A
proof of this fact can be found in [7, p. 1849].
Homotopy invariance. If H : U ×[0, 1] → V, (x, t) 7→ y is
jointly continuous in (x, t) and proper, then deg(Ht , y) is
defined and independent of t ∈ [0, 1]. Here Ht : U → V
is defined by Ht (x) = H(x, t).

One important point of theory is that degree can be defined
for continuous functions through approximation by smooth
functions [36, Proposition and Definition 3.1, p. 111], and
(16) is just a way of computing it in the special case of C 1
[37, Remark p. 71]. In particular, the homotopy invariance of
the degree holds in the continuous case [36, Proposition 3.4,
p. 112].
B. Proof of existence
Our main theorem will be preceded by some lemmas. Take
Ψ = I the identity matrix, and the map ω would reduce to
ω̃ : L+Γ → Range+ Γ
Z
Λ 7→ G(G∗ ΛG)−1 G∗ .

(17)

Lemma 1. The map ω̃ is continuously differentiable.
Proof. The map
GL(n, C) → GL(n, C) : X 7→ X −1

(18)

is smooth, which follows from Cramer’s rule in linear algebra.
Hence, the function F̃Λ (ejθ ) := G(G∗ ΛG)−1 G∗ inside the
integral of (17) is also smooth in Λ. Moreover, since G
is a rational function, all the partial derivatives of F̃Λ (ejθ )
with respect to Λ are continuous in θ (and Λ). Then by
Leibniz’s rule for differentiation under the integral sign, partial
derivatives of ω̃ of all orders exist.
Next, we show that the first order partial derivatives are continuous. For the time being, let us consider the map ω̃ defined
on L+ . (We made the domain restricted to the intersection
with Range Γ out of the consideration of dimensionality.)
From [38], the differential of the map (18) at X is given by
Cn×n → Cn×n : V 7→ −X −1 V X −1 .

4

Using this fact, the differential of ω̃ at Λ ∈ L+ is
Z
δΛ 7→ δ ω̃Λ = − G(G∗ ΛG)−1 (G∗ δΛG)(G∗ ΛG)−1 G∗

(19)
such that δΛ ∈ Hn and Λ + δΛ stays in L+ . Let us denote
the integrand in (19) by δ F̃Λ,δΛ (ejθ ). For a fixed δΛ, one
can see that the differential δ ω̃Λ (δΛ) is continuous w.r.t. Λ.
To see this fact, let a sequence {Λk }k≥1 ⊂ L+ converge to
some Λ̄ ∈ L+ as k → ∞. Notice that, the corresponding
sequence of matrix-valued functions {G∗ Λk G}k≥1 is such
that G∗ (ejθ )Λk G(ejθ ) > 0 for all θ ∈ [−π, π] and k.
Since the eigenvalues of a continuous matrix-valued function
F : [a, b] → Cn×n , θ 7→ F (θ), depend continuously on θ [39,
Cor. VI.1.6], we have that G∗ Λk G ≥ µk I where

µk := min λmin G∗ (ejθ )Λk G(ejθ ) > 0
θ

and λmin (·) denotes the smallest eigenvalue. Further, since
the sequence {Λk }k≥1 converges to an element Λ̄ ∈ L+ ,
then {G∗ Λk G}k≥1 converges uniformly to the function
G∗ (ejθ )Λ̄G(ejθ ) which is positive definite for all θ ∈ [−π, π].
Hence, there exists µ > 0 such that µk ≥ µ for all k. On the
other hand, since δΛ is fixed, it must hold that G∗ δΛG ≤ M I,
where

M := max ρ G∗ (ejθ )δΛG(ejθ ) .
θ

Here ρ(·) denotes the spectral radius of a matrix. Therefore,
we have
δ F̃Λk ,δΛ ≤ M µ−2 GG∗ , ∀k.
Moreover,
[δ F̃Λk ,δΛ ]iℓ ≤ M µ−2 Gmax ,

∀ k ≥ 1, ∀ i, ℓ,

where Gmax := maxθ,i,ℓ |[GG∗ ]iℓ | < ∞ since the entries of
G(ejθ )G∗ (ejθ ) are continuous functions of θ, analytic in an
open annulus containing the unit circle. Hence, by Lebesgue’s
dominated convergence theorem, we have
Z
lim δ ω̃Λk (δΛ) = −
lim δ F̃Λk ,δΛ = δ ω̃Λ̄ (δΛ).
k→∞

order to prove joint continuity, we first notice that the spectral
factor WΛ (z) can be written as [1, Lemma 11.4.1]
∗
−1
WΛ (z) := L−∗
B + LΛ ,
Λ B PΛ A(zI − A)

(22)

where PΛ is the unique stabilizing solution of the following
Discrete-time Algebraic Riccati Equation (DARE)
Π = A∗ ΠA − A∗ ΠB(B ∗ ΠB)−1 B ∗ ΠA + Λ,
and LΛ is the right Cholesky factor of B ∗ PΛ B, i.e.,
B ∗ PΛ B = L∗Λ LΛ
with LΛ being lower triangular having real and positive
diagonal entries. Next, let us introduce a change of variables
by letting
∗
CΛ := L−∗
Λ B PΛ .
Then, it is not difficult to recover the relation LΛ = CΛ B. In
this way, the spectral factor (22) can be rewritten as
WΛ (z) = CΛ A(zI − A)−1 B + CΛ B.
According to [40, Thm. A.5.5], the dependence of the m × n
matrix CΛ defined above on Λ ∈ L+Γ turns out to be
a homeomorphism. From this fact it follows that WΛ (ejθ )
depends continuously on Λ ∈ L+Γ , for all θ ∈ [−π, π].
Consider now
ΦΛ,t (ejθ ) = WΛ−1 (ejθ )[ tΨ(ejθ ) + (1 − t)I ]WΛ−∗ (ejθ ).
As a linear combination in t ∈ [0, 1] of continuous functions of
Λ, ΦΛ,t (ejθ ) is jointly continuous w.r.t. t ∈ [0, 1] and Λ ∈ L+Γ ,
for all θ ∈ [−π, π].
Next we need to show the continuity together with the
integral. Consider any sequence {(Λk , tk )}k≥1 ⊂ L+Γ × [0, 1]
such that limk→∞ tk = t̄ ∈ [0, 1] and limk→∞ Λk = Λ̄ ∈ L+Γ .
Following the same line of reasoning as in the proof of Lemma
1, there exists µ > 0 such that G∗ Λk G ≥ µI, ∀k. Therefore,
it holds that
GΦΛk ,tk G∗ ≤ KG(G∗ Λk G)−1 G∗
≤ Kµ−1 GG∗ ,

∀ k ≥ 1,

k→∞

Partial derivatives can then be recovered by the operation
hδΛ1 , δ ω̃Λ (δΛ2 )i by choosing δΛk , k = 1, 2 to be the standard basis matrices of Hn , where the notation hM1 , M2 i :=
tr(M1 M2 ) denotes the standard inner product in Hn . In this
way, one can see that every partial derivative of ω̃ is continuous
in Λ.
Lemma 2. The map
H:

tΨ(ejθ ) + (1 − t)I ≤ KI, ∀ t ∈ [0, 1], θ ∈ [−π, π].
Such K exists since Ψ is bounded. The rest argument is also
similar. Given the joint continuity of ΦΛ,t in Λ and t, one can
show that the following limit holds
Z
Z
Z
lim
GΦΛk ,tk G∗ =
lim GΦΛk ,tk G∗ = GΦΛ̄,t̄ G∗ .
k→∞

L+Γ

× [0, 1] → Range+ Γ
Z
(Λ, t) 7→ GΦΛ,t G∗ .

(20)

is a proper continuous homotopy between ω and ω̃, where
ΦΛ,t :=

where K is a positive real number such that

WΛ−1 [ tΨ

+ (1 − t)I

]WΛ−∗ .

(21)

Proof. By definition we need to show two things, namely that
H is jointly continuous in Λ and t and that H is proper. In

k→∞

This proves joint continuity of H in t and Λ.
Once we have joint continuity, the properness is not difficult
to prove. In fact, let K ⊂ Range+ Γ be a compact subset, and
we next show that the set
H −1 (K) := { (Λ, t) ∈ L+Γ × [0, 1] : H(Λ, t) ∈ K }
is compact. The argument is essentially the same as the
proof of Theorem 11.4.1 of [1]. Since our setting is finitedimensional, a set being compact is equivalent to being closed

5

and bounded. If H −1 (K) is unbounded, one can then find a
sequence {(Λk , tk )} ⊂ H −1 (K) such that k(Λk , tk )k → ∞
as k → ∞, which necessarily implies kΛk k → ∞. However,
in this case H(Λk , tk ) would tend to be singular, which
contradicts the premise of K being compact. This proves the
boundedness.
To prove the closedness, if a sequence {(Λk , tk )} in
H −1 (K) converges to (Λ, t), then Λ cannot be on the
boundary of L+ , otherwise kH(Λk , tk )k → ∞, which again
contradicts the compactness of K. To see the latter fact, notice
that
Z
H(Λk , tk ) = GΦΛk ,t G∗
Z
= GWΛ−1
[ tΨ + (1 − t)I ]WΛ−∗
G∗
k
k
Z
≥ Kmin G(G∗ Λk G)−1 G∗ ,

where Kmin := mint,θ λmin tΨ(ejθ ) + (1 − t)I > 0
since Ψ is coercive. Now if {Λk } approaches ∂L+ , then
G∗ (ejθ )Λk G(ejθ ) tends to be singular for some θ. Since G
has rank m on T, this in turn implies that kH(Λk , tk )k → ∞
as k → ∞. Therefore, by the joint continuity of H, (Λ, t) ∈
H −1 (K). This concludes the proof of properness.
Theorem 1. The map ω is surjective.
Proof. Given the second listed property of the degree, the
claim follows directly if we can show that
deg(ω) 6= 0.
We notice first that ω is proper by Theorem 11.4.1 from [1],
and thus the degree is well defined. By Lemma 2 and the
homotopy invariance of the degree,
deg(ω) = deg(ω̃).
As a consequence of Sard–Brown theorem [36, p. 63], the
codomain Range+ Γ must contain a regular value of ω̃ since it
has positive Range Γ-Lebesgue measure. By Lemma 1, the C 1
degree (16) of ω̃ at a regular value is well-defined. Meanwhile,
from Theorem 11.4.2 of [1], we know that ω̃ is bijective.
Therefore, we must have
deg(ω̃) 6= 0,

C. The special case of covariance extension
Given Λ ∈ L+ and G(z) in (5), G∗ ΛG is now a matrix
Laurent polynomial that takes positive definite values on the
unit circle. Let us take
p
X

Qk z k ≡ G∗ ΛG,

We have the following corollary of Theorem 1.
Corollary 1. Given a finite m×m matrix covariance sequence
Σ0 , Σ1 , . . . , Σp , for any Ψ ∈ Sm , there exists a Schur
polynomial D(z) of degree p such that the spectral density
Φ := D−1 ΨD−∗

(26)

satisfies the moment equations (8). The polynomial D(z) is a
right Schur spectral factor of G∗ ΛG for some Λ ∈ L+Γ .
In particular,
when taking Ψ(z) = N (z)N ∗ (z) with
Pp
N (z) = k=0 Nk z −k , Nk ∈ Cm×m , which is the spectral
density of a moving-average process, the spectral density Φ
in (26) would correspond to an m-dimensional vector ARMA
process
p
X

k=0

Dk y(t − k) =

p
X

Nk w(t − k),

t ∈ Z,

(27)

k=0

and we recover one of the main results of [5, Section V] under
a more general setting.
IV. C ONCLUDING

REMARKS

We have shown that the multivariate spectral estimation
problem posed in [1] admits a solution under an arbitrary prior
matrix density. An immediate question is uniqueness of the
solution and, more strongly, well-posedness of the problem.
Following previous work on rational covariance extension [7],
we intend to pursue the uniqueness problem in the frame of the
global inverse function theorem now attributed to Hadamard.
The next theorem appears in [42]; see also [43, p. 127].
Theorem 2 (Hadamard). Let M1 and M2 be connected,
oriented, boundary-less n-dimensional manifolds of class C 1 ,
and suppose that M2 is simply connected. Then a C 1 map
f : M1 → M2 is a diffeomorphism if and only if f is proper
and the Jacobian determinant of f never vanishes.
The next proposition is simple.
Proposition 1. The set Range+ Γ is simply connected.

and this concludes the proof.

Q(z) :=

Pp
where D(z) = k=0 Dk z −k is a m × m matrix polynomial
(with negative powers) and the scalar polynomial det D(z)
has all its roots strictly inside the unit circle. We shall call
such D(z) Schur.1 Therefore, the outer spectral factor in (11)
is just
WΛ (z) ≡ D(z).
(25)

Q−k = Q∗k ∈ Cm×m .

k=−p

(23)
Then according e.g. to [41], Q(z) admits a spectral factorization
Q(z) = D∗ (z)D(z),
(24)

Proof. By definition [43, p. 127], we need to show that:
whenever f : [0, 1] → Range+ Γ is a closed curve, i.e., f is
continuous with f (0) = f (1) = Σ, there exists a continuous
function F : [0, 1] × [0, 1] → Range+ Γ such that
(i) F (t, 0) = f (t), for all t ∈ [0, 1],
(ii) F (0, u) = F (1, u) = Σ, for all u ∈ [0, 1], and
(iii) F (t, 1) = Σ, for all t ∈ [0, 1].
One can easily verify that F (t, u) := (1 − u)f (t) + uΣ is the
desired function.
1 Moreover, one can make such spectral factor unique if the constant matrix
coefficient D0 is required to be lower triangular with real and positive
diagonal elements.

6

Given Theorem 2 and the above proposition, the open
question becomes: Is our map ω continuously differentiable?
If so, how to compute its Jacobian?
Another research direction concerns the computation of a
solution to the problem. To accomplish this task, in [1] the
following matricial fixed-point iteration was introduced
Z
1/2
1/2
Λk+1 = Λk G(WΛ−1
ΨWΛ−∗
)G∗ Λk ,
(28)
k
k
where the initialization is set to Λ0 = n1 I. Iteration (28) can
be seen as a multivariate generalization of the scalar algorithm
proposed in [15] for the Kullback–Leibler estimation of spectral densities. The latter algorithm has proved to be extremely
efficient and numerically robust, and its convergence properties
have been thoroughly investigated in [16]–[18]. The extension
of these convergence results to the multivariate case will be
another subject of future investigation.
R EFERENCES
[1] A. Ferrante, M. Pavon, and M. Zorzi, “Application of a global inverse
function theorem of Byrnes and Lindquist to a multivariable moment
problem with complexity constraint,” in Three Decades of Progress in
Control Sciences. Springer Berlin Heidelberg, 2010, pp. 153–167.
[2] C. I. Byrnes, T. T. Georgiou, and A. Lindquist, “A new approach to
spectral estimation: A tunable high-resolution spectral estimator,” IEEE
Transactions on Signal Processing, vol. 48, no. 11, pp. 3189–3205, 2000.
[3] T. T. Georgiou and A. Lindquist, “Kullback–Leibler approximation of
spectral density functions,” IEEE Transactions on Information Theory,
vol. 49, no. 11, pp. 2910–2917, 2003.
[4] R. E. Kálmán, “Realization of covariance sequences,” in Toeplitz Centennial. Springer, 1982, pp. 331–342.
[5] T. T. Georgiou, “Partial realization of covariance sequences,” Ph.D.
dissertation, University of Florida, Gainesville, 1983.
[6] ——, “Realization of power spectra from partial covariance sequences,”
IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 35,
no. 4, pp. 438–449, 1987.
[7] C. I. Byrnes, A. Lindquist, S. V. Gusev, and A. S. Matveev, “A complete
parameterization of all positive rational extensions of a covariance
sequence,” IEEE Transactions on Automatic Control, vol. 40, no. 11,
pp. 1841–1857, 1995.
[8] C. I. Byrnes, S. V. Gusev, and A. Lindquist, “A convex optimization
approach to the rational covariance extension problem,” SIAM Journal
on Control and Optimization, vol. 37, no. 1, pp. 211–229, 1998.
[9] ——, “From finite covariance windows to modeling filters: A convex
optimization approach,” SIAM Review, vol. 43, no. 4, pp. 645–675, 2001.
[10] T. T. Georgiou, “A topological approach to Nevanlinna–Pick interpolation,” SIAM Journal on Mathematical Analysis, vol. 18, no. 5, pp.
1248–1260, 1987.
[11] C. I. Byrnes, T. T. Georgiou, and A. Lindquist, “A generalized entropy
criterion for Nevanlinna–Pick interpolation with degree constraint,”
IEEE Transactions on Automatic Control, vol. 46, no. 6, pp. 822–839,
2001.
[12] A. Blomqvist, A. Lindquist, and R. Nagamune, “Matrix-valued
Nevanlinna–Pick interpolation with complexity constraint: An optimization approach,” IEEE Transactions on Automatic Control, vol. 48, no. 12,
pp. 2172–2190, 2003.
[13] M. G. Kreı̆n and A. A. Nudel’man, The Markov moment problem and extremal problems, ser. Translations of Mathematical Monographs. Providence, Rhode Island: American Mathematical Society, 1977, vol. 50.
[14] U. Grenander and G. Szegö, Toeplitz forms and their applications,
ser. California Monographs in Mathematical Sciences. University of
California Press, 1958.
[15] M. Pavon and A. Ferrante, “On the Georgiou–Lindquist approach to
constrained Kullback–Leibler approximation of spectral densities,” IEEE
Transactions on Automatic Control, vol. 51, no. 4, pp. 639–644, 2006.
[16] A. Ferrante, M. Pavon, and F. Ramponi, “Further results on the Byrnes–
Georgiou–Lindquist generalized moment problem,” in Modeling, Estimation and Control. Springer Berlin Heidelberg, 2007, pp. 73–83.

[17] A. Ferrante, F. Ramponi, and F. Ticozzi, “On the convergence of
an efficient algorithm for Kullback–Leibler approximation of spectral
densities,” IEEE Transactions on Automatic Control, vol. 56, no. 3, pp.
506–515, 2011.
[18] G. Baggio, “Further results on the convergence of the Pavon–Ferrante
algorithm for spectral estimation,” IEEE Trans. Autom. Control, (to
appear), 2018.
[19] M. Zorzi, “Rational approximations of spectral densities based on
the alpha divergence,” Mathematics of Control, Signals, and Systems,
vol. 26, no. 2, pp. 259–278, 2014.
[20] T. T. Georgiou, “Relative entropy and the multivariable multidimensional
moment problem,” IEEE Transactions on Information Theory, vol. 52,
no. 3, pp. 1052–1066, 2006.
[21] A. Ferrante, M. Pavon, and F. Ramponi, “Hellinger versus Kullback–
Leibler multivariable spectrum approximation,” IEEE Transactions on
Automatic Control, vol. 53, no. 4, pp. 954–967, 2008.
[22] F. Ramponi, A. Ferrante, and M. Pavon, “A globally convergent matricial
algorithm for multivariate spectral estimation,” IEEE Transactions on
Automatic Control, vol. 54, no. 10, pp. 2376–2388, 2009.
[23] A. Ferrante, C. Masiero, and M. Pavon, “Time and spectral domain
relative entropy: A new approach to multivariate spectral estimation,”
IEEE Transactions on Automatic Control, vol. 57, no. 10, pp. 2561–
2575, 2012.
[24] T. T. Georgiou and A. Lindquist, “Likelihood analysis of power spectra
and generalized moment problems,” IEEE Transactions on Automatic
Control, vol. 62, no. 9, pp. 4580–4592, 2017.
[25] M. Zorzi, “A new family of high-resolution multivariate spectral estimators,” IEEE Transactions on Automatic Control, vol. 59, no. 4, pp.
892–904, 2014.
[26] ——, “Multivariate spectral estimation based on the concept of optimal
prediction,” IEEE Transactions on Automatic Control, vol. 60, no. 6, pp.
1647–1652, 2015.
[27] B. Zhu and G. Picci, “Proof of local convergence of a new algorithm for
covariance matching of periodic ARMA models,” IEEE Control Systems
Letters, vol. 1, no. 1, pp. 206–211, 2017.
[28] G. Picci and B. Zhu, “Approximation of vector processes by covariance matching with applications to smoothing,” IEEE Control Systems
Letters, vol. 1, no. 1, pp. 200–205, 2017.
[29] C. I. Byrnes and A. Lindquist, “Interior point solutions of variational
problems and global inverse function theorems,” International Journal
of Robust and Nonlinear Control, vol. 17, no. 5-6, pp. 463–481, 2007.
[30] M. Zorzi and A. Ferrante, “On the estimation of structured covariance
matrices,” Automatica, vol. 48, no. 9, pp. 2145–2151, 2012.
[31] A. Ferrante, M. Pavon, and M. Zorzi, “A maximum entropy enhancement
for a family of high-resolution spectral estimators,” IEEE Transactions
on Automatic Control, vol. 57, no. 2, pp. 318–329, 2012.
[32] L. Ning, X. Jiang, and T. Georgiou, “On the geometry of covariance
matrices,” IEEE Signal Processing Letters, vol. 20, no. 8, pp. 787–790,
2013.
[33] T. T. Georgiou, “The structure of state covariances and its relation to the
power spectrum of the input,” IEEE Transactions on Automatic Control,
vol. 47, no. 7, pp. 1056–1066, 2002.
[34] ——, “Spectral analysis based on the state covariance: the maximum entropy spectrum and linear fractional parametrization,” IEEE transactions
on Automatic Control, vol. 47, no. 11, pp. 1811–1823, 2002.
[35] F. Ramponi, A. Ferrante, and M. Pavon, “On the well-posedness of
multivariate spectrum approximation and convergence of high-resolution
spectral estimators,” Systems & Control Letters, vol. 59, no. 3, pp. 167–
172, 2010.
[36] E. Outerelo and J. M. Ruiz, Mapping degree theory. Providence, Rhode
Island: American Mathematical Society, 2009, vol. 108.
[37] J. T. Schwartz, Nonlinear functional analysis. CRC Press, 1969.
[38] M. Brookes, “The matrix reference manual,” Imperial College London,
2005.
[39] R. Bhatia, Matrix analysis, ser. Graduate Texts in Mathematics. Graduate Texts in Mathematics, Springer-Verlag New York, 2013, vol. 169.
[40] E. Avventi, “Spectral moment problems: generalizations, implementation
and tuning,” Ph.D. dissertation, KTH Royal Institute of Technology,
Stockholm, 2011.
[41] G. Baggio and A. Ferrante, “On the factorization of rational discrete-time
spectral densities,” IEEE Transactions on Automatic Control, vol. 61,
no. 4, pp. 969–981, 2016.
[42] W. B. Gordon, “On the diffeomorphisms of Euclidean space,” The
American Mathematical Monthly, vol. 79, no. 7, pp. 755–759, 1972.
[43] S. G. Krantz and H. R. Parks, The implicit function theorem: History,
theory, and applications, ser. Modern Birkhäuser Classics. Birkhäuser
Basel, 2013.

