Circumcentering the Douglas--Rachford method

Abstract: We introduce and study a geometric modification of the Douglas-Rach\-ford method called the Circumcentered-Douglas-Rachford method. This method iterates by taking the intersection of bisectors of reflection steps for solving certain classes of feasibility problems. The convergence analysis is established for best approximation problems involving two (affine) subspaces and both our theoretical and numerical results compare favorably to the original Douglas-Rachford method. Under suitable conditions, it is shown that the linear rate of convergence of the Circumcentered-Douglas-Rachford method is at least the cosine of the Friedrichs angle between the (affine) subspaces, which is known to be the sharp rate for the Douglas-Rachford method. We also present a preliminary discussion on the Circumcentered-Douglas-Rachford method applied to the many set case and to examples featuring non-affine convex sets.

\section{Introduction}

Projection and reflection schemes are celebrated tools for finding a point in the intersection of finitely many sets~\cite{Censor:2014gb}, a basic problem in the natural sciences and engineering (see, {\em e.g.}, \cite{Bauschke:2006ej} and \cite{Combettes:1993dq}). Probably the Douglas--Rachford method (DRM) is one of the most famous and well-studied of these schemes (see, {\em e.g.},~ \cite{BCNPW14,BCNPW15, Lions:1979kk,Svaiter:2011fb,Bauschke:2016bt}). Also known as averaged alternating reflections method, it was introduced in \cite{Douglas:1956kk} and has recently gained much popularity, in part thanks to its good behavior in non-convex settings (see, {\em e.g.},~\cite{Hesse:2014gi,ABglobal,ABTcomb,ABT16,BNlocal,benoist,Borwein:2011dq,Hesse:2013cv,Phan:2016hl}).

This paper has a two-fold aim: (i) \emph{improving} the original DRM by means of a simple geometric modification, and (ii) meeting the demand of more satisfactory schemes for the many set case.

Regarding (i),  the proposed scheme is \emph{greedy} by means of distance to the solution set, that is, our iterate is the best possible point relying on successive reflections onto two subspaces.   In particular, we get an improvement  towards the solution set with respect to DRM iteration, which  arises from the average of two successive reflections. Also, we get a convergence rate at least as good as DRM's with a comparable computational effort per iteration, however with  numerical results  fairly favorable. The aim (ii) will be  treated in the last section.

To consider the problem, let $\langle \cdot, \cdot\rangle$ denote the scalar product in $\ensuremath{\mathbb R}^n$, $\|\cdot\|$ is the induced norm, that is, the euclidean vector or matrix norm, and $P_S$ denotes the orthogonal projection onto a nonempty closed and convex set $S\subset\ensuremath{\mathbb R}^n$. The reflection onto $S$ is given by means of $P_S$, namely, $R_S(x)=(2P_S-\ensuremath{\operatorname{Id}})(x)$, where $\ensuremath{\operatorname{Id}}$ stands for the identity operator. Note that $P_S(x)$ is simply the midpoint of the segment $[x,R_S(x)]$.

Our results are established for the following fundamental feasibility problem. Given two \emph{subspaces}  $U$, $V$ of $\ensuremath{\mathbb R}^n$ and any point $x\in\ensuremath{\mathbb R}^n$, we are interested in solving the \emph{best approximation problem}~\cite{Deutsch:2001fl} of finding the closest point to $x$ in $U\cap V$, {\em i.e.},
\begin{equation}\label{eq:general}
\text{Find } \bar x\in U\cap V\text{ such that } \|\bar x-x\|=\min_{w\in U\cap V} \|w-x\|.
\end{equation} For {subspaces} there exists a nice characterization of the best approximation problem above as $\bar x=P_{U\cap V}(x)$ if, and only if, $x-\bar x\in (U\cap V)^\perp$, {\em i.e.},
\[\langle x-\bar x, w\rangle =0\qquad \forall \, w\in U\cap V.\]
The classical DRM iteration at a point $x\in\ensuremath{\mathbb R}^n$ yields a new iterate $T(x)\in\ensuremath{\mathbb R}^n$ given by the midpoint between $x$ and $R_VR_U(x)$. That is, the Douglas--Rachford (DR) operator $T:\ensuremath{\mathbb R}^n\rightarrow\ensuremath{\mathbb R}^n$ designed to solve \eqref{eq:general} reads as follows
\[T=T_{U,V}\coloneqq \frac{\ensuremath{\operatorname{Id}}+R_VR_U}{2}.\]
It is known that, under suitable assumptions, DRM generates a sequence $\{T^k(x)\}_{k\in\ensuremath{\mathbb N}}$ converging to the solution of the best approximation problem \eqref{eq:general} (see~\cite{BCNPW14}).

Let us now introduce our scheme, called the Circumcentered--Douglas--Rachford method (C--DRM): from a point $x\in\ensuremath{\mathbb R}^n$ the next iterate is the circumcenter of the triangle of vertexes $x$, $y\coloneqq R_U(x)$ and $z\coloneqq R_VR_U(x)$, denoted by
\begin{equation}\label{CDR-op}C_T(x)\coloneqq\circum\{x,y,z\}.\end{equation}
By circumcenter we mean that $C_T(x)$ is equidistant to $x$, $y$ and $z$ and lies on the affine space defined by these vertexes. For all $x\in\ensuremath{\mathbb R}^{n}$, $C_T(x)$ exists, is unique  and  elementary computable. Existence and uniqueness are obvious if the cardinality of the set $\{x,y,z\}$ is either $1$ or  $2$. In fact, if it happens that $x=y=z$, we have $C_T(x)=x\in U\cap V$ already --- the converse is also true, that is, if $C_T(x)=x$, then $x=y=z$. This means that the set of fixed points $\ensuremath{\operatorname{Fix}} C_T$ of the (nonlinear) operator  $C_T$ is equal to $U\cap V$. If the cardinality $\{x,y,z\}$ is $2$ then $C_T(x)$ is the midpoint between the two distinct points. If $x$, $y$ and $z$  are distinct both existence and uniqueness follow from elementary geometry. Thus, one would only have to worry about having a situation in which  $x$, $y$ and $z$  are simultaneously distinct and collinear. This cannot happen since  reflections onto subspaces are norm preserving. More than that, will further see that the distance of $x$, $y$ and $z$ to $U\cap V$ is exactly the same. Thus, the equidistance we are asking for in \eqref{CDR-op} turns out to be a necessary condition for a solution of \eqref{eq:general}.

Note that C--DRM has indeed a $2$-dimensional search flavor: we will show that $C_T(x)$ is the closest point to $U\cap V$ belonging to $\ensuremath{\operatorname{aff}}\{x,y,z\}$, the affine space defined by $x$, $y$ and $z$, whose dimension is equal to $2$, if $x$, $y$ and $z$, are distinct. This property, together with the fact that the DR point $T(x)\in\ensuremath{\operatorname{aff}}\{x,y,z\}$, is the key to proving a better performance of C--DRM over DRM. An immediate consequence of this nice interpretation is that C--DRM will solve problems in $\ensuremath{\mathbb R}^2$ in at most two steps.  Figure~\ref{figure2} serves as an intuition guide and illustrates our idea.

\begin{figure}[h!]
	\centering
\includegraphics[width=.37\textwidth]{DRC-ExSphere2.pdf}
	 \caption{Geometrical interpretation for circumcentering DRM}
	\label{figure2}
\end{figure}

This paper is organized as follows. In Section 2 we derive the convergence analysis proving that C--DRM has a rate of convergence for solving problem \eqref{eq:general} at least as good as  DRM's. Section 3 presents numerical experiments for subspaces along with some non-affine examples in $\ensuremath{\mathbb R}^2$. Final remarks as how one can adapt C--DRM for the many set case and other comments on future work are presented in Section 4.

\section{Convergence analysis of the Circumcentered--Douglas--Rachford method}

In this section we present the theoretical advantages of using C--DRM over the classical DRM iteration for solving \eqref{eq:general}.

In order to simplify the presentation we recall and fix some notation. For a point $x\in \ensuremath{\mathbb R}^n$, we denote for now on  $y\coloneqq R_U(x)$ and  $z\coloneqq R_VR_U(x)$. Recall that, at the point $x\in\ensuremath{\mathbb R}^n$, we define the C--DRM iteration as  $$C_T(x)\coloneqq  {\rm circumcenter}\{x,y,z\}$$ and the DR iteration (at the same point) is given by \[T(x)\coloneqq \frac{\ensuremath{\operatorname{Id}}+R_VR_U}{2}(x)=\frac{x+z}{2}.\]
In the following we present some elementary facts \cite[Theorem 5.8]{Deutsch:2001fl} needed throughout the text.

\begin{proposition}\label{Fato}
Let $S$ be a given subspace and $x \in\ensuremath{\mathbb R}^n$ arbitrary but fixed. Then, for all $s\in S$ we have:
\begin{enumerate}
\item$ \langle x-P_S(x), s \rangle=0$;
\item $\|x-P_S(x)\|^2=\|x-s\|^2-\|s-P_S(x)\|^2$;
\item $\|x-s\|=\|R_S(x)-s\|$;
\item The projection and reflection mappings $P_S$ and $R_S$ are linear.
\end{enumerate}
\end{proposition}

Our first lemma states that the projection of $y$ and $z$ onto $U\cap V$ coincide with $P_{U\cap V}(x)$ and that the distances of $x,y$ and $z$ to $U\cap V$ are the same. In addition to that, we have that the projection of the DR point $T(x)$ onto $U\cap V$ is as well given by $P_{U\cap V}(x)$.

\begin{lemma}\label{projecion2}
Let $x\in \ensuremath{\mathbb R}^n$. Then,  \[ P_{U\cap V}(x)=P_{U\cap V}(y)=P_{U\cap V}(z)\] and \begin{equation}\label{distanciaT}\dist (x,U\cap V)=\dist (y,U\cap V)=\dist (z,U\cap V).\end{equation}
Moreover,  $P_{U\cap V}(x)=P_{U\cap V}(T(x))$ and \[P_{U\cap V}(T^k(x))\coloneqq P_{U\cap V}(\underbrace{T(\cdots T(T}_{k}(x))\cdots )).\]
\end{lemma}
\begin{proof} We consider a bar to denote the projection onto the subspace $U \cap V$, {\em i.e.}, $\bar x\coloneqq P_{U\cap V}(x)$, $\bar y\coloneqq P_{U\cap V}(y)$, $\bar z\coloneqq P_{U\cap V}(z)$, etc.
By using Proposition \ref{Fato}(iii) for the reflection onto $U$, we get $\|x-w\|=\|y-w\|$ for all $w\in U\cap V$. In particular, $\|x-\bar y\|= \|y-\bar y\|$ and $\|y-\bar x\|= \|x-\bar x\|$ since $\bar x, \bar y \in U\cap V$. Therefore,
$$\|x-\bar x\|\le \|x-\bar y\|=  \|y-\bar y\|\le  \|y-\bar x\|= \|x-\bar x\|,$$ which implies $$\|x-\bar x\|= \|x-\bar y\|= \|y-\bar x\|=  \|y-\bar y\|,$$
and, of course, $\dist (x,U\cap V)=\dist (y,U\cap V)$ and $P_{U\cap V}(x)=P_{U\cap V}(y)$ follow.

Now, the statements $\dist (y,U\cap V)=\dist (z,U\cap V)$ and $P_{U\cap V}(y)=P_{U\cap V}(z)$ can be derived by repeating the same argument with $y$ and $z$, where Proposition \ref{Fato}(iii) is then considered for the reflection onto $V$. As the projection onto subspaces is linear (Proposition \ref{Fato}(iv)) and $T(x)\coloneqq \frac{x+z}{2}$, we have $$P_{U\cap V}(T(x))=P_{U\cap V}\left(\frac{x+z}{2}\right)=\frac{P_{U\cap V}(x)}{2}+\frac{P_{U\cap V}(z)}{2}=\frac{\bar x}{2}+\frac{\bar x}{2}=\bar x.$$ The rest of the proof follows inductively.

Indeed, we proved $P_{U\cap V}(s)=P_{U\cap V}(T(s))$ for all $s\in\ensuremath{\mathbb R}^n$. Then, by setting $s\coloneqq T^{k-1}(x)$, we get $$P_{U\cap V}(T^{k-1}(x))=P_{U\cap V}(T(T^{k-1}(x)))=P_{U\cap V}(T^k(x)),$$ proving the lemma.
\end{proof}

We proceed by characterizing $C_T(x)$ as the projection of any point $w\in U\cap V$ onto the affine subspace defined by $x,y$ and $z$ denoted by  $\ensuremath{\operatorname{aff}}\{x,y,z\}$.

\begin{lemma}\label{circum-as-proj}
Let $x\in \ensuremath{\mathbb R}^n$ and $W^x\coloneqq \ensuremath{\operatorname{aff}}\{x,y,z\}$. Then, $$P_{W^x}(w)=C_T(x),$$ for all $w\in U\cap V$. In particular, $P_{W^x}(P_{U\cap V}(x))=C_T(x)$.
\end{lemma}
\begin{proof}
Let $w\in U\cap V$ be given and set $p\coloneqq P_{W^x}(w)$. Recall that $C_T(x)$ is defined by being the only point in $W^x$ equidistant to $x$, $y$ and $z$. So, to prove the lemma, we just need to show that $p$ is equidistant to $x$, $y$ and $z$. By Proposition~\ref{Fato}(ii) we have
\[
\begin{aligned}
\|x-p\|^2 &=\|x-w\|^2-\|w-p\|^2,\\
\|y-p\|^2 &=\|y-w\|^2-\|w-p\|^2,\\
\|z-p\|^2 &=\|z-w\|^2-\|w-p\|^2.
\end{aligned}
\]
Proposition \ref{Fato}(iii) and Lemma \ref{projecion2} provided $\|x-w\|=\|y-w\|=\|z-w\|$. Hence,  the above equalities imply $\|x-p\|=\|y-p\|=\|z-p\|$, which proves the result.
\end{proof}

We have just seen that $C_T(x)$ is the closest point in $W^x=\ensuremath{\operatorname{aff}}\{x,y,z\}$ to $U\cap V$. In particular, the circumcenter $C_T(x)$ lies at least as close to $U\cap V$ as the DR point $T(x)$.

The next result shows that compositions of $C_T(\cdot)$ do not change the projection onto $U\cap V$, that is, for any $x\in\ensuremath{\mathbb R}^n$ and $k\in\ensuremath{\mathbb N}$ we have $$P_{U\cap V}(C^k_T(x)):=P_{U\cap V}(\underbrace{C_T(\cdots C_T(C_T}_{k}(x))\cdots ))=P_{U\cap V}(x).$$ This is a usual feature of algorithms designed to solve best approximation problems.

\begin{lemma}\label{xc-proj}
Let $x\in \ensuremath{\mathbb R}^n$ and $k\in\ensuremath{\mathbb N}$. Then, $$P_{U\cap V}(C_T^k(x))=P_{U\cap V}(C_T(x))=P_{U\cap V}(x).$$
\end{lemma}
\begin{proof} Note that by proving the second equality, the first follows easily by induction on $k$, likewise the one in the proof of Lemma \ref{projecion2}. Therefore, let us prove that $P_{U\cap V}(C_T(x))=P_{U\cap V}(x)$. Consider again the abbreviation $\bar x\coloneqq P_{U\cap V}(x)$ and $\bar x_c\coloneqq P_{U\cap V} (C_T(x))$. From Lemma \ref{circum-as-proj} we have that $P_{W^x}(\bar x)=C_T(x)$ and also $P_{W^x}(\bar x_c)=C_T(x)$. Thus, by Pythagoras it follows that
\begin{align}
\|x-\bar x\|^2   &=\|x-C_T(x)\|^2+\|\bar x-C_T(x)\|^2, \label{(1)}\\
\|x-\bar x_c\|^2 &=\|x-C_T(x)\|^2+\|\bar x_c-C_T(x)\|^2. \label{(2)}
\end{align}
Now, using again Pythagoras, for the triangles with vertexes $x$, $\bar x$, $\bar x_c$ and $C_T(x)$, $\bar x_c$, $\bar x$, we get
\begin{align}\label{(3)}\|x-\bar x_c\|^2& =\|\bar x-\bar x_c\|^2+\|x-\bar x\|^2\\
\intertext{and}
\label{(4)}\|C_T(x)-\bar x\|^2 &=\|\bar x-\bar x_c\|^2+\|C_T(x)-\bar x_c\|^2.
\end{align}
Then, we obtain
\[
\|\bar x-\bar x_c\|^2=\|x-\bar x_c\|^2-\|x-\bar x\|^2=\|\bar x_c-C_T(x)\|^2-\|\bar x-C_T(x)\|^2=-\|\bar x-\bar x_c\|^2,
\] where the first equality follows from \eqref{(3)}, the second from subtracting \eqref{(1)} and \eqref{(2)} and the third follows from \eqref{(4)}. Thus, $\|\bar x-\bar x_c\|=0$, or equivalently, $\bar x=\bar x_c$.
\end{proof}

Note that Lemma~\ref{xc-proj} is related to  \emph{Fej\'er monotonicity} (see  \cite[Proposition 5.9 (i)]{BC2011}).

We will now measure the improvement of $C_T(x)$ towards $U\cap V$ by means of $x$ and $T(x)$.

\begin{lemma}\label{o-melhor}
For each $x\in \ensuremath{\mathbb R}^n$ we have
\begin{equation}\label{(21)}\dist (C_T(x), U\cap V)^2= \dist (T(x), U\cap V)^2-\|T(x)-C_T(x)\|^2.
\end{equation}
In particular,
\begin{equation*}\label{(20)}\dist (C_T(x), U\cap V)=\|C_T(x)-P_{U\cap V}(x)\|\leq \|T(x)-P_{U\cap V}(x)\|=\dist (T(x), U\cap V).
\end{equation*}
\end{lemma}
\begin{proof}
Lemma \ref{circum-as-proj} says in particular that $P_{W^x}(P_{U\cap V}(x))=C_T(x)$, which is equivalent to saying that $\scal{s-C_T(x)}{P_{U\cap V}(x)-C_T(x)}=0$ for all $s$ on the affine subspace $W^x$. Now, taking $T(x)$ for the role of $s$ and using Pythagoras, we get \eqref{(21)}, since $P_{U\cap V}(C_T(x))=P_{U\cap V}(T(x))=P_{U\cap V}(x)$ due to Lemmas \ref{projecion2} and  \ref{xc-proj}. The rest of the result is direct consequence of Lemmas \ref{xc-proj} and \ref{projecion2}.
\end{proof}

The linear rate of convergence we are going to derive for C--DRM is given by the cosine of the Friedrichs angle between $U$ and $V$, defined below.

\begin{definition}
The \emph{cosine of the Friedrichs angle} $\theta_F$
between $U$ and $V$ is given by
\begin{equation*}
c_F(U,V) \coloneqq  \sup \menge{\scal{u}{v}}{u\in U\cap (U\cap
V)^\perp,\; v\in V\cap (U\cap V)^\perp,\;
\|u\|\leq 1,\; \|v\|\leq 1}.
\end{equation*}
If context permits, we use just $c_F$ instead of $c_F(U,V)$.
\end{definition}

 Next we state some fundamental properties of the Friedrichs angle.

\begin{proposition}
\label{f:angle}
Let $U,V\subset\ensuremath{\mathbb R}^n$ be subspaces, then:
\begin{enumerate}

\item
\label{f:angleSolmon}
$0\le c_F(U,V) =c_F(V,U)= c_F(U^\perp,V^\perp)<1$.
\item
\label{f:angle3}
{$c_F=\|P_VP_U-P_{U\cap V}\|=\|P_{V^\perp}P_{U^\perp}-P_{U^\perp\cap V^\perp}\|$}.
\end{enumerate}
\end{proposition}

\begin{proof}
(i) See \cite[Theorems 13 and 16]{Deutsch:1995ja}; (ii): See \cite[Lemma 9.5(7)]{Deutsch:2001fl}.
\end{proof}

The following result is an elementary fact in Linear Algebra and will be used in sequel.

\begin{proposition}\label{MidpointSubspace}
Let a subspace $S\subset\ensuremath{\mathbb R}^n$ be given. If $x,p\in \ensuremath{\mathbb R}^n$ are such that their midpoint $$s \coloneqq \frac{x+p}{2}\in S,$$ then $\dist (x,S)=\dist (p,S)$.
\end{proposition}
\begin{proof}
Let $s\coloneqq\frac{x+p}{2}\in S$, $\hat x\coloneqq P_S(x)$ and $\hat p\coloneqq P_S(p)$. Set $\tilde p \coloneqq  \hat x+2(s-\hat x)\in S$ and note that $\tilde p$ is defined in such a way that the triangle with vertexes $x$, $\hat x$ and $s$ is congruent to the triangle formed by $p$, $\tilde p$ and $s$. In particular, $\|\tilde p-p\|=\|x-\hat x\|$.
Therefore,
\begin{equation}\label{eq:MiddlePointSubspaces}
\|\hat p-p \|\leq\|\tilde p-p \|=\|x-\hat x\|.
\end{equation}
An analogous construction can be considered for the triangle with vertexes $p$, $\hat p$ and $s$ and the one with vertexes $x$, $\tilde x$ and $s$, where $\tilde x \coloneqq  \hat p+2(s-\hat p)\in S$, yielding $\|\hat x-x \|\leq\|\tilde x-x \|=\|p-\hat p\|$. This, combined with \eqref{eq:MiddlePointSubspaces}, proves the proposition.
\end{proof}

The next lemma organizes and summarizes known properties of sequences generated by DRM, some of which will be important in the proof of our main theorem. It is worth noting that items (i) and (vi) are novel to our knowledge.

\begin{lemma}\label{AnyInitialPointDR}
Let $x\in \ensuremath{\mathbb R}^n$ be given. Then, the following assertions for DRM hold:
\begin{enumerate}
	\item   $\dist (T^k(x), U+V)=\dist (x, U+V)$ for all $k\in \ensuremath{\mathbb N}$, where $U+V =\ensuremath{\operatorname{span}}(U\cup V)$;
	\item The set $\ensuremath{\operatorname{Fix}} T\coloneqq \menge{x\in\ensuremath{\mathbb R}^n}{T(x)=x}$ is given by $\ensuremath{\operatorname{Fix}} T =  (U\cap V)\oplus(U^\perp\cap V^\perp)$;
	\item The DRM sequence $\{T^k(x)\}_{k\in\ensuremath{\mathbb N}}$ converges to $P_{\ensuremath{\operatorname{Fix}} T}(x)$ and for all $k\in \ensuremath{\mathbb N}$, $$\|T^k(x)-P_{\ensuremath{\operatorname{Fix}} T}(x)\|\leq c^k_F\|x-P_{\ensuremath{\operatorname{Fix}} T}(x)\|;$$
	\item For all $k\in \ensuremath{\mathbb N}$ we have $P_{U\cap V}(T^k(x))=P_{U\cap V}(x)$ and $P_{\ensuremath{\operatorname{Fix}} T}(T^k(x))=P_{\ensuremath{\operatorname{Fix}} T}(x)$;
	\item $P_{U\cap V}(x)=P_{\ensuremath{\operatorname{Fix}} T}(x)$ if, and only if, $x\in  U+V$;
	\item The DRM sequence $\{T^k(x)\}_{k\in\ensuremath{\mathbb N}}$ converges to $P_{U\cap V}(x)$ if, and only if, \[x\in  U+V;\]

	\item The shadow sequences \[\{P_U(T^k(x))\}_{k\in\ensuremath{\mathbb N}}\text{ and }\{P_V(T^k(x))\}_{k\in\ensuremath{\mathbb N}}\] converge to $P_{U\cap V}(x)$.

\end{enumerate}
\end{lemma}
\begin{proof}
For the sake of notation set $S\coloneqq U+V$ and remind that $y\coloneqq R_U(x)$ and $z\coloneqq R_V(y)$. We have $\frac{1}{2}(x+y)=P_U(x)\in S$ and $\frac{1}{2}(y+z)=P_V(y)\in S$. Employing Proposition \ref{MidpointSubspace} yields $\dist (x,S)=\dist (y,S)=\dist (z,S)$.
Also, $\frac{1}{2}(T(x)+y)= \frac{1}{2}(\frac{x+z}{2}+y) = \frac{1}{2}(P_U(x)+P_V(y))\in S$. Using again Proposition \ref{MidpointSubspace} we conclude that $\dist (T(x),S)=\dist (y,S)$. Hence, $\dist (T(x),S)=\dist (x,S)$ for all $x\in\ensuremath{\mathbb R}^n$. A simple induction procedure gives us $\dist (T^k(x), U+V)=\dist (x, U+V)$ for all $k\in \ensuremath{\mathbb N}$, proving (i).

The proofs of items (ii), (iii), (iv) and (vii)  are  in \cite{BCNPW14}.

It is straightforward to check that $S^\perp=U^\perp\cap V^\perp$. Therefore, $\ensuremath{\operatorname{Fix}} T$ specialized to $S$ reduces to $U\cap V$ and (v) follows. (vi) is a combination of (ii) and (v).
\end{proof}

We are now in the position to present our main convergence result, which states that the best approximation problem \eqref{eq:general} can be solved for any point $x\in\ensuremath{\mathbb R}^n$ with usage of C--DRM.

\begin{theorem}\label{TeoremaSpan}
Let $x\in\ensuremath{\mathbb R}^n$ be given. Then, the three C--DRM sequences \[\{C_T^k(P_U(x))\}_{k\in\ensuremath{\mathbb N}}, \{C_T^k(P_V(x))\}_{k\in\ensuremath{\mathbb N}} \text{ and } \{C_T^k(P_{ U+V}(x))\}_{k\in\ensuremath{\mathbb N}}\] converge linearly to $P_{U\cap V}(x)$. Moreover, their rate of convergence is at least the cosine of the Friedrichs angle $c_F\in[0,1)$.
\end{theorem}
\begin{proof}
Obviously, $u, v, s\in  U+V$, with $u \coloneqq P_U(x)$, $v \coloneqq P_V(x)$ and $s\coloneqq P_{ U+V}(x)$. Let us first prove that $\bar u=\bar v=\bar x \coloneqq P_{U\cap V}(x)$, where $\bar u \coloneqq P_{U\cap V}(u)$, $\bar v \coloneqq P_{U\cap V}(v)$ and $\bar s \coloneqq P_{U\cap V}(s)$. The definition of $\bar u,\bar x$ allow us to employ Pythagoras and conclude that
$$
\|u-x\|^2+\|u-\bar x\|^2=\|x-\bar x\|^2 \leq \|x-\bar u\|^2=\|u-x\|^2+\|u-\bar u\|^2,
$$
which provides $\|u-\bar x\|=\|u-\bar u\|$. Thus $\bar u=\bar x$. We get $\bar v=\bar s=\bar x$ analogously, and by item (v) of Lemma \ref{AnyInitialPointDR} we further have $\bar u=P_{\ensuremath{\operatorname{Fix}} T}(u)=\bar v=P_{\ensuremath{\operatorname{Fix}} T}(v)=\bar s=P_{\ensuremath{\operatorname{Fix}} T}(s)=\bar x$.
Hence, it holds that
\begin{align*}
\|C_T(u)-\bar x\|=\|C_T(u)-\bar u\| & \leq \|T(u)-\bar u\|=\|T(u)-P_{\ensuremath{\operatorname{Fix}} T}(u)\| \\
                                    & \leq c_F \|u-P_{\ensuremath{\operatorname{Fix}} T}(u)\|=c_F \|u-\bar x\|,
\end{align*}
where the first inequality is by Lemma~\ref{o-melhor} and the second one by item (iii) of Lemma~\ref{AnyInitialPointDR}.
Recall that Lemma \ref{xc-proj} stated that $P_{U\cap V}(C_T^k(P_U(x)))=P_{U\cap V}(P_U(x))$ for all $k\in\ensuremath{\mathbb N}$. So, $P_{U\cap V}(C_T^k(u))=P_{U\cap V}(u)=\bar x$ for all $k\in \ensuremath{\mathbb N}$. Consider now the induction hypothesis $\|C_T^{k-1}(u)-\bar x\|\leq c_F^{k-1}\|u-\bar x\|$ for some $k-1$ --- the case $k-1=1$ was seen above --- and note that
\begin{align*}
\|C_T^k(u)-\bar x\| &=\|C_T(C_T^{k-1}(u))-P_{U\cap V}(C_T^{k-1}(u))\| \\
                    & \leq  \|T(C_T^{k-1}(u))-P_{U\cap V}(C_T^{k-1}(u))\|
                    \\
                    &
                    \leq c_F \|C_T^{k-1}(u)-P_{U\cap V}(C_T^{k-1}(u))\| \\
                    & = c_F \|C_T^{k-1}(u) -\bar x\|

                    \leq c_Fc_F^{k-1}\|u-\bar x\|=c_F^k\|u-\bar x\|,
\end{align*}
where the first inequality is due to Lemma~\ref{o-melhor}. The second inequality above follows from Lemma \ref{AnyInitialPointDR} (iii) and (v), since $u\in U+V$, and the third is by the induction hypothesis. This proves the theorem for the sequence $\{C_T^k(P_U(x))\}$. The proof lines for the convergence of the sequences $\{C_T^k(P_V(x))\}$ and $\{C_T^k(P_{ U+V}(x))\}$ with the linear rate $c_F$ are analogous.
\end{proof}

An immediate consequence is stated below.

\begin{corollary}\label{CorolSpan}
Let $x\in U+V$ be given. Then, the C--DRM sequence $\{C_T^k(x)\}_{k\in\ensuremath{\mathbb N}}$ converges linearly to $P_{U\cap V}(x)$. Moreover, the rate of convergence is at least the cosine of the Friedrichs angle $c_F\in[0,1)$.
\end{corollary}

Although we believe that Theorem \ref{TeoremaSpan} holds for $\{C_T^k(x)\}$ itself, it is worth mentioning that considering the initial feasibility step $P_U(x)$ or $P_V(x)$ is totally reasonable, since we are assuming that the projection/reflection operators $P_U$, $P_V$, $R_U$ and $R_V$ are available. In addition to that, these feasibility steps keep the whole C--DRM sequence in $ U+V$, which can be very desirable. In this sense, let us look at two distinct lines $U,V\subset\ensuremath{\mathbb R}^3$ intersecting at the origin and assume that their Friedrichs angle is not ninety degrees, {\em i.e.}, $c_F\in(0,1)$. C--DRM finds the origin after one or two steps when starting in $ U+V$, since $U+V$ is the plane containing the two lines. If the initial point is not in $ U+V$ and no feasibility step is taken, C--DRM may generate an infinite sequence. Therefore, running C--DRM in $ U+V$, a potentially smaller set than $\ensuremath{\mathbb R}^n$, sounds attractive from the numerical point of view.

The  feasibility procedure employed in Theorem~\ref{TeoremaSpan} provides convergence to best approximation solutions for the DRM without the need of considering shadow sequences. This is formally presented in the following.

\begin{corollary}\label{CorolDRM-feasible}
Let $x\in \ensuremath{\mathbb R}^{n}$ be given. Then, the three DRM sequences
\[\{T^k(P_U(x))\}_{k\in\ensuremath{\mathbb N}},\; \{T^k(P_V(x))\}_{k\in\ensuremath{\mathbb N}} \; \text{ and }\;  \{T^k(P_{ U+V}(x))\}_{k\in\ensuremath{\mathbb N}}
\] converge linearly to $P_{U\cap V}(x)$. Moreover, their rate of convergence is  given by the cosine of the Friedrichs angle $c_F\in[0,1)$.
\end{corollary}

\begin{proof} This result follows from the fact that  $P_{ U\cap V}(P_U(x))=P_{ U\cap V}(P_V(x))=P_{ U\cap V}(P_{U+V}(x)) = P_{ U\cap V}(x) $, established within the proof of Theorem~\ref{TeoremaSpan}, combined with Lemma~\ref{AnyInitialPointDR} (vi).
\end{proof}

It is known that $c_F$ is the sharp rate for DRM \cite{BCNPW14}. This is not clear for C--DRM though and left as an open question in this work. One way of addressing this issue would be looking at the magnitude of improvement of C--DRM over DRM given by \eqref{(21)} in Lemma \ref{o-melhor}.

We finish this section by showing that Theorem~\ref{TeoremaSpan} and Corollaries~\ref{CorolSpan} and~\ref{CorolDRM-feasible} are applicable to affine subspaces with nonempty intersection, where the concept of the cosine of the Friedrichs angle is suitably extended.

\begin{corollary}\label{corol:affine-extension}
Let $A$ and $B$ be affine subspaces of $\ensuremath{\mathbb R}^n$ with nonempty intersection and $p\in A\cap B$   arbitrary but fixed. Then, Theorem~\ref{TeoremaSpan} and Corollaries~\ref{CorolSpan} and~\ref{CorolDRM-feasible}  hold for $A$ and $B$, with the rate $c_F$ being the cosine of the Friedrichs angle between the subspaces $U_A\coloneqq A-\{p\}$ and $V_B\coloneqq B-\{p\}$.
\end{corollary}

\begin{proof}
Since $p\in A\cap B$, the translations $A-\{p\}$ and $B-\{p\}$ provide nonempty subspaces $U_A$ and $V_B$. Now, the elementary translation properties of reflections $R_{U_A}(x)+p=R_A(x+p)$ and $R_{V_B}(x)+p=R_B(x+p)$ give us the translation formulas for the correspondent Douglas-Rachford and circumcentering  operators:
\[
T_{A,B}(x+p)\coloneqq T_{U_A,V_B}(x)+p
\]
and
\[
C_{T_{A,B}}(x+p)\coloneqq C_{T_{U_A,V_B}}(x)+p,
\]
for all $x\in\ensuremath{\mathbb R}^n$. This suffices to prove the corollary when setting $U\coloneqq U_A$ and $V\coloneqq V_B$ in Theorem~\ref{TeoremaSpan} and Corollaries~\ref{CorolSpan} and~\ref{CorolDRM-feasible}, because the above formulas imply that $ T_{A,B}^k(x+p)= T_{U_A,V_B}^k(x)+p$ and $C_{T_{A,B}}^k(x+p)= C_{T_{U_A,V_B}}^k(x)+p$,  for all $k\in \ensuremath{\mathbb N}$.

\end{proof}

Simple manipulations let us conclude that $c_F= c_F(U_A,V_B)$, with $U_A$ and $V_B$ as above, does not depend on the particular choice of the  point $p$ in $A\cap B$. Therefore, $c_F$ can be referred to as the cosine of the Friedrichs angle between the affine subspaces $A$ and $B$ with no ambiguity.

We finish this section remarking that the computation of circumcenters is possible in arbitrary inner product spaces --- see~\eqref{eq:xc-linsys}. However, projecting/reflecting onto subspaces depends on their closedness. Now, in Hilbert spaces, it is well known that having  $c_F$ strictly smaller than $1$ is equivalent to asking $U+V$ to be closed~\cite[Theorem 13]{Deutsch:1995ja}. This is an   assumption that maintains  the linear convergence in Hilbert spaces for several projection/reflection methods and that would also enable us to extend our main results concerning C--DRM  to an infinite dimensional setting.

The following section is on numerical experiments and begins by showing how one can compute $C_T(x)$ by means of elementary and cheap Linear Algebra operations.

\section{Numerical experiments}\label{NI}

In this section, we make use of numerical experiments to show, as a proof of concept, that the good theoretical proprieties of $C_T(x)$ are also working in practical problems.

First, for a given point $x\in \ensuremath{\mathbb R}^{n}$, we establish a procedure to find $C_T(x)$. We then discuss the stopping criteria used in our experiments and show the performance of C--DRM compared to DRM applied to problem \eqref{eq:general}. We also apply C--DRM and DRM to non-affine samples, which are not treated theoretically in the previous section. The experiments with these problems indicate as well a good behavior of C--DRM over DRM.    All experiments were performed using \texttt{julia}~\cite{Bezanson:2017gd} programming language and the pictures were generated using PGFPlots~\cite{Feuersanger:2016ut}.

\subsection{How to compute the circumcenter in $\ensuremath{\mathbb R}^n$}

In order to compute $C_T(x)$, recall that $y \coloneqq  R_{U}(x)$ and $z \coloneqq  R_{V}(y) = R_{V}R_{U}(x)$. We have already mentioned that $C_T(x) = x$ if, and only if, the  cardinality of  $\ensuremath{\operatorname{aff}}\{x,y,z\}$ is 1. If this cardinality is 2, $C_T(x)$ is the midpoint between the two distinct points.

Therefore, we will focus on the computation of $C_T(x)$ for the case where $x$, $y$ and $z$ are distinct.  According to Lemma~\ref{circum-as-proj},  $C_T(x)$ is still well defined, and it can be seen as the circumcenter of the triangle $\Delta xyz$ formed by the points $x$, $y$ and $z$, as illustrated in Figure~\ref{figure1}. Also, $T(x)$ lies in $\ensuremath{\operatorname{aff}}\{x,y,z\}$.
\begin{figure}[h!]
	\centering
\includegraphics[width=.41\textwidth]{DRC-ExPlane2.pdf}
	 \caption{Circumcenter on the affine subspace $\ensuremath{\operatorname{aff}}\{x,y,z\}$.}
\label{figure1}
\end{figure}

Let $x$ be \emph{the anchor} point of our framework and define $s_{U}\coloneqq y-x$ and $s_{V}\coloneqq z-x$, the vectors  pointing from $x$ to $y$ and from $x$ to $z$, respectively. Note that $\ensuremath{\operatorname{aff}}\{x,y,z\} = x + \ensuremath{\operatorname{span}}\{s_{U},s_{V}\}$, and since $C_T(x)\in \ensuremath{\operatorname{aff}}\{x,y,z\}$, the dimension of the ambient space, namely $n$, is irrelevant to the geometry. The problem is \emph{intrinsically} a $2$-dimensional one, regardless of what $n$ is.

We want to find the vector  $s\in \ensuremath{\operatorname{aff}}\{x,y,z\}$, whose projection onto each vector   $s_{U}$ and $s_{V}$   has its endpoint at the midpoint of the line segment from $x$ to $y$ and $x$ to $z$, that is,
\[
P_{\ensuremath{\operatorname{span}}\{s_U\}}(s) = \frac{1}{2}s_U \quad \text{ and } \quad P_{\ensuremath{\operatorname{span}}\{s_V\}}(s) = \frac{1}{2}s_V.
\]
This requirement yields
\begin{equation*}
	\begin{cases}
	\left\langle s_U,s\right\rangle = \frac{1}{2} \|s_U\|^2,\\

	\left\langle s_V,s\right\rangle = \frac{1}{2} \|s_V\|^2.
		\end{cases}
\end{equation*}
By writing $s=\alpha s_U + \beta s_V$ we get the $2\times 2$ linear system with unique solution $(\alpha,\beta)$
\begin{equation}
  \label{eq:xc-linsys}
  \begin{cases}
  \alpha\| s_U\|^2 +   \beta\left\langle s_U,s_V\right\rangle  = \frac{1}{2} \|s_U\|^2,\\
   \alpha\left\langle s_U,s_V\right\rangle  + \beta\| s_V \|^2= \frac{1}{2} \|s_V\|^2.
    \end{cases}
\end{equation}
Hence,
\[C_T(x) = x + \alpha s_U + \beta s_V.\]
Note that \eqref{eq:xc-linsys} enables us to calculate $C_T(x)$ in arbitrary inner product spaces.

\subsection{The case of two subspaces}

In our experiments we randomly generate $100$ instances with subspaces $U$ and $V$ in $\ensuremath{\mathbb R}^{200}$ such that $U\cap V\neq \{0\}$. Each instance is run for $20$ initial random points. Based on  Theorem~\ref{TeoremaSpan} and Corollary~\ref{CorolDRM-feasible}, we monitor the  C--DRM sequence $\{C_T^k(P_V(x))\}$ and the DRM sequence $\{T^k(P_V(x))\}$. Note that the DRM sequence will always converge to $U\cap V$, since $P_V(x)\in  U+V$. For the C--DRM sequence, such hypothesis does not seem to be necessary, however for the sake of fairness, we choose to monitor this sequence in the same way. We incorporate the method of alternating projections (MAP) (see, \emph{e.g.}, \cite{Deutsch:1985gz}) in our experiments as well. MAP generates a sequence $\{(P_VP_U)^k(x)\}$ that lies automatically in $ U+V$ for all $k\geq 1$.

Let $\{s^k\}$ be any of the three sequences that we monitor. We considered two tolerances
\[
\varepsilon_1 \coloneqq 10^{-3} \text { and } \varepsilon_2 \coloneqq 10^{-6},
\]
and employed two stopping criteria:
\begin{itemize}
	\item the \emph{true error}, given by
$
\|s^k - \bar x\|< \varepsilon_{i};
$
and
\item the \emph{gap distance}, given by
$
\|P_U(s^k) - P_V(s^k)\|< \varepsilon_{i},
$
for $i=1,2$.
\end{itemize}
We performed tests with two tolerances in order to challenge C--DRM by asking for more precision.
Also, one can view the \emph{true error} as the best way to assure one is sufficiently close to $U\cap V$, and in our case $\bar x\coloneqq P_{U\cap V}(x)$ is easily available. However, this is not the case in applications, thus, we also utilized the \emph{gap distance}, which we consider a reasonable measure of infeasibility.

In order to represent the results of our numerical experiments, we used the Performance Profiles~\cite{Dolan:2002du}, a analytic tool that allows one to compare several different algorithms on a set of problems with respect to a performance measure or \emph{cost}, which in our case is the number of iterations, providing the visualization and interpretation of the results of benchmark experiments.  The rationale of choosing number of iterations  as performance measure here is that in each of the sequences that are monitored, the majority of the computational cost involved is equivalent ---  two orthogonal projections onto the subspaces $U$ and $V$ per iteration have to be computed for each method. The graphics  were generated using \texttt{perprof-py}~\cite{Siqueira:2016ej}.

\begin{figure}[!ht]
\begin{subfigure}[t]{0.490\textwidth}
\centering
\includegraphics[width=\textwidth]{DRM-C_DRM_MAP-N200Samp100_1E-03_true.pdf}
	 \caption{\label{fig:pp-twosubspaces1}}
\end{subfigure}
  \,
\begin{subfigure}[t]{0.490\textwidth}
\centering
\includegraphics[width=\textwidth]{DRM-C_DRM_MAP-N200Samp100_1E-06_true.pdf}
	 \caption{\label{fig:pp-twosubspaces2}}

    \end{subfigure}
\\
    \begin{subfigure}[t]{0.490\textwidth}
    \centering
    \includegraphics[width=\textwidth]{DRM-C_DRM_MAP-N200Samp100_1E-03_gap.pdf}
    	 \caption{\label{fig:pp-twosubspaces3}}
    \end{subfigure}
      \,
    \begin{subfigure}[t]{0.490\textwidth}
    \centering
    \includegraphics[width=\textwidth]{DRM-C_DRM_MAP-N200Samp100_1E-06_gap.pdf}
    	 \caption{\label{fig:pp-twosubspaces4}}
    \end{subfigure}

\caption{Experiments with two subspaces.\label{fig:pp-twosubspaces}}
\end{figure}

The numerical experiments shown in Figure~\ref{fig:pp-twosubspaces}  confirm the theoretical results obtained in this paper, since C--DRM has a much better performance than DRM. For $\varepsilon_2 = 10^{-6}$, C--DRM solves all instances and choices of  initial points in less iterations than DRM, regardless the stopping criteria (See Figures~\ref{fig:pp-twosubspaces2} and \ref{fig:pp-twosubspaces4}). For  $\varepsilon_1 = 10^{-3}$, using the true error criteria, according to Figure~\ref{fig:pp-twosubspaces1} a tiny part of the instances were solved faster by DRM, however this behavior was not reproduced with the gap distance criteria (see Figure~\ref{fig:pp-twosubspaces4}). MAP has $c_F^2$  as asymptotic linear rate (see \cite{Kayalar:1988jk}) and it was beaten by C--DRM in all our instances. This gives rise to the interesting question of whether the rate $c_F^2$ can be theoretically achieved by C--DRM.
\begin{figure}[!ht]
\begin{subfigure}[t]{0.40\textwidth}
\centering
\includegraphics[height=.25\textheight]{cF_Samples_R200_SmallAngle_MAP_1E-03.pdf}
	 \caption{\label{fig:HighcF-twosubspaces1}}
\end{subfigure}
  \hspace*{.5in}
\begin{subfigure}[t]{0.40\textwidth}
\centering
\includegraphics[height=.25\textheight]{cF_Samples_R200_SmallAngle_MAP_1E-06.pdf}
	 \caption{\label{fig:HighcF-twosubspaces2}}

    \end{subfigure}

\caption{Experiments with two subspaces having a small Friederichs angle. \label{fig:HighcF-twosubspaces}}
\end{figure}

Figure~\ref{fig:HighcF-twosubspaces} represents experiments in which the Friederichs angle between the two subspaces is smaller than $10^{-2}$ and the \emph{true error} criterion is used. In this case, MAP and DRM are known to converge slowly. C--DRM, however, handled the small values of the Friederichs angle substantially better.

\subsection{Some non-affine examples}

Next we present two simple classes of examples revealing the potential of the proposed modification when it is applied to the convex and the non-convex case. Here we are using the \emph{gap distance} with $\varepsilon_2 = 10^{-6}$.

\begin{example}[Two balls in $\ensuremath{\mathbb R}^2$]
 We present three figures that depict numerical experiments showing the behavior of C--DRM over DRM concerning the problem of finding a point in the intersection of two convex balls in $\ensuremath{\mathbb R}^2$.

 Note that Lemma \ref{o-melhor} shows that $C_T(x)$ is closer to  $U\cap V$ than $T(x)$ for problem \eqref{eq:general}. Unfortunately, this is not true in general for convex sets.  Figure~\ref{fig:twoballs1}, illustrates this for two balls.  Here, $x^0$ is the starting point, $\bar x=P_{U\cap V}(x^0)$ is the only point in the intersection, $x_C^1 \coloneqq C_T(x^0)$ and $x_{DR}^1 \coloneqq T(x^0)$.
 Note however, that this does not mean that C--DRM will not work for the general case. Even though $x_{DR}^1$  is closer to  $\bar x$ than $x_C^1$ is, C--DRM performed way less iterations (37) than DRM (971) to find the solution.

Below we present two examples, in Figures~\ref{fig:twoballs2} and \ref{fig:twoballs3}, where the two balls intersection is still compact but has infinitely many points. Depending on the starting point, we  achieve different results, regarding the number of iterations that both C--DRM and DRM take to converge. Moreover, Figure~\ref{fig:twoballs2} shows that the accumulation point of the sequences generated by C--DRM and DRM are not necessarily the same, with comparable iteration complexity though. In Figure~\ref{fig:twoballs3}, DRM converged after 6 iterations while C--DRM took 7 iterations.

\begin{figure}[!ht]
\begin{subfigure}[t]{0.24\textwidth}
\centering
\frame{\includegraphics[height=.2\textheight]{xDR-C-Ex2.pdf}}
	 \caption{}
	\label{fig:twoballs1}
	\end{subfigure}
  \hspace*{.3in}
\begin{subfigure}[t]{0.24\textwidth}
\centering
\frame{\includegraphics[height=.2\textheight]{xDR-C-Ex3.pdf}}
	 \caption{}
	\label{fig:twoballs2}
    \end{subfigure}
     \hspace*{.2in}
\begin{subfigure}[t]{0.24\textwidth}
\centering
\frame{\includegraphics[height=.2\textheight]{xDR-C-Ex5.pdf}}
	 \caption{}
	\label{fig:twoballs3}

\end{subfigure}
\caption{Experiments with two balls in $\ensuremath{\mathbb R}^2$. \label{fig:twoballs}}
\end{figure}
\end{example}

We performed extensive experiments featuring two convex balls in $\ensuremath{\mathbb R}^n$ with starting points being chosen randomly, and the results were very similar to the ones presented in the pictures above. These positive experiments show that it might be possible to use C--DRM to find a point in the intersection of non-affine convex sets. This should be sought in the future. Note however, that C--DRM need not be defined in the general convex setting. This may be the case when an iterate happens to reach the line passing through the centers of the balls in our examples. Therefore, a hybrid strategy is necessary in order to have C--DRM generating an infinite sequence.
\begin{example}[A ball and a line and a circle and a line in $\ensuremath{\mathbb R}^2$]
\end{example}
Our examples show that C--DRM is likely to converge in less iterations than DRM. Also, as important as algorithmic complexity, is convergence to a solution itself.
\begin{figure}[!ht]
\begin{subfigure}[t]{0.24\textwidth}
\centering
\frame{\includegraphics[height=.177\textheight]{xDR-C-Ex6.pdf}}
	 \caption{}
	\label{fig:ball-line1}

\end{subfigure}
   \hspace*{.21in}
\begin{subfigure}[t]{0.24\textwidth}
\centering
\frame{\includegraphics[height=.177\textheight]{xDR-C-Ex8.pdf}}
	 \caption{}
	\label{fig:ball-line2}
    \end{subfigure}
    \hspace*{.45in}
\begin{subfigure}[t]{0.2\textwidth}
\centering
\frame{\includegraphics[height=.177\textheight]{xDR-C-Ex9.pdf}}
	 \caption{}
	\label{fig:ball-line3}
\end{subfigure}
\caption{Experiments with a ball and a line in $\ensuremath{\mathbb R}^2$. \label{fig:ball-line}}
\end{figure}
In this regard, we underline that our pictures clearly display that C--DRM converges faster than DRM  to a solution of problem \eqref{eq:general}.
Moreover,  DRM fails to find the unique common point of the ball and the line (only converging in the matter of shadow sequences) and to find the best approximation point in Figure~\ref{fig:ball-line1} and Figure~\ref{fig:ball-line2}, respectively.

Figure~\ref{fig:ball-line3} represents a slightly non-convex example with a circle and a line, which was considered for DRM in \cite{benoist}. In this experiment both  C--DRM and DRM converge and the latter was slower. This reveals an interesting and promising property of C--DRM, as well as DRM, when it is applied to non-convex problems. To end this discussion, it is worth mentioning that we performed extensive numerical tests for particular instances of non-convex problem in $\ensuremath{\mathbb R}^n$ and the results are very positive. This is a humble attempt  in targeting the problem of finding a point in the intersection of   an affine subspace with the $s$--space vectors defined by the generalized $\ell_0$--ball (see problem (6) of \cite{Hesse:2014gi}).

\section{Conclusions and future work}\label{Fremarks}

We have introduced and derived a convergence analysis for the Circumcentered--Douglas--Rachford method (C--DRM) for best approximation problems featuring two (affine) subspaces $U,V\subset\ensuremath{\mathbb R}^n$. For any initial point, linear convergence to the best solution was shown and the rate of convergence of C--DRM was proven to be at least as good as DRM's. DRM is known to converge with the sharp rate $c_F\in[0,1)$, the cosine of the Friedrichs angle between $U$ and $V$ (see, {\em e.g.},  \cite{BCNPW14}). A question, left as open in this paper, is whether $c_F$ is a sharp rate for C--DRM. In this regard, our numerical experiments show that \emph{circumcentering} ``speeds up'' convergence of DRM for two subspaces as well as for most of our simple non-affine examples.

In view of future work, we end the paper with a brief discussion on the many set case and on how one can ``circumcenter'' other classical projection/reflection type methods.

\medskip

\noindent{\bf The many set case.} Another relevant advantage of the circumcentering scheme C--DRM is that it can be  extended to the following many set case.

Assume that $\{U_i\}_{i=1}^{m}\subset\ensuremath{\mathbb R}^n$ is a family of finitely many affine subspaces with nonempty intersection $\cap_{i=1}^m U_i$ and that we are interested in projecting onto $\cap_{i=1}^m U_i$  using knowledge provided by reflections onto each $U_i$.

For an arbitrary initial point $x\in\ensuremath{\mathbb R}^n$ we could consider a generalized C--DRM iteration by taking the circumcenter $C_T(x)$ of \[\{x,R_{U_1}(x),R_{U_2}R_{U_1}(x),\ldots ,R_{U_m}\cdots R_{U_2}R_{U_1}(x)\},\] {\em i.e.}, $C_T(x)$ is in $\ensuremath{\operatorname{aff}}\{x,R_{U_1}(x),R_{U_2}R_{U_1}(x),\ldots ,R_{U_m}\cdots R_{U_2}R_{U_1}(x)\}$ and $$\dist(C_T(x), x)=\dist(C_T(x), R_{U_1}(x))=\cdots=\dist(C_T(x), R_{U_m}\cdots R_{U_2}R_{U_1}(x)).$$  The fact that $C_T(x)$ is well defined and that it is precisely given by the projection of any point in $\cap_{i=1}^m U_i$ onto
\[
  W^x \coloneqq\ensuremath{\operatorname{aff}}\{x,R_{U_1}(x),R_{U_2}R_{U_1}(x),\ldots ,R_{U_m}\cdots R_{U_2}R_{U_1}(x)\}
\]
can be derived similarly as in Lemma~\ref{circum-as-proj}. We understand though, that the convergence analysis of  C--DRM for the many set case might be substantially more challenging, since we  no longer can rely on the theory of DRM. Also, one should note that now, for large $m$, the computation of $C_T(x)$ may not be negligible. This computation consists of finding the intersection of $m$ bisectors in $W^x$. Therefore, linear system~\eqref{eq:xc-linsys} is now $m\times m$, and the calculation of $C_T(x)$  requires  its  resolution.

If, for a given problem, the computation of $C_T(x)$ mentioned above is simply too demanding, one could, \emph{e.g.}, consider pairwise circumcenters or even other ways of circumcentering. The important thing here is that we can enforce several strategies to help overcome the unsatisfactory extension of the classical Douglas--Rachford method for the many set case. It is known that for an example in $\ensuremath{\mathbb R}^2$ with three distinct lines intersecting at the original (see \cite[Example 2.1]{ABTcomb}), the natural extension of the Douglas--Rachford method may fail to find a solution. On the other hand, any reasonable circumcentering scheme will solve this particular problem in at most two steps for any initial point. Circumcentering schemes may also be embedded in methods for the many set case, {\em e.g.}, CADRA~\cite{Bauschke:2015df} and the Cyclic--Douglas--Rachford method \cite{Borwein:2014ka}.

\medskip

\noindent{\bf Circumcentering other reflection/projection type methods.}
For the case of $U$ and $V$ being affine subspaces, the reflected Cimmino method \cite{Cimmino:1938tp} considers a current point $x\in\ensuremath{\mathbb R}^n$ and takes the next iterate as the mean $\frac{1}{2}(R_U(x)+R_V(x))$. Circumcentering the Cimmino method is possible by setting the next iterate as $\circum\{x,R_U(x),R_V(x)\}$. Something similar can be done for the Method of Alternating Projections (MAP) (see \emph{e.g.} \cite{Deutsch:1985gz}). From a point $x\in\ensuremath{\mathbb R}^n$, MAP moves to $P_VP_U(x)$. In order to circumcenter MAP, one could take the circumcenter of $x$, $R_U(x)$ and $R_VP_U(x)$. The coherence of this approach lies on the fact that the mid points of the segments $[x,R_U(x)]$ and $[P_U(x)$, $R_VP_U(x)]$ are $P_U(x)\in U$ and $P_VP_U(x)\in V$, respectively.
Note that both the Circumcentered--Cimmino--Method and the Circumcentered--MAP solve problems with affine subspaces $U,V\subset\ensuremath{\mathbb R}^2$ in at most two steps. This happens because circumcentering can be seen as a $2$-dimensional hyperplane search for the two set case.

Finally, we consider that investigating C--DRM for general convex feasibility problems \cite{Bauschke:2006ej} may be fruitful.

\paragraph*{Acknowledgements}
We thank the anonymous referees for their valuable suggestions.

\printbibliography

\end{document}


Spectral analysis beyond $\ell^2$ on Sierpinski lattices

Abstract: We study the spectrum of the Laplacian on the Sierpinski lattices. First, we show that the spectrum of the Laplacian, as a subset of $\mathbb{C}$, remains the same for any $\ell^p$ spaces. Second, we characterize all the spectral points for the lattices with a boundary point.

\section{introduction}
In this note, we study the spectrum of the Laplacian on the Sierpinski Lattice $\widetilde{\SG}$. This problem was fully investigated by A. Teplyaev \cite{T} in the $\ell^2$ setting. We will continue his study for the $\ell^p$ case, and the $\ell^1$ and $\ell^\infty$ cases are of special interest.
\begin{figure}[htp]
	\includegraphics[width=8cm]{blowup.pdf}
	\caption{The Sierpinski lattices.}\label{fig6}
\end{figure}

The \textit{Sierpinski lattice} is an infinite graph defined as follows. Let
$$F_0(x)=\frac{1}{2}x+(\frac{1}{4},\frac{\sqrt{3}}{4}),\quad F_1(x)=\frac{1}{2}x,\quad F_2(x)=\frac{1}{2}x+(\frac{1}{2},0),$$
and $q_0=(\frac{1}{2},\frac{\sqrt{3}}{2}),q_1=(0,0),q_2=(1,0)$ be the fixed points of $F_i$ respectively. Given an infinite word $\omega=\omega_1\omega_2\cdots \in \{0,1,2\}^\infty$, the corresponding Sierpinski lattice $\widetilde{\SG}$ is constructed as
\[\widetilde{\SG}=\bigcup_{m=1}^\infty F_{\omega_1}^{-1}F_{\omega_2}^{-1}\cdots F_{\omega_m}^{-1}(V_m),\]
where $V_0=\{q_0,q_1,q_2\}$ and $V_m=\bigcup_{i=0}^2 F_i(V_{m-1})$ are defined iteratively. See Figure \ref{fig6}.
For $x,y\in \widetilde{\mathcal{SG}}$, we write $x\sim y$ if $x,y\in F_{\omega_1}^{-1}F_{\omega_2}^{-1}\cdots F_{\omega_m}^{-1}F_{l_m}F_{l_{m-1}}\cdots F_{l_1}(V_0)$ for a sequence $l_1,\cdots, l_m\in\{0,1,2\}$.
 Call $y$ a \textit{neighbouring vertex} of $x$. All vertices in the Sierpinski lattice have four neighbouring vertices, except at most one vertex called the \textit{boundary vertex}, which admits only two neighbouring vertices. The boundary vertex exists if and only if there exists $M\in \mathbb{N}$ and $i\in \{0,1,2\}$ such that $\omega_m=i$ for all $m\geq M$, see \cite{T}.

The Laplacian $\Delta$ on $\widetilde{\SG}$ is defined as
\begin{equation}\label{eqn11}
\Delta f(x)=\begin{cases}
\sum_{y\sim x}f(y)-4f(x), \quad &\text{if $x$ is not a boundary point,}\\
\sum_{y\sim x}2f(y)-4f(x),\quad &\text{if $x$ is a boundary point.}
\end{cases}
\end{equation}

The celebrated result of A. Teplyaev \cite{T} showed that the Lapalacian $\Delta$, viewed as an operator $\ell^2(\widetilde{\SG})\to\ell^2(\widetilde{\SG})$ has pure point spectrum. What's more, $\ell^2(\widetilde{\SG})$ admits a basis of localized eigenfunctions of the Laplacian, which can be generated using the spectral decimation recipe \cite{FS,tS}. Read the book \cite{S1} for an introduction to the spectral decimation. For the spectral analysis on other fractal graphs and related fractalfolds, see \cite{MT,S2,ST}.

In this work, we will describe the spectrum of the Laplacian $\Delta:\ell^p(\widetilde{\SG})\to\ell^p(\widetilde{\SG})$. In Section 2, we will show that the spectrum is a union of a Julia set and a discrete set named $6$-series eigenvalues. The spectrum remains the same for any $1\leq p\leq \infty$ and any lattice. On the other hand, in Section 3, we will see that for $1<p<\infty$, the Laplacian has only point spectrum and continuous spectrum, while $\Delta:\ell^1\to\ell^1$ has all three kinds of spectral points. This phenomenon is a consequence of the existence of the $4$-eigenfunctions in $\ell^\infty(\widetilde{\SG})$, which does not live in other $\ell^p(\widetilde{\SG})$ spaces. In addition, we get a full description of the $\ell^1$ spectrum for the lattices with one boundary vertex.

\section{The spectrum of $\Delta$ on $\widetilde{\SG}$}\label{intro}
In this section, we compute the spectrum  of the Laplacian
$\Delta:\ell^p(\widetilde{\SG})\to \ell^p(\widetilde{\SG}),$
which is stated in the following Theorem \ref{Q1}.

\begin{definition}
	The Julia set corresponding to the polynomial $R(\lambda)=\lambda(5-\lambda)$ is defined as
	\[\mathcal{J}=\{x\in\mathbb{C}: \{R^{\circ k}(x)\}_{k=0}^\infty\in l^\infty\}.\]
\end{definition}
\noindent\textbf{Remark.} The Hausdorff dimension of $\mathcal{J}$ is the unique zero of the Bowen's function
$$B(t)=\lim_{k\to\infty} \frac{1}{k}\ln \sum_{w\in R^{-k}(x)}|(R^{\circ k})'(w)|^{-t},$$
where $x$ is any chosen point in $\mathcal{J}$. See Section 9.1 in the book \cite{PU}.

\begin{theorem}\label{Q1}
	Let $\sigma(\Delta)=\mathcal{J}\cup \Sigma_6$, where $\Sigma_6=\{6\}\cup (\bigcup_{m=0}^\infty R^{\circ -m}\{3\})$. The spectrum of $\Delta: \ell^p(\widetilde{\mathcal{SG}})\rightarrow \ell ^p (\widetilde{\mathcal{SG}})$ is equal to $\sigma(\Delta)$ for all $1\leq p\leq \infty$.
\end{theorem}

\noindent\textbf{Remark.} Theorem 2.2 is proved for the $\ell^2(\widetilde{\SG})$ case in \cite{T}. Here a different approach will be used to deal with general $\ell^p$ cases. The theorem is also valid for $\Delta:C_0(\widetilde{\SG})\to C_0(\widetilde{\SG})$.\vspace{0.2cm}

We will prove Theorem \ref{Q1} with several lemmas.  For a fixed infinite word $\omega$, we consider a sequence of sparse lattices $\widetilde{\SG}^{(-k)}$ defined as
\[\widetilde{\SG}^{(-k)}=\bigcup_{m=k}^\infty F_{\omega_1}^{-1}F_{\omega_2}^{-1}\cdots F_{\omega_m}^{-1}V_{m-k},\]
and we say $x\sim_{-k}y$ if  $x,y\in F_{\omega_1}^{-1}F_{\omega_2}^{-1}\cdots F_{\omega_m}^{-1}F_{l_{m-k}}F_{l_{m-k-1}}\cdots F_{l_1}(V_0)$ for a sequence $l_1,\cdots, l_{m-k}\in\{0,1,2\}$. The Laplacian $\Delta_{(-k)}$ on $\widetilde{\SG}^{(-k)}$ can be defined in a similar manner as (\ref{eqn11}).
The eigenvalues and eigenfunctions on $\widetilde{\SG}^{(-k)}$ for different $k$'s are related by the spectral decimation method \cite{FS,ST,T}.

To understand the spectral decimation, we only need to focus on a small neighbourhood of a point $y_0$ in $\widetilde{\SG}^{(-k-1)}$. For convenience, we only consider the case $k=0$ and a point $y_0\in \widetilde{\SG}^{(-1)}$ with four neighbouring vertices, noticing that the boundary vertices and $k\geq 1$ cases can be dealt with in an essentially same way. Let $\{x_i\}_{i=1}^4$ be the neighbouring vertices of $y_0$ in $\widetilde{\SG}^{(-1)}$, and let $\{y_i\}_{i=1}^6$  be the vertices in $\widetilde{\mathcal{SG}}$ bounded by $\{x_i\}_{i=1}^4$. The induced subgraph in $\widetilde{\mathcal{SG}}$ is denoted by $\Gamma$ in the following context, see Figure \ref{fig1}. Clearly, the definition of $\Delta$ and $\Delta_{(-1)}$ on $\Gamma$ are naturally inherited from those on the graphs $\widetilde{\SG}$ and $\widetilde{\SG}^{(-1)}$ as follows,
\begin{eqnarray}
\label{eqn21}\Delta f(y_i)=\sum_{z\sim y_i}f(z)-4f(y_i),&0\leq i\leq 6,\\
\label{eqn22}\Delta_{(-1)} f(y_0)=\sum_{i=1}^4f(x_i)-4f(y_0).&
\end{eqnarray}

\begin{figure}[htp]
	\includegraphics[width=5cm]{gammat.pdf}
	\begin{picture}(0,0)
	\put(-4,0){$x_2$}
	\put(-154,0){$x_1$}
	\put(-114,64){$x_4$}
	\put(-44,64){$x_3$}

	\put(-80,-4){$y_0$}
	\put(-68,34){$y_3$}
	\put(-44,-4){$y_2$}
	\put(-114,-4){$y_1$}
	\put(-90,34){$y_4$}
	\put(-136,34){$y_5$}
	\put(-22,34){$y_6$}
	\end{picture}
	\caption{The graph $\Gamma$.}\label{fig1}
\end{figure}

\begin{proposition}[Spectral Decimation]\label{decimation}
Let $\lambda\notin \{2,5,6\}$ and $R(\lambda)=\lambda(5-\lambda)$. Let $\Delta$ and $\Delta_{(-1)}$ on $\Gamma$ be defined in (\ref{eqn21}) and (\ref{eqn22}).

(a). Let $f\in l(\Gamma)$ and $-\Delta f(y_i)=\lambda f(y_i),\forall 0\leq i\leq 6$. Then $-\Delta_{(-1)}f(y_0)=R(\lambda)f(y_0)$.

(b). Given any values $f(x_i),i=1,2,3,4$ and $f(y_0)$ such that $-\Delta_{(-1)}f(y_0)=R(\lambda)f(y_0)$, there is a unique extension $f\in l(\Gamma)$ such that $f$ satisfies the eigenvalue equations $-\Delta f(y_i)=\lambda f(y_i),\forall 0\leq i\leq 6$.
\end{proposition}
\noindent\textit{Proof.} This can be done by direct computation. See Section 3.2 in the book \cite{S1} for details.\hfill$\square$\vspace{0.2cm}

Proposition \ref{decimation} can be easily applied to the eigenvalue problems on the Sierpinski lattices. However, to deal with the spectrum, we need somewhat stronger versions. We will do this in the following two lemmas.

\begin{figure}[htp]
	\includegraphics[width=5cm]{gammat.pdf}\qquad
	\includegraphics[width=5cm]{gammat.pdf}
	\begin{picture}(0,0)
	\put(-78,-5){$4$}
	\put(-68,34){$3$}
	\put(-44,-5){$3$}
	\put(-114,-5){$3$}
	\put(-90,34){$3$}
	\put(-136,33){$2$}
	\put(-22,33){$2$}

	\put(-240,-5){$1$}
	\put(-305,31){$-1$}
	\put(-187,31){$-1$}
	\end{picture}
	\caption{The $4$-Dirichlet eigenfunction and $1$-Dirichlet eigenfunction on $\Gamma$ (with only non-zero values marked).}\label{fig2}
\end{figure}

\begin{lemma}\label{Q1lemma1}
	Consider the Dirichlet eigenvalue problem on $\Gamma$:
	\[\begin{cases}
	f(x_i)=0,&1\leq i\leq 4,\\
	-\Delta f(y_i)=\lambda f(y_i),&1\leq i\leq 6.
	\end{cases}\]
	 All the Dirichlet eigenvalues are $\{1,2,4,5,6\}$.
\end{lemma}
\noindent\textit{Proof.} We can easily find one $2$-eigenfunction, three $5$-eigenfunctions and one $6$-eigenfunction, see Section 3.2, 3.3 in \cite{S1} for an illustration of such eigenfunctions. In addition, we find one $4$-eigenfunction and one $1$-eigenfunction as shown in Figure 2. All the above  give $7$ linearly independent eigenfunctions. \hfill$\square$

\begin{lemma}\label{Q1lemma2} Let $\lambda\notin\{1,2,4,5,6\}$.
There exist constants $\{c_{i,\lambda}\}_{i=0}^6$ such that for any $f\in \l(\Gamma)$ we have
$$(R(\lambda)+\Delta_{(-1)})f(y_0)=\sum_{i=0}^6 c_{i,\lambda}(\lambda+\Delta)f(y_i).$$
In addition, $c_{0,\lambda}\neq 0$.
\end{lemma}

\noindent\textit{Proof.} Let $f\in l(\Gamma)$. By the assumption and using Lemma \ref{Q1lemma1}, we know that $\lambda$ is not a Dirichlet eigenvalue. So there is a unique solution to each of the following boundary value problems.
\begin{equation}\label{Q1eqn1}
\begin{cases}
u(x_i)=0,&1\leq i\leq 4,\\
(\lambda+\Delta) u(y_i)=(\lambda+\Delta) f(y_i),&0\leq i\leq 6,
\end{cases}
\end{equation}
\begin{equation}
 \begin{cases}
 v(x_i)=f(x_i),&1\leq i\leq 4\\
 (\lambda+\Delta) v(y_i)=0,&0\leq i\leq 6.
 \end{cases}
\end{equation}
Clearly, we have
\[f=u+v.\]
In addition, since $v$ is an eigenfunction of $\Delta$, we have
$$(R(\lambda)+\Delta_{(-1)})v(y_0)=0,$$
by using Proposition \ref{decimation}. As a consequence, we get $(R(\lambda)+\Delta_{(-1)})f(y_0)=(R(\lambda)+\Delta_{(-1)})u(y_0)$. On the other hand, since $u$ is uniquely determined by the linear equations (\ref{Q1eqn1}), we conclude there are constants $c_{i,\lambda}$ such that
\[(R(\lambda)+\Delta_{(-1)})f(y_0)=(R(\lambda)+\Delta_{(-1)})u(y_0)=\sum_{i=0}^6c_{i,\lambda}(\lambda+\Delta) f(y_i).\]

Lastly, we prove $c_{0,\lambda}\neq 0$ by contradiction. Assume $c_{0,\lambda}=0$, then we have
\[f(y_0)=\big(R(\lambda)-4\big)^{-1}\big(-\sum_{i=1}^4f(x_i)+\sum_{i=1}^6 c_{i,\lambda}(\lambda+\Delta)f(y_i)\big).\]
In addition, it is easy to see that $\{f(y_i)\}_{i=1}^6$ are uniquely determined by  $\{f(x_i)\}_{i=1}^4,\{(\Delta+\lambda)f(y_i)\}_{i=1}^6$ and $f(y_0)$. As a consequence, $f$ is uniquely determined by the $10$ numbers $\{f(x_i)\}_{i=1}^4,\{(\Delta+\lambda)f(y_i)\}_{i=1}^6$, which contradicts the fact that $l(\Gamma)$ is $11$ dimensional. \hfill$\square$\\

Now, we return to investigate the Sierpinski lattice $\widetilde{\mathcal{SG}}$, applying the above two lemmas locally.
\begin{lemma}\label{Q1lemma3}
	Let $\lambda\notin\{1,2,4,5,6\}$, and consider $\Delta_{(-k)}:\ell^p(\widetilde{\SG}^{(-k)})\to  \ell^p(\widetilde{\SG}^{(-k)})$, $1\leq p\leq \infty$. Then $\lambda+\Delta_{(-k)}$ is invertible if and only if $R(\lambda)+\Delta_{(-k-1)}$ is invertible.
\end{lemma}

\noindent\textit{Proof.} Without loss of generality, we consider the $k=0$ case. Fix any point $y_0\in \widetilde{\SG}^{(-1)}$, and choose a neighbourhood of $y_0$ in $\widetilde{\mathcal{SG}}$ that is isomorphic to $\Gamma$. For each $g\in l(\widetilde{\SG})$, we define
\[Tg(y_0)=\sum_{i=0}^6 c_{i,\lambda}g(y_i),\]
where $c_{i,\lambda}$ is defined in Lemma \ref{Q1lemma2}. It is clear that $T$ is bounded from $\ell^p(\widetilde{\SG})$ to $\ell^p(\widetilde{\SG}^{(-1)})$. In addition, since $c_{0,\lambda}\neq 0$, $T$ is surjective.

Then by using Lemma \ref{Q1lemma2} at each point of $\widetilde{\SG}^{(-1)}$, the following two systems of equations give the same solutions on $\widetilde{\SG}$,
\begin{equation}\label{Q1eqn2}
(\lambda+\Delta) f(x)=g(x)\text{, on }\widetilde{\SG},
\end{equation}
and
\begin{equation}\label{Q1eqn3}
\begin{cases}
(\lambda+\Delta) f(x)=g(x),&\text{ for }x\in \widetilde{\SG}\setminus \widetilde{\SG}^{(-1)},\\
(R(\lambda)+\Delta_{(-1)}) f(x)=Tg(x), &\text{ for }x\in \widetilde{\SG}^{(-1)},
\end{cases}
\end{equation}
where $g\in \ell^p(\widetilde{\SG})$. But (\ref{Q1eqn3}) has a unique solution in $\ell^p(\widetilde{\SG})$ if and only if
\begin{equation}\label{Q1eqn4}
(R(\lambda)+\Delta_{(-1)}) f(x)=Tg(x) \text{, on }\widetilde{\SG}^{(-1)},
\end{equation}
has a unique solution in $\ell^{p}(\widetilde{\SG}^{(-1)})$. The lemma follows immediately from the equivalence of solvabilty  and uniqueness of solutions to (\ref{Q1eqn2}) and (\ref{Q1eqn4}).\hfill$\square$\\

In fact, in Lemma \ref{Q1lemma3}, the only exceptions are $\lambda=\{2,6\}$. The cases for $\lambda=1,4,5,6$ are easy to check, while the case $\lambda=2$ needs a little more work. Luckily, by a same idea as the proof of Lemma \ref{Q1lemma1}, \ref{Q1lemma2} and \ref{Q1lemma3}. We will get the following lemma.

\begin{lemma}\label{Q1lemma4}
	Let $\lambda\notin\{1,3,4,5,6\}\cup R^{\circ-1}\{1,2,5\}$, and consider $\Delta_{(-k)}:\ell^p(\widetilde{\SG}^{(-k)})\to  \ell^p(\widetilde{\SG}^{(-k)})$,$1\leq p\leq \infty$. Then $(\lambda+\Delta_{(-k)})^{-1}$ is invertible if and only if $(R^{\circ 2}(\lambda)+\Delta_{(-k-2)})^{-1}$ is invertible.

	In particular, $(2+\Delta_{(-k)})^{-1}$ is invertible if and only if $(-6+\Delta_{(-k-2)})^{-1}$ is invertible.
\end{lemma}

We end this section with the proof of Theorem \ref{Q1}.\vspace{0.1cm}

\noindent\textit{Proof of Theorem \ref{Q1}.} Clearly, $\Sigma_6=\{6\}\cup  (\bigcup_{m=0}^\infty R^{\circ -m}\{3\})\subset \sigma(\Delta)$. See \cite{T} for the eigenfunctions for $\lambda\in \Sigma_6$. Thus, it is easy to see that
\[ \mathcal{J}\cup \Sigma_6=\overline{\Sigma_6}\subset \sigma(\Delta).\]

It remains to show that $\sigma(\Delta)\subset\mathcal{J}\cup \Sigma_6$. It suffices to show that if $\lambda \notin \mathcal{J}\cup \Sigma_6$, then $\lambda+\Delta$ is invertible. We consider two cases below.

First, consider $\lambda\notin \mathcal{J}\cup \Sigma_6\cup (\bigcup_{m=0}^\infty R^{\circ-m}\{2\})$. It is easy to see that
\[\|\Delta_{(-k)}\|_{op}\leq 8.\]
On the other hand, by the definition of $\mathcal{J}$, there exists $k\geq 0$ such that
\[|R^{\circ k}(\lambda)|>8\geq \|\Delta_{(-k)}\|_{op},\]
which implies that $R^{\circ k}(\lambda)+\Delta_{(-k)}$ is invertible. By using Lemma \ref{Q1lemma3} repeatedly, we see that $\lambda+\Delta$ is invertible.

Second, if $\lambda\in \bigcup_{m=0}^\infty R^{\circ-m}\{2\}$, by using Lemma \ref{Q1lemma3} and \ref{Q1lemma4}, and a same argument as the first case, we can show that $\lambda+\Delta$ is also invertible.\hfill$\square$

\section{A spectral analysis on lattices with one boundary}
In this section, we focus on characterizing each point in the spectrum. We will point out that the $\ell^p,1<p<\infty$ cases and $\ell^1$ case are very different. A full description of the spectral points in the $\ell^p,1<p<\infty$ cases is easy with the method developed by A. Teplyaev \cite{T}, while the $\ell^1$ case is much complicated and we only give a full answer for the lattices with a boundary point.

As preparation, we define the \textit{inner product} of real functions on $\widetilde{\SG}$ as follows, $$<f,g>=\sum_{x\in \widetilde{\SG}}\mu_xf(x)g(x),$$
where
$\mu_x=\begin{cases}
1, &\text{ if  $x$  is not a boundary point}, \\
1/2, &\text{ if  $x$  is a boundary point}.
\end{cases}$

\begin{lemma}\label{Q2lemma1}
	Let $f\in \ell^p(\widetilde{\SG})$ and $g\in \ell^q(\widetilde{\SG})$ with $\frac{1}{p}+\frac{1}{q}=1$, $1\leq p<\infty$, then we have $<\Delta f,g>=<f,\Delta g>$.
\end{lemma}
\noindent\textit{Proof.} It is easy to see that the summation below converges absolutely, so we can rearrange the order,
\[\sum_{x\in \widetilde{\SG}}\sum_{y:y\sim x}g(x)f(y)=\sum_{x\in \widetilde{\SG}}\sum_{y:y\sim x}f(x)g(y).\]
As a result,
\[\quad\qquad\qquad\begin{aligned}
<\Delta f,g>&=\sum_{x\in \widetilde{\SG}} \mu_x g(x)\sum_{y:y\sim x}\frac{1}{\mu_x}\big(f(y)-f(x)\big)\\
&=-4<f,g>+\sum_{x\in \widetilde{\SG}}\sum_{y:y\sim x}g(x)f(y)\\
&=-4<f,g>+\sum_{x\in \widetilde{\SG}}\sum_{y:y\sim x}f(x)g(y)=<f,\Delta g>.\qquad\qquad\qquad\square
\end{aligned}\]

In the following, we use $\sigma_c(\Delta)$ to denote the continuous spectrum of the Laplacian, and $\sigma_p(\Delta)$ for the point spectrum, $\sigma_r(\Delta)$ for the residue spectrum.  As a consequence of Lemma \ref{Q2lemma1}, we have the following criterion for $\lambda$ to be a residue spectral point.

\begin{lemma}\label{Q2lemma2}
Let $1\leq p<\infty$, $\frac{1}{p}+\frac{1}{q}=1$, and assume $\lambda\notin\sigma_p(\Delta)$ for $\Delta:\ell^p(\widetilde{\SG})\to \ell^p(\widetilde{\SG})$.  Then $\lambda\in \sigma_r(\Delta)$ for $\Delta:\ell^p(\widetilde{\SG})\to \ell^p(\widetilde{\SG})$ if and only if $\lambda\in \sigma_p(\Delta)$ for $\Delta:\ell^q(\widetilde{\SG})\to \ell^q(\widetilde{\SG})$.
\end{lemma}

\noindent\textit{Proof.} The lemma is an easy application of Lemma \ref{Q2lemma1}. In fact, if $(\lambda+\Delta)(\ell^p(\widetilde{\SG}))$ is not dense in $\ell^p(\widetilde{\SG})$, there exists a non-zero $f_\lambda\in \ell^q(\widetilde{\SG})$ such that $<f,(\lambda+\Delta)f_\lambda>=<(\lambda+\Delta)f,f_\lambda>=0$ for any $f\in \ell^p(\widetilde{\SG})$. This shows that $(\lambda+\Delta)f_\lambda=0$. Conversely, it is clear that if $\lambda$ is an eigenvalue of $\Delta:\ell^q(\widetilde{\SG})\to \ell^q(\widetilde{\SG})$ with a corresponding eigenfunction $f_\lambda\in \ell^q(\widetilde{\SG})$, then $<(\lambda+\Delta)f,f_\lambda>=0$ for any $f\in \ell^p(\widetilde{\SG})$. \hfill$\square$

\subsection{Lattices with a boundary point}
In this part, we will characterize each spectral point for $\Delta:\ell^p(\widetilde{\SG})\to\ell^p(\widetilde{\SG})$, given the condition that $\widetilde{\SG}$ is a lattice with a boundary point. The result is stated as follows.

\begin{theorem}\label{Q2thm3}
Write
$$\Sigma_4=\bigcup_{m=0}^\infty R^{\circ-m}\{4\},\quad \Sigma_5=\bigcup_{m=0}^\infty R^{\circ-m}\{5\} \quad \text{and} \quad  \Sigma_6=\{6\}\bigcup\big(\bigcup_{m=0}^\infty R^{\circ-m}\{3\}\big).$$

(a). For $\Delta:\ell^p(\widetilde{\SG})\to \ell^p(\widetilde{\SG})$ with $1<p<\infty$, we have $\sigma_p(\Delta)=\Sigma_5\cup\Sigma_6$ and $\sigma_c(\Delta)=\mathcal{J}\setminus \Sigma_5$. There is no residue spectral point.

(b). For $\Delta:\ell^1(\widetilde{\SG})\to \ell^1(\widetilde{\SG})$, we have all three types of spectral points as follows,
\[\sigma_p(\Delta)=\Sigma_5\cup\Sigma_6,\quad\sigma_c(\Delta)=\mathcal{J}\setminus (\Sigma_4\cup \Sigma_5\cup\{0\}),\quad \sigma_r(\Delta)=\{0\}\cup\Sigma_4.\]
\end{theorem}

By Lemma \ref{Q2lemma2}, Theorem \ref{Q2thm3} is an immediate consequence of the following proposition.

\begin{proposition}\label{Q2prop4}
  For $\Delta:\ell^\infty(\widetilde{\SG})\to \ell^\infty(\widetilde{\SG})$, we have $\sigma_p(\Delta)=\{0\}\cup\Sigma_4\cup\Sigma_5\cup\Sigma_6$.
\end{proposition}

\noindent\textit{Proof.} Without loss of generality, we take $\omega=0000\cdots$ and $\widetilde{\SG}=\bigcup_{m=0}^\infty F_0^{-m}V_m$, since any two lattices with a boundary point are isomorphic to each other \cite{T}. The following proof relies on Lemma \ref{Q2lemma5} and Lemma \ref{Q2lemma6}, which will be stated later.

The existence of $5$-series and $6$-series eigenfunctions is a well-known result of the spectral decimation, see \cite{T}. See Appendix for the existence of the $4$-series eigenfunctions. So it suffices to show that there are no other $\ell^\infty$ eigenvalues.

Take $\lambda\in \mathcal{J}\setminus \big(\{0\}\cup\Sigma_4\cup\Sigma_5\big)$, and let $f$ be a $\lambda$-eigenfunction. For convenience, we write $q_i^{(-m)}=F_0^{-m}q_i,i=0,1,2$. By direct computation, and using the decimation method, we get
\begin{equation}\label{eqn31}
\begin{aligned}
\begin{pmatrix}f(q_0)\\f(q_1)\\f(q_2)\end{pmatrix}&=
\begin{pmatrix}
1 & 0 & 0\\
\frac{4-\lambda}{(2-\lambda)(5-\lambda)} & \frac{4-\lambda}{(2-\lambda)(5-\lambda)} & \frac{2}{(2-\lambda)(5-\lambda)}\\
\frac{4-\lambda}{(2-\lambda)(5-\lambda)} & \frac{2}{(2-\lambda)(5-\lambda)} & \frac{4-\lambda}{(2-\lambda)(5-\lambda)}
\end{pmatrix}
\begin{pmatrix}f(q_0)\\f(q^{(-1)}_1)\\f(q^{(-1)}_2)\end{pmatrix}
\\
&=f(q_0)\begin{pmatrix}1\\1-\frac{\lambda}{4}\\1-\frac{\lambda}{4}\end{pmatrix}
+\frac{\lambda\big(f(q^{(-1)}_1)-f(q^{(-1)}_2)\big)}{2R(\lambda)}
\begin{pmatrix}0\\1\\-1\end{pmatrix}\\
&+\big(\frac{f(q_1^{(-1)})+f(q_2^{(-1)})}{2}-(1-\frac{R(\lambda)}{4})f(q_0)\big)\frac{6-\lambda}{(2-\lambda)(5-\lambda)}
\begin{pmatrix}0\\1\\1\end{pmatrix},
\end{aligned}
\end{equation}
as $f$ is an $R(\lambda)$-eigenfunction on $\widetilde{\SG}^{(-1)}$. In addition,

\begin{equation}\label{eqn32}
f(q_1^{(-m)})+f(q_2^{(-m)})-(2-\frac{R^{\circ m}(\lambda)}{2})f(q_0)=0, \forall m\geq 0.
\end{equation}
By using (\ref{eqn31}) and (\ref{eqn32}) repeatedly and using symmetry, we get
\begin{equation}\label{eqn33}
\begin{pmatrix}f(q_0)\\f(q_1)\\f(q_2)\end{pmatrix}=
f(q_0)\begin{pmatrix}1\\1-\frac{\lambda}{4}\\1-\frac{\lambda}{4}\end{pmatrix}
+\frac{\lambda\big(f(q^{(-m)}_1)-f(q^{(-m)}_2)\big)}{2R^{\circ m}(\lambda)}
\begin{pmatrix}0\\1\\-1\end{pmatrix},
\end{equation}
and
\begin{equation}\label{eqn34}
\begin{aligned}
\begin{pmatrix}f(F_0^{-m}F^m_1q_0)\\f(q^{(-m)}_1)\\f(F_0^{-m}F^m_1q_2)\end{pmatrix}=
f(q^{(-m)}_1)\begin{pmatrix}1-\frac{\lambda}{4}\\1\\1-\frac{\lambda}{4}\end{pmatrix}
+\frac{\lambda\big(f(q_0)-f(q^{(-m)}_2)\big)}{2R^{\circ m}(\lambda)}
\begin{pmatrix}1\\0\\-1\end{pmatrix}\\
+\big(\frac{f(q_0)+f(q_2^{(-m)})}{2}-(1-\frac{R^{\circ m}(\lambda)}{4})f(q_1^{(-m)})\big)\prod_{l=0}^{m-1}\frac{6-R^{\circ l}(\lambda)}{(2-R^{\circ l}(\lambda))(5-R^{\circ l}(\lambda))}\begin{pmatrix}1\\0\\1\end{pmatrix}.
\end{aligned}
\end{equation}
As a consequence of (\ref{eqn32}) and (\ref{eqn33}), we get the estimate
\begin{equation}\label{eqn35}
\max\{|f(q_0)|,|f(q_1)|,|f(q_2)|\}\leq C (1\vee \frac{\lambda}{R^{\circ m}(\lambda)})\cdot\max\{|f(q^{(-m)}_1)|,|f(q^{(-m)}_2)|\}.
\end{equation}
On the other hand, by using (\ref{eqn32}) and (\ref{eqn34}), we get the equation
\begin{equation}
\begin{aligned}
f(F_0^{-m}F^m_1q_0)+f(F_0^{-m}&F^m_1q_2)=(2-\frac{\lambda}{2})f(q_1^{(-m)})\\
+\big((\frac{2}{4-R^{\circ m}(\lambda)}&-2+\frac{R^{\circ m}(\lambda)}{2})f(q_1^{(-m)})+(\frac{2}{4-R^{\circ m}(\lambda)}+1)f(q_2^{(-m)})\big)P_m\\
&=(2-\frac{\lambda}{2})f(q_1^{(-m)})+P_m(\lambda)(a_mf(q_1^{(-m)})+b_mf(q_2^{(-m)})).
\end{aligned}
\end{equation}
where
\begin{equation}\label{pm}
P_m(\lambda)=\prod_{l=0}^{m-1}\frac{6-R^{\circ l}(\lambda)}{(2-R^{\circ l}(\lambda))(5-R^{\circ l}(\lambda)},
\end{equation}
 $a_m=\frac{2}{4-R^{\circ m}(\lambda)}-2+\frac{R^{\circ m}(\lambda)}{2}$ and $b_m=\frac{2}{4-R^{\circ m}(\lambda)}+1$.
By symmetry, we also have
\begin{equation}
\begin{aligned}
f(F_0^{-m}F^m_2q_0)&+f(F_0^{-m}F^m_2q_1)\\
&=(2-\frac{\lambda}{2})f(q_2^{(-m)})+P_m(\lambda)(a_mf(q_2^{(-m)})+b_mf(q_1^{(-m)})).
\end{aligned}
\end{equation}

It is easy to check that $a_m^2\neq b_m^2$ if $R^{\circ m}(\lambda)\in \mathcal{J}\setminus \{0,4\}$. By using Lemma \ref{Q2lemma5} below, we can find an increasing sequence $\{m_k\}_{k=1}^\infty$ such that $R^{\circ m_k}(\lambda)$ is bounded away from $0$ and $4$. Thus, we have
\begin{equation}\label{eqn38}
\begin{aligned}
&\max\{|f(F_0^{-m_k}F^{m_k}_1q_0)+f(F_0^{-m_k}F^{m_k}_1q_2)|,|f(F_0^{-m_k}F^{m_k}_2q_0)+f(F_0^{-m_k}F^{m_k}_2q_1)|\}\\
\geq & (2C |P_{m_k}(\lambda)|-|2-\frac{\lambda}{2}|)\max \{|f(q^{(-m_k)}_1)|,|f(q^{(-m_k)}_2)|\},
\end{aligned}
\end{equation}
where $C$ is independent of $k$. However, according to Lemma \ref{Q2lemma6}, we can see that $\lim\limits_{k\to\infty}|P_{m_k}(\lambda)|=+\infty$. Combining the estimates (\ref{eqn35}) and (\ref{eqn38}), and letting $k\to\infty$, we see that $f$ is unbounded. \hfill$\square$\vspace{0.2cm}

At the end of this subsection, we prove the lemmas that are used in the proof of Proposition \ref{Q2prop4}.

First, let's recall some basic facts about the totally disconnected Julia set, which can be found in many textbooks, see for example \cite{M}. Denote $\varphi_-(x)=\frac{5-\sqrt{25-4x}}{2}$ and $\varphi_+(x)=\frac{5+\sqrt{25-4x}}{2}$.  There is a natural homeomorphism $\pi$ from the Cantor set $\mathcal{C}=\{-,+\}^{\mathbb{N}}$ to $\mathcal{J}$ defined as follows
\[\pi(\eta)=\bigcap_{m=1}^\infty \varphi_{\eta_1}\varphi_{\eta_2}\cdots \varphi_{\eta_m}(\mathcal{J}),\]
for $\eta=\eta_1\eta_2\cdots\in \mathcal{C}$. In particular, $\pi(---\cdots )=0$ and $\pi(+++\cdots)=4$. In addition, define the left shift operator  $\iota: \mathcal{C}\rightarrow \mathcal{C}$ by $\iota(\eta_1\eta_2\eta_3\cdots)=\eta_2\eta_3\cdots$. Then
\[R\circ \pi(\eta)=\pi\circ \iota (\eta), \forall \eta\in \mathcal{C}.\]

\begin{lemma}\label{Q2lemma5}
	Let $\lambda\in \mathcal{J}\setminus \big(\{0\}\cup\Sigma_4\cup\Sigma_5\big)$.

	(a). There is a sequence $m_1<m_2<\cdots $ such that $\min\{|R^{\circ m_k}(\lambda)|,|R^{\circ m_k}(\lambda)-4|\}>C$, where $C$ is a positive constant independent of $\lambda$.

	(b). There is an infinite sequence $n_1<n_2<\cdots $ such that $R^{\circ n_k}(\lambda)\in \varphi_-(\mathcal{J})$.
\end{lemma}
\noindent\textit{Proof.} (a). Clearly, we can find countably infinite different positive integers $m$ such that $\iota^{\circ m}\pi^{-1}(\lambda)$ are of the form $+-\cdots$ or $-+\cdots$. This means $R^{\circ m}(\lambda)\in \varphi_{-}\varphi_{+}(\mathcal{J})\cup \varphi_{+}\varphi_{-}(\mathcal{J})$, and thus $R^{\circ m}(\lambda)$ is bounded away from $\{0,4\}$.

(b). Clearly, we can find countably infinite different integers $n$ such that $\big(\iota^{\circ n}\pi^{-1}(\lambda)\big)_1=-$.\hfill$\square$\vspace{0.2cm}

Next, we give an estimate for $P_m(\lambda)$ in $(\ref{pm})$.

\begin{lemma}\label{Q2lemma6}  For $\lambda\in \mathcal{J}\setminus \Sigma_4$, we have
	$$\lim_{m\to\infty} |P_m(\lambda)|=\lim\limits_{m\to\infty}\prod_{l=0}^{m-1}|\frac{6-R^{\circ l}(\lambda)}{(2-R^{\circ l}(\lambda))(5-R^{\circ l}(\lambda)}|=\infty.$$
\end{lemma}

\noindent\textit{Proof.} Using the fact that $R(x)=x(5-x)$ and by direct computation, we can show
\[|P_{m}(\lambda)|=\big|\frac{\lambda(6-\lambda)}{R^{\circ m}(\lambda)\big(2-R^{\circ m-1}(\lambda)\big)}\big|\cdot \prod_{l=0}^{m-2}|3-R^{\circ l}(\lambda)|.\]
Thus it suffices to show $\lim\limits_{m\to\infty}\prod_{l=0}^{m}|3-R^{\circ l}(\lambda)|=\infty$.

\begin{figure}[htp]
	\includegraphics[width=12cm]{decomposition.png}
	\begin{picture}(0,0)
	\put(-300,10){$A$}
	\put(-93,10){$B$}
	\put(-41,10){$C$}

	\put(-343,-3){$0$}
	\put(-253,-3){$1.38$}
	\put(-113,-3){$3.62$}
	\put(-77,-3){$4$}
	\put(-10,-3){$5$}
	\end{picture}
	\caption{An illustration of the $A,B,C$ areas and approximated values of the end points.}\label{fig4}
\end{figure}

Let $A=\varphi_{-}(\mathcal{J})$, $B=\varphi_{+}(\mathcal{J})\cap (0,4]$ and $C=\varphi_+(\mathcal{J})\cap (4,5]$, so that $\mathcal{J}=A\cup B\cup C$. See Figure \ref{fig4} for an illustration. For $x \in A$, we have $|3-x|>1.5$; for $x \in C$, we have $|3-x|>1$; For $x\in B$, we have $R(x)\in C$ and $(3-x)\big(3-R(x)\big)>1$ by an easy estimate.

As a consequence, we have the estimates
\[\begin{aligned}
\prod_{l=0}^{m}|3-R^{\circ l}(\lambda)|&\geq c\big(\prod_{l\in I_{m,A}}|3-R^{\circ l}(\lambda)|\big)\cdot \big(\prod_{l\in I_{m,B}}|(3-R^{\circ l}(\lambda)\big)\big(3-R^{\circ l+1}(\lambda)\big)|\big)\\
&\geq c (\frac{3}{2})^{\# I_{m,A}},
\end{aligned}\]
where $c=\min\{|x-3|:x\in\mathcal{J}\}$, $I_{m,A}=\{0\leq l\leq m:R^{\circ l}(\lambda)\in A\}$ and $I_{m,B}=\{0\leq l\leq m-1:R^{\circ l}(\lambda)\in B\}$. The lemma follows immediately from Lemma \ref{Q2lemma5} (b).\hfill$\square$

\subsection{Lattices with no boundary}
In A. Teplyaev's work \cite{T}, it was shown that the localized eigenfunctions form a complete basis of the $\ell^2(\widetilde{\SG})$ space. The basic idea is to find a localized eigenfunction $f_\lambda$ such that $<f,f_\lambda>\neq 0$ for each nonzero $f\in \ell^2(\widetilde{\SG})$. This same proof can be easily extended to $C_0(\widetilde{\SG})$ case, where $C_0(\widetilde{\SG})=\{f\in \ell^\infty(\widetilde{\SG}):\lim_{x\to\infty} f(x)=0\}$. We state the result as follows.

\begin{lemma}\label{Q2lemma7}
	For any $f\in C_0(\widetilde{\SG})$, there exists a localized eigenfunction $f_\lambda$ of $\Delta$ such that $<f_\lambda,f>\neq 0$.
\end{lemma}

As an immediate consequence, there is no eigenvalue of $\Delta$ on $C_0(\widetilde{\SG})$ other than the $5$ or $6$ series.

\begin{proposition}\label{Q2prop8}
	Let $\Delta:C_0(\widetilde{\SG})\to C_0(\widetilde{\SG})$, we have $\sigma_p(\Delta)=\Sigma_5\cup\Sigma_6$.
\end{proposition}
\noindent\textit{Proof.} Assume there exists an eigenvalue $\lambda\notin \Sigma_5\cup\Sigma_6$, and let $f_{\lambda}$ be the corresponding eigenfunction. By Lemma \ref{Q2lemma7}, there is a localized eigenfunction $f_{\lambda'}$ such that $<f_\lambda,f_{\lambda'}>\neq 0$. On the other hand, $\lambda\neq 0$, and
\[\lambda^{-1}<-\Delta f_\lambda,f_{\lambda'}>=<f_\lambda, f_{\lambda'}>={\lambda'}^{-1}< f_\lambda,-\Delta f_{\lambda'}>.\]
Then by Lemma \ref{Q2lemma1},  this implies that $<f_\lambda,f_{\lambda'}>=0$,  a contradiction. \hfill$\square$
\begin{theorem}
	 For $1<p<\infty$, $\Delta:\ell^p(\widetilde{\SG})\to \ell^p(\widetilde{\SG})$ has point spectrum $\sigma_p(\Delta)=\Sigma_5\cup\Sigma_6$, and continuous spectrum $\sigma_c(\Delta)=\mathcal{J}\setminus \Sigma_5$. There is no residue spectrum.
\end{theorem}
\noindent\textit{Proof.} As a direct consequence of Proposition \ref{Q2prop8}, $\sigma_p(\Delta)=\Sigma_5\cup\Sigma_6$. In addition, we see that there is no residue spectral point by Lemma \ref{Q2lemma2}.\hfill$\square$ \vspace{0.2cm}

However, the $\ell^1$ spectrum of the Laplacian is much complicated on the lattices without boundary, and it seems possible that the eigenvalues for $\Delta:\ell^\infty(\widetilde{\SG})\to \ell^\infty(\widetilde{\SG})$ depend on the generating sequence $\omega$ of the lattice. Further researches are suggested in the future.

\section{Appendix}
In this appendix, we construct the $4$-eigenfunctions on $\widetilde{\mathcal{SG}}$. Note that this induces a class of eigenvalues $\Sigma_4=\bigcup_{m=0}^\infty R^{\circ-m}\{4\}$.

We introduce the following orthogonal matrices
\begin{equation}\label{extend}
A_1=
\begin{pmatrix}
1&0&0\\
0&0&-1\\
0&-1&0
\end{pmatrix},\quad
A_2=
\begin{pmatrix}
0&0&-1\\
0&1&0\\
-1&0&0
\end{pmatrix},
\quad
A_3=
\begin{pmatrix}
0&-1&0\\
-1&0&0\\
0&0&1
\end{pmatrix}.
\end{equation}\quad

Recall that if we fix an infinite word $\omega=\omega_1\omega_2\cdots$, then there is a Sierpinski lattice defined by $\widetilde{\SG}=\bigcup_{m=0}^\infty F_{\omega_1}^{-1}F^{-1}_{\omega_2}\cdots F^{-1}_{\omega_m} V_m$.
For convenience, we write $$q_i^{(-m)}=F_{\omega_1}^{-1}F^{-1}_{\omega_2}\cdots F^{-1}_{\omega_m}(q_i),\quad i=0,1,2,$$
and we write
$$q_{li}^{(-m)}=F_{\omega_1}^{-1}F^{-1}_{\omega_2}\cdots F^{-1}_{\omega_m}(F_lq_i),\quad l\in W_m=\{0,1,2\}^m.$$
Clearly $q_i=q_{\omega_m\omega_{m-1}\cdots\omega_1 i}^{(-m)}$.

\begin{proposition}
	(a). If $\widetilde{\SG}$ has no boundary, then there is a three dimensional $\ell^\infty$ eigenspace of $\Delta$ corresponding to $4$. (b). If $\widetilde{\SG}$ has a boundary point, then there is a two dimensional $\ell^\infty$ eigenspace of $\Delta$ corresponding to $4$.
\end{proposition}
\noindent\textit{Proof.} (a). Let $f(q_0)=a,f(q_1)=b,f(q_2)=c$, where $a,b,c$ are arbitrary real number. Define
\begin{equation}
\begin{pmatrix}
f(q^{(-m)}_0)\\
f(q^{(-m)}_1)\\
f(q^{(-m)}_2)
\end{pmatrix}=
A^{-1}_{\omega_{m}}\cdots A^{-1}_{\omega_{2}}A^{-1}_{\omega_1}\begin{pmatrix}
f(q_0)\\
f(q_1)\\
f(q_2)
\end{pmatrix},
\end{equation}
and
\begin{equation}\begin{pmatrix}
f(q^{(-m)}_{l0})\\
f(q^{(-m)}_{l1})\\
f(q^{(-m)}_{l2})
\end{pmatrix}=
A_{l_1}A_{l_2}\cdots A_{l_m}\begin{pmatrix}
f(q^{(-m)}_0)\\
f(q^{(-m)}_1)\\
f(q^{(-m)}_2)
\end{pmatrix},\quad\forall l\in W_m.
\end{equation}
See Figure \ref{fig3} for an example of the extension of $f$. One can easily check that $f$ is a $4$-eigenfunction of $\Delta$  on $\widetilde{\mathcal{SG}}$ and $f$ is bounded. By the above construction, we get a three dimensional eigenspace to $4$.

\begin{figure}[htp]
	\includegraphics[width=4cm]{gamma2.pdf}\qquad
	\includegraphics[width=4cm]{gamma2.pdf}
	\begin{picture}(0,0)
	\put(-73,24){$a$}
	\put(-91,-6){$b$}
	\put(-63,-6){$c$}

	\put(-130,-1){$-a$}
	\put(-103,48){$-b$}
	\put(-116,24){$-c$}

	\put(-4,-1){$b$}
	\put(-67,98){$-c$}
	\put(-32,48){$a$}

	\put(-4,-1){$b$}
	\put(-67,98){$-c$}
	\put(-32,48){$a$}

	\put(-89,71){$-a$}
	\put(-46,71){$b$}
	\put(-63,43){$c$}

	\put(-42,-6){$-a$}
	\put(-61,24){$-b$}
	\put(-22,24){$-c$}

	\put(-210,26){$q_0$}
	\put(-228,-5){$q_1$}
	\put(-198,-5){$q_2$}
	\end{picture}
	\caption{An illustration for extending $f$ to be a $4$-eigenfunction.(We take $\omega_1=2,\omega_2=1$ as shown in the left picture.) }\label{fig3}
\end{figure}

On the other hand, noticing that $4$ is not a forbidden eigenvalue, a $4$-eigenfunction $f$ is unqiuely determined by $f|_{V_0}$.

(b). The proof of (b) is essentially the same. The eigenspace is $2$ dimensional as a consequence of the eigenvalue equation at the boundary point.\hfill$\square$

\bibliographystyle{amsplain}