---
abstract: 'We consider the existence of standing pulse solutions of a neural network integro-differential equation. These pulses are bistable with the zero state and may be an analogue for short term memory in the brain. The network consists of a single-layer of neurons synaptically connected by lateral inhibition. Our work extends the classic Amari result by considering a non-saturating gain function. We consider a specific connectivity function where the existence conditions for single-pulses can be reduced to the solution of an algebraic system. In addition to the two localized pulse solutions found by Amari, we find that three or more pulses can coexist. We also show the existence of nonconvex "dimpled" pulses and double pulses. We map out the pulse shapes and maximum firing rates for different connection weights and gain functions.'
author:
- 'Yixin Guo[^1]'
- 'Carson C. Chow[^2]'
bibliography:
- 'paper1.bib'
nocite: '[@Aliprantis0; @Aliprantis1; @Arbib; @Atkinson; @Bender; @Boyce; @Champneys1; @Delevs; @Duffy; @Ellias; @Enander; @Ermentrout1; @Ermentrout2; @Folland; @Fuster1; @Garvan; @Green; @Griffel; @Guo3; @Gutkin; @Haskell; @Kato; @Kuznetsov; @Miller; @Morrison; @Murray; @Nicholls; @Nishiura; @Pelinovsky; @Polianin; @Powers; @Rahman; @Rubin; @Rubin1; @Rudin; @Salinas; @Strogatz; @Troy2; @Troybook; @Wiggins; @Wilson1; @XPPAUT; @Zeidler]'
title: 'Existence and Stability of Standing Pulses in Neural Networks: I. Existence'
---

integro-differential equations, integral equations, standing pulses, neural networks, existence

34A36, 37N25, 45G10, 92B20

Introduction {#sec:intro}
============

The temporary storage of information in the brain for short periods of time is called working memory @Baddeley. It is known that the firing activity of certain neurons in the cortex are correlated with working memory states but it is not known what neural mechanisms are responsible for maintaining the persistent neural activity @fuster [@Goldmanrakic; @Wang]. Experiments find that a specific set of neurons become activated by a memory cue. They fire at a rate above their background levels while the memory is being held and then return to baseline levels after the memory is extinguished. When the neurons are active their firing rates are low compared to their maximal possible rates. Cortical neurons are generally not intrinsically bistable and do not fire unless given an input that is above a threshold @Connors [@Mccormick1; @Mccormick]. It has been suggested that recurrent excitatory inputs in a network could be responsible for maintaining neural activity observed during memories @fuster [@Goldmanrakic; @Grossberg; @Mccormick1; @Mccormick; @Wang1; @Wang; @Wilson; @Wilson1; @Gutkin; @Laing3]. The persistent activity is bistable with the background state. To match experimental data, a memory network must have the ability to maintain persistent activity in a selected subset of the neurons while keeping the firing rates low compared to their possible maximum.

Mathematically, this question has been probed by examining the existence and stability of localized persistent stationary solutions of neural network equations @Amari77 [@Coombes; @Ermentrout; @Ermentrout1; @Grossberg; @Pinto1; @Rubin1; @Wilson; @Wilson1]. These localized states have been dubbed 'bump attractors' @Laing1 [@Laing2; @Laing3; @Gutkin; @Wang; @Wilson]. In a one dimensional network they have also been called standing pulses @Ermentrout [@Pinto1]. While these simple networks do not capture all of the biophysical features of cortical circuits they do capture the qualitative behavior of working memory.

The coarse-grained averaged activity of a neural network can be described by @Amari77 [@Ermentrout; @Grossberg; @Wilson; @Wilson1] $$\begin{aligned}
\label{eq:differentiate}
\tau \frac{\partial u(x,t)}{\partial t} = -u(x,t) + \int_\Omega w(x-y)
f[u(y,t)]dy\end{aligned}$$ where $u(x,t)$ is the synaptic input to neurons located at position $x
\in(-\infty, \infty)$ at time $t \geq 0$, and it represents the level of excitation or amount of input to a neural element. The connection function $w(x)$ determines the connections between neurons. The nonnegative and monotonically non-decreasing gain function $f[u]$, denotes the *firing rate* at $x$ at time $t$. We can set the synaptic decay time $\tau$ to unity without loss of generality.

In his classic work, Amari @Amari77 considered (\[eq:differentiate\]) with a 'Mexican Hat' connection function (i.e. excitation locally and inhibition distally). While this is not biologically realistic for a single layer of neurons, it has been argued that networks of combined excitatory and inhibitory neurons with biophysically plausible connections can effectively mimic a Mexican Hat under certain conditions @Ermentrout [@Kang; @Pinto1]. Amari also made the assumption that $f[u]$ is the Heaviside function. This approximation made (\[eq:differentiate\]) analytically tractable and he was able to find a host of solutions one of them being localized stable pulses that are bistable with zero activity. Kishimoto and Amari @Kishimoto later showed these solutions also existed for a smooth sigmoidal gain function that saturated quickly.

Later work considered two populations @Pinto [@Pinto1], various connectivity functions @Coombes [@Laing1; @Rubin1], and two dimensions @Haskell [@Laing3]. However, all used either the Heaviside gain function or a saturating sigmoidal gain function implying that neurons start to fire when their inputs exceed threshold and saturate to their maximum rate quickly. However, in the brain persistently active neurons fire at rates far below their saturated maximum @Colby [@Compte; @Funahashi; @Wang1; @Wang]. How a network can maintain persistent activity at low firing rates is not fully understood @Camperi [@Compte; @Grossberg; @Laing1; @Latham1; @Latham2; @Renart; @Wang1; @Wang].

The problem of persistent activity at low firing rates cannot be addressed with a quickly saturating gain function. To circumvent this limitation, we use a nonsaturating piecewise-linear gain function with a jump i.e. $\beta=0$ (see Fig. \[fig:gain\_function\]) having the form $$\begin{aligned}
\label{eq:piecewiseligain}
g[u]=\left \{ \begin{array}{ll} \alpha(u-u_{\scriptscriptstyle
T})+\beta& \mbox{\hspace{1.5cm} $u>u_{\scriptscriptstyle T}$} \\ 0 &
\mbox{\hspace{1.5cm} $u \leq u_{\scriptscriptstyle T}$}
\end{array} \right.\end{aligned}$$ When the gain $\alpha$ is zero, (\[eq:piecewiseligain\]) becomes the Heaviside function scaled by $\beta$. We note that others have considered piecewise linear gain functions but without the jump @Benyishai [@Hansel; @Seung]. In these cases, persistent activity is not possible unless the threshold is set to zero and the gain to unity where a multi-stable "line attractor" is possible @Seung.

In this paper we show the existence of isolated convex standing pulse solutions (single-pulses) of (\[eq:differentiate\]). We consider a single one dimensional layer of neurons. Although, this configuration is a major simplification, it has been shown that such networks exhibit features present in more realistic architectures. We investigate how the pulse solutions change when parameters of the gain function and the connection function change. We demonstrate the coexistence of two single-pulse solutions as seen by Amari @Amari77, and give conditions where more than two pulse solutions can coexist. We also show the existence of nonconvex "dimple-pulse" solutions and double-pulse solutions. We derive the stability criteria for stable pulses in an accompanying paper @Guo3.

Neural network equations {#sec:connectionandgain}
========================

We study a neural network (\[eq:differentiate\]) with lateral-inhibition or Mexican Hat type connection function $w(x)$ for which excitatory connections dominate for proximal neurons and inhibitory connections dominate for distal neurons. In general, $w(x)$ satisfies the following six properties.

1.  $w(x)$ is symmetric, i.e. $w(-x)=w(x)$,

2.  $w(x)>0$ on an interval $(-x_0,x_0)$, and $w(-x_0)=w(x_0)=0$,

3.  $w(x)$ is decreasing on $(0,x_0]$;

4.  $w(x)<0$ on $(-\infty, -x_0) \cup (x_0, \infty)$;

5.  $w(x)$ is continuous on $\Re$, and $w(x)$ is integrable on $\Re$;

6.  $w(x)$ has a unique minimum $x_m$ on $\Re^{+}$ such that $x_m>x_0$, and $w(x)$ is strictly increasing on $(x_m,\infty)$.

For concreteness, we consider the connection function given by $$\label{eq:connection}
w(x)=A e^{-a|x|}-e^{-|x|}$$ where $a>1$, and $A>1$ guarantee that $w(x)$ obeys properties 1 - 6. An example of (\[eq:connection\]) is shown in Fig. \[fig:Mexi\]. This connection function is of the lateral inhibition or Mexican Hat class. Perhaps, given the cusp at zero it should be called a "Wizard Hat" function.

\[fig:Mexi\]

For connection function (\[eq:connection\]), ${\displaystyle x_0=\frac{\ln A}{a-1}}$ and ${\displaystyle
x_m=\frac{\ln aA}{a-1}}.$ The area of $w(x)$ above and below the $x$-axis represents the net excitation and inhibition in the network respectively. The total area of (\[eq:connection\]) is $2(\frac{A}{a}-1)$. The amount of excitation and inhibition depends on the ratio of $A$ to $a$. If $A>a$, i.e. $2(\frac{A}{a}-1)>0$, excitation dominates in the network and if $2(\frac{A}{a}-1)<0,$ inhibition dominates. In the balanced case, $A=a$, i.e. $2(\frac{A}{a}-1)=0$.

\[fig:gain\_function\]

The gain function (\[eq:piecewiseligain\]) can be written as $$\begin{aligned}
f[u]=[\alpha(u-u_{\scriptscriptstyle T})+\beta]
\Theta(u-u_{\scriptscriptstyle T})
\label{eq:firingrate}\end{aligned}$$ where $\Theta(u-u_{\scriptscriptstyle T})$ is the Heaviside function such that $$\Theta(u-u_{\scriptscriptstyle T})=\left\{ \begin{array}{ll} 1 & {\rm
if} \ u > u_{\scriptscriptstyle T} \\ 0 & \mbox{otherwise}
\end{array}\right..$$ The gain function (\[eq:firingrate\]) does not saturate with a positive slope $\alpha$. Without loss of generality, we set $\beta=1$. The gain function (\[eq:firingrate\]) turns into the Heaviside function when $\alpha=0$ ( See Fig. \[fig:gain\_function\]).

A stationary solution of (\[eq:differentiate\]) satisfies the equilibrium equation $$\label{eq:integral_equation2}
u(x)=\int_{-\infty}^{\infty}w(x-y)f[u(y)]dy.$$ An example of a working memory state can be seen by considering constant solutions of (\[eq:integral\_equation2\]). For $u(x)=u^0$, the integral equation becomes $$\begin{aligned}
u^0=f[u^0]\int_{-\infty}^{\infty}w(y)dy \end{aligned}$$ Using (\[eq:connection\]), the constant solution satisfies $$\begin{aligned}
\label{eq:u0sol}
u^0=w^0 f[u^0].\end{aligned}$$ where $w^0=2(A/a-1)$. From (\[eq:u0sol\]), we immediately see that $u^0=0$ is a solution. In fact, zero is a solution of (\[eq:integral\_equation2\]) for any positive threshold $u_{\scriptscriptstyle T}$ and any values of parameters $a$, $A$, and $\alpha.$

Inserting gain function (\[eq:firingrate\]) into (\[eq:u0sol\]) gives $$u^0=w^0(\alpha (u^0 - u_{\scriptscriptstyle T}) +1)
\label{eq:u02}$$ The existence of constant solutions can be deduced graphically (see Fig. \[fig:consdomainm1\]). Nontrivial constant solutions ($u^0>0$) require $w^0>0$ which means that $A/a>1$. Thus only for net excitatory connections are nontrivial constant solutions possible. A simple stability calculation shows that $\alpha<1$ is necessary for stability. Condition (\[eq:u02\]) shows that for $u_T<0$ and $\alpha<1$, there is a single stable solution. If $u_T>0$ and $\alpha>0$ there can be three solutions (see Fig. \[fig:consdomainm1\]). Two of the solutions, $u^0=0$ and $u^0>u_T$ are stable. The third solution at $u^0=u_T$ is unstable. For this parameter set, the network exhibits working memory-like behavior. The network is stable in the background state $u^0=0$. A transient input from a memory cue can switch the network into the stable $u^0>u_T$ state which represents the memory. This is a state of persistent activity that is sustained by positive feedback. The state can be switched off to zero by another transient input when it is no longer needed. The next section will examine spatially localized pulses that have the same memory property.

\[fig:consdomainm1\]

Single-pulse solutions {#sec:singlepulse}
======================

We prove the existence and determine the properties of localized stationary persistent states which we call single-pulses. We consider single-pulse solutions of (\[eq:integral\_equation2\]) that satisfy the following:

\[de:single-pulse\] <span>**<span>Single-pulse solution</span>:**</span> \[def:single-pulse\] $$u(x) \left \{ \begin{array}{ll} >u_{\scriptscriptstyle T} &
  \mbox{$\mathrm{if}$ $x\in(-x_{\scriptscriptstyle
      T},x_{\scriptscriptstyle T})$, $x_{\scriptscriptstyle T}>0$}\\
  =u_{\scriptscriptstyle T} & \mbox{$\mathrm{if}$
    $x=-x_{\scriptscriptstyle T},x=x_{\scriptscriptstyle T}$} \\
  <u_{\scriptscriptstyle T} & \mbox{$\mathrm {otherwise}$}
\end{array} \right.$$ such that ${\displaystyle (u,u',u'',u''') \rightarrow (0,0,0,0)}$ exponentially fast as $x \rightarrow \pm \infty$ and $u, u' \in
L^1(\Re)$. $u$ and $u'$ are bounded and continuous on $\Re$. $u''$, $u'''$, and $u''''$ are continuous everywhere except at $x=\pm
x_{\scriptscriptstyle T}$ and bounded everywhere on $\Re$. $u(x)$ is symmetric with $u''(0)<0$; $u(0)$ is the maximum between $-x_{\scriptscriptstyle T}$ and $x_{\scriptscriptstyle T}$ ( $\mathrm
{Fig.~\ref{fig:bumppic}}.)$

We note that there also exist pulses where $u''(0)>0$, which implies $u(0)$ is no longer the maximum of the pulse. We call this solution a <span>*dimple-pulse*</span>. The theorem below gives a range for which there is no single-pulse solution.

\[th:nobump\] For fixed $a$, $A$ and $\beta=1$, there is no single-pulse solution if both ${\displaystyle \alpha<\frac{a}{2A}}$ and ${\displaystyle
u_{\scriptscriptstyle T}>\frac{2A}{a}}$ are true.

Substituting the exponential connection function (\[eq:connection\]) and gain function (\[eq:firingrate\]) into the integral equation (\[eq:integral\_equation2\]) gives $$u(x)=\int_{\-\infty}^{\infty}(Ae^{-a|x-y|}-e^{-|x-y|})[\alpha(u(y)-u_{\scriptscriptstyle
T})+ 1]\Theta(u-u_{\scriptscriptstyle T})dy.$$ Suppose there is a single-pulse solution as defined above when both ${\displaystyle \alpha<\frac{a}{2A}}$ and ${\displaystyle
u_{\scriptscriptstyle T}>\frac{2A}{a}}$ are satisfied. For a single pulse to exist $$\begin{aligned}
u(0) & = &
\int_{-\infty}^{\infty}(Ae^{-a|y|}-e^{-|y|})[\alpha(u(y)-u_{\scriptscriptstyle
T})+ 1]\Theta(u-u_{\scriptscriptstyle T})dy \nonumber \\ & = &
\int_{-x_{\scriptscriptstyle T}}^{x_{\scriptscriptstyle
T}}(Ae^{-a|y|}-e^{-|y|})[\alpha(u(y)-u_{\scriptscriptstyle T})+ 1]dy
\nonumber \\ & \leq & \int_{-x_{\scriptscriptstyle
T}}^{x_{\scriptscriptstyle
T}}Ae^{-a|y|}[\alpha(u(y)-u_{\scriptscriptstyle T})+ 1]dy \nonumber
\label{eq:eqn1}\end{aligned}$$ where $u(x)\ge u_T$ is continuous on $I:=[-x_{\scriptscriptstyle T},
x_{\scriptscriptstyle T}]$. $Ae^{-a|y|}$ is integrable on $I$ and $Ae^{-a|y|} \geq 0$ for all $x \in I$. By the Mean Value Theorem for Integrals, $\exists$ $ c^0 \in I$ s.t. $$\begin{aligned}
u(0) & \le & (\alpha u(c^0) -\alpha u_T+1)
\int_{-x_{\scriptscriptstyle T}}^{x_{\scriptscriptstyle
T}}Ae^{-a|y|}dy \nonumber \\ & \leq & \alpha P u(c^0) + (1-\alpha
u_{\scriptscriptstyle T}) P\end{aligned}$$ where ${\displaystyle
P=\int_{-\infty}^{\infty}Ae^{-a|y|}dy=\frac{2A}{a}}$. If $\alpha P
<1$ and $(1-\alpha u_{\scriptscriptstyle T}) \leq 0$ are both true, then $u(0) < u(c^0)$, $c \in I$. However, this cannot be true because $u(0)$ is the maximum of $u(x)$ on $\Re$. From $\alpha P <1$, we get ${\displaystyle \alpha <\frac{a}{2A}}$. From $(1-\alpha
u_{\scriptscriptstyle T}) \leq 0$, ${\displaystyle
u_{\scriptscriptstyle T} \geq
\frac{1}{\alpha}>\frac{2A}{a}}$. Therefore, there is no single-pulse when both ${\displaystyle \alpha <\frac{a}{2A}}$ and ${\displaystyle
u_{\scriptscriptstyle T} > \frac{2A}{a}}$ are both true. In other words if the gain is too low or the threshold too high, there cannot be a single-pulse.

Strategy to construct a single-pulse solution {#sec:strategy}
---------------------------------------------

The general approach to studying integral equation (\[eq:integral\_equation2\]) is to derive an associated differential equation whose solutions are also solutions of the integral equation. We derive the differential equation by using the Fourier transform $$\begin{aligned}
F[g(x)]=\int_{-\infty}^{\infty}g(x)e^{isx}dx\end{aligned}$$ where $g \in L^{1}(\Re)$ and $s \in \Re$, with the inverse Fourier transform $$\begin{aligned}
g(x)=\frac{1}{2\pi}\int_{-\infty}^{\infty}F[g(x)]e^{-isx}ds.\end{aligned}$$

For our conditions on $u(x)$ and $w(x)$, an application of the Fourier transform to (\[eq:integral\_equation2\]) is well-defined and turns the convolution into a point-wise product $$\label{eq:convol}
F[u]=F[w]F[f[u]].$$ Computing $F[w]$ in (\[eq:convol\]) gives $$\label{eq:equ1}
F[u] =\frac{(2aA+2as^2A-2a^2-2s^2)}{(a^2+a^2s^2+s^2+s^4)}F[f].$$ Multiplying both sides of (\[eq:equ1\]) by the denominator of the right hand side and using the linear property of the Fourier Transform with the identities $F[u'']=-s^2F[u]$ and $F[u^{''''}]=s^4F[u]$ gives $$\label{eq:ode1}
F[u^{''''}-(a^2+1)u''+a^2u] = F[2(aA-a^2)f]+2(aA-1)F[s^2f].$$ By the definitions of $u(x)$ and $f[u]$, $$F[u^{''''}-(a^2+1)u''+a^2u]$$ and $$F[2(aA-a^2)f]$$ are in $L^1(\Re)$.

Integrating $F[s^2f]$ by parts yields $$\begin{aligned}
\lefteqn{F[s^2f] } \\ &=&\int_{-\infty}^{\infty}s^2e^{isx}f[u(x)]dx \\
& = & \int_{-x_{\scriptscriptstyle T}}^{x_{\scriptscriptstyle
T}}s^2e^{isx}f[u(x)]dx\\ &=&f[u(x_{\scriptscriptstyle
T})](-ise^{isx_{\scriptscriptstyle T}}+ise^{-isx_{\scriptscriptstyle
T}})+f'[u(x_{\scriptscriptstyle T}^-)]u'(x_{\scriptscriptstyle
T})(e^{isx_{\scriptscriptstyle T}}+e^{-isx_{\scriptscriptstyle T}})\\
& & -\int_{-x_{\scriptscriptstyle T}}^{x_{\scriptscriptstyle
T}}e^{isx}\frac{d^2f[u(x)]}{dx^2}dx.\end{aligned}$$ Note that $f[u(x)] = 0$ outside of $(-x_{\scriptscriptstyle T},
x_{\scriptscriptstyle T})$ and $F[s^2f] \in L^1(\Re)$.

Applying the inverse Fourier transform to (\[eq:ode1\]) gives a fourth order ordinary differential equation $$\begin{aligned}
\label{eq:general_ode} 
&& u^{''''}-(a^2+1)u''+a^2u = 2(aA-a^2)f[u(x)]+
\\ & & 2(aA-1)\left\{f[u(x_{\scriptscriptstyle
T})]\Delta'(x)+f'[u(x_{\scriptscriptstyle
T}^-)]u'(x_{\scriptscriptstyle T}) \Delta(x)- \frac{d^2f[u(x)]}{dx^2}
\right\} \nonumber\end{aligned}$$ where $$\Delta'(x)=\delta'(x-x_{\scriptscriptstyle
T})+\delta'(x+x_{\scriptscriptstyle T})$$ and $$\Delta(x)=\delta(x-x_{\scriptscriptstyle
T})+\delta(x+x_{\scriptscriptstyle T}).$$ Here $\delta(x)$ and $\delta'(x)$ are defined as @Folland $${\displaystyle \delta(x)=\int_{-\infty}^{\infty} e^{isx}dx},
\mbox{\hspace{1cm}} {\displaystyle
\delta'(x)=is\int_{-\infty}^{\infty} e^{isx}dx}.$$ If $u(x)$ is a solution of (\[eq:general\_ode\]) where (\[eq:convol\])-(\[eq:ode1\]) hold, then $u(x)$ is also a solution of (\[eq:integral\_equation2\]).

We construct a single-pulse solution as in Fig. \[fig:bumppic\] by decomposing ODE (\[eq:general\_ode\]) into two linear differential equations: $$\begin{aligned}
\label{eq:regIODE1}
\mbox{} \hspace{0.7cm} u^{''''}-(a^2+1)u''+a^2u & =& 2a(A-a)f(u)-2(aA-1)
\frac{d^2f[u]}{dx^2},  \mbox{if $u>u_{\scriptscriptstyle T}$ (region
I)} \\
\mbox{}  \hspace{0.7cm} u^{''''}-(a^2+1)u''+a^2u & = &0, 
\mbox{\hspace{3cm} if $u<u_{\scriptscriptstyle T}$ (region II and III)}
\label{eq:regIIODE2}\end{aligned}$$

\[fig:bumppic\]

We label the solution of (\[eq:general\_ode\]) on regions I, II and III, $u_{\mathrm I}(x)$ by $u_{\mathrm {II}}(x)$ and $u_{\mathrm {III}}(x)$ respectively. The solutions $u_{\mathrm I}(x)$, $u_{\mathrm {II}}(x)$ and $u_{\mathrm {III}}(x)$ must be connected together at $-x_{\scriptscriptstyle T}$ and $x_{\scriptscriptstyle T}$ to get a continuous and smooth $u(x)$ on $\Re$. $u_{\mathrm I}(x)$ and $u_{\mathrm {II}}(x)$ are connected at $x_{\scriptscriptstyle T}$ with five matching conditions: $$\begin{aligned}
\label{eq:matchingcondition1}
u_{\mathrm I}(x_{\scriptscriptstyle T}) & = & u_{\scriptscriptstyle T}
\\
\label{eq:matchingcondition2}
u_{\mathrm {II}}(x_{\scriptscriptstyle T})& = & u_{\scriptscriptstyle
T} \\
\label{eq:matchingcondition3}
u_{\mathrm I}'(x_{\scriptscriptstyle T})& = & u_{\mathrm
{II}}'(x_{\scriptscriptstyle T}) \\
\label{eq:matchingcondition4} u_{\mathrm I}''(x_{\scriptscriptstyle T})& = &
u_{\mathrm {II}}''(x_{\scriptscriptstyle
T})-2(aA-1)f(u(x_{\scriptscriptstyle T})) \\
\label{eq:matchingcondition5} u_{\mathrm I}'''(x_{\scriptscriptstyle T})& = &
u_{\mathrm {II}}'''(x_{\scriptscriptstyle
T})-2(aA-1)f'(u(x_{\scriptscriptstyle T}))u'(x_{\scriptscriptstyle T})\end{aligned}$$ Conditions (\[eq:matchingcondition1\])-(\[eq:matchingcondition3\]) are given by the continuity of $u(x)$ and $u'(x)$. (\[eq:matchingcondition5\]) is obtained by integrating (\[eq:general\_ode\]) over a small neighborhood of $x_{\scriptscriptstyle T}$. (\[eq:matchingcondition4\]) is obtained by integrating (\[eq:general\_ode\]) twice, first with respect to $x$, then over a small neighborhood of $x_{\scriptscriptstyle T}$. $u''(x)$ and $u'''(x)$ are discontinuous at $x_{\scriptscriptstyle
T}$, $i.e.$ there are jumps in $u''(x_{\scriptscriptstyle T})$ and $u'''(x_{\scriptscriptstyle T})$. Since $u(x)$ is symmetric, similar matching conditions apply to $u_{\mathrm I}(x)$ and $u_{\mathrm
{III}}(x)$ at $-x_{\scriptscriptstyle T}$.

In region II, the solution for a single pulse that satisfies the boundary conditions is $$\begin{aligned}
\label{eqa:solregII}
u_{\mathrm {II}}(x)=Ee^{-ax}+Fe^{-x}\mbox{\hspace{3cm}}
\mbox{\hspace{2cm}}E, F \in \Re.\end{aligned}$$ By symmetry, the solution in region III is $$\begin{aligned}
\label{eqa:solregIII}
u_{\mathrm {III}}(x)=Ee^{ax}+Fe^{x},\mbox{\hspace{3cm}}
\mbox{\hspace{2cm}}E, F \in \Re.\end{aligned}$$

In region I, substituting $f[u(x)]=\alpha(u-u_{\scriptscriptstyle
T})+1$ and ${\displaystyle \frac{d^2f[u(x)]}{dx^2}=\alpha u''(x)}$ into (\[eq:regIODE1\]) gives $$\begin{aligned}
\label{eq:regIODE} \hspace{1.cm}u^{''''}-(a^2+1-2\alpha(aA-1))u''+(a^2-2a\alpha(A-a))u
=2a(A-a)(1-\alpha u_{\scriptscriptstyle T})\end{aligned}$$ The eigenvalues of (\[eq:regIODE\]) are $\omega_1$, $-\omega_1$, $\omega_2$, $- \omega_2$ where $$\begin{aligned}
\omega_1^2 & = & R+S \label{eiv1}\\ \omega_2^2 & = & R-S \label{eiv2}\end{aligned}$$ with $$R=\frac{(a^2+1-2\alpha(aA-1))}{2},
\label{R}$$ $$S=\frac{\sqrt{\Delta}}{2},
\label{S}$$ and $$\Delta=(a^2+1-2\alpha(aA-1))^2-4(a^2-2a\alpha(A-a)).
\label{Delta}$$ Imposing symmetry and $u'(0)=0$, the general solution of ODE(\[eq:regIODE\]) can be written in the form: $$\label{eq:generalsolregI}
u_{\mathrm I}(x)=C(e^{\omega_1x}+e^{-\omega_1x})+D(e^{\omega_2x}+e^{-\omega_2x})+U_0$$ where $$U_0 = \frac{2(A-a)(\beta-\alpha u_{\scriptscriptstyle T})}{a-2\alpha(A-a)}$$ for $x \in (-x_{\scriptscriptstyle T}, x_{\scriptscriptstyle
T})$, $x_{\scriptscriptstyle T} \in \Re$, $C, D \in \mathbf{C}$, and $u_{\mathrm I}(x)\in \Re$.

The single-pulse solutions of (\[eq:general\_ode\]) are found by matching $u_I$, $u_{II}$, and $u_{III}$ across $x_{\scriptscriptstyle
  T}$ and $-x_{\scriptscriptstyle T}$ using the matching conditions (\[eq:matchingcondition1\]) - (\[eq:matchingcondition2\]). We investigate the existence and shape of single-pulse solutions as we change the gain and connection function. For simplicity, we call $x_{\scriptscriptstyle T}$ the width of a pulse although it is actually the half width. The height of a single-pulse is $u(0)$. The firing rate of the pulse is given by $f[u]$.

Solutions for the Amari case ($\alpha=0$) {#sec:amari}
-----------------------------------------

Amari found conditions for which single-pulse solutions exist for (\[eq:integral\_equation2\]) with general Mexican Hat connectivity and the Heaviside gain function @Amari77. Here, we revisit the Amari case for the exponential connection function (\[eq:connection\]). When $\alpha=0$ and $\beta=1$, the gain function (\[eq:firingrate\]) becomes the Heaviside function $\Theta(u)$ and the term ${\displaystyle
2(aA-1)\frac{d^2f[u]}{dx^2}}$ does not exist in ODE (\[eq:regIODE1\]). The eigenvalues (\[eiv1\]) and (\[eiv2\]) become simple and the solutions (\[eq:generalsolregI\]) and (\[eqa:solregII\]) are $$\begin{aligned}
\label{eq:amsolregI} u_{\mathrm I}(x)& =
&C(e^{ax}+e^{-ax})+D(e^{x}+e^{-x})+U_0, \\ \label{eq:amsolregII}
u_{\mathrm {II}}(x) & = & Ee^{-ax}+Fe^{-x},\end{aligned}$$ respectively. Applying conditions (\[eq:matchingcondition1\])-(\[eq:matchingcondition5\]) to (\[eq:amsolregI\]) and (\[eq:amsolregII\]) yields the system

$$\label{eq:am1}
Ee^{-ax_{\scriptscriptstyle T}}+Fe^{-x_{\scriptscriptstyle T}} =
u_{\scriptscriptstyle T}$$

$$\label{eq:am2} C(e^{ax_{\scriptscriptstyle T}}+e^{-ax_{\scriptscriptstyle
T}})+D(e^{x_{\scriptscriptstyle T}}+e^{-x_{\scriptscriptstyle
T}})+\frac{2(A-a)\beta}{a} = u_{\scriptscriptstyle T}$$

$$\begin{aligned}
\label{eq:am3} aC(e^{ax_{\scriptscriptstyle
T}}-e^{-ax_{\scriptscriptstyle T}})+D(e^{x_{\scriptscriptstyle
T}}-e^{-x_{\scriptscriptstyle T}}) & =& -aEe^{-ax_{\scriptscriptstyle
T}}-Fe^{-x_{\scriptscriptstyle T}} \\ \label{eq:am4}
a^2C(e^{ax_{\scriptscriptstyle T}}+e^{-ax_{\scriptscriptstyle
T}})+D(e^{x_{\scriptscriptstyle T}}+e^{-x_{\scriptscriptstyle T}}) &=&
a^2Ee^{-ax_{\scriptscriptstyle T}}+Fe^{-x_{\scriptscriptstyle T}} -2
(a A-1) \beta \\ \label{eq:am5} a^3C(e^{ax_{\scriptscriptstyle
T}}-e^{-ax_{\scriptscriptstyle T}})+D(e^{x_{\scriptscriptstyle
T}}-e^{-x_{\scriptscriptstyle T}}) &=& -a^3Ee^{-ax_{\scriptscriptstyle
T}}-Fe^{-x_{\scriptscriptstyle T}}\end{aligned}$$

<span>2.5in</span>

<span>2.5in</span>

\[fig:ambump\]

The system (\[eq:am1\]) - (\[eq:am5\]) is linear in the coefficients $C$, $D$, $E$, and $F$ which can be solved in terms of $x_{\scriptscriptstyle T}$: $$\begin{array}{lll}
C & = & {\displaystyle -\frac{A}{a}e^{-ax_{\scriptscriptstyle T}} }\\
D & = & e^{-x_{\scriptscriptstyle T}} \\ E & = & {\displaystyle
\frac{A}{a}(e^{ax_{\scriptscriptstyle T}}-e^{-ax_{\scriptscriptstyle
T}})} \\ F & = & -(e^{x_{\scriptscriptstyle
T}}-e^{-x_{\scriptscriptstyle T}}) \\
\end{array}$$ &gt;From these coefficients we arrive at the following proposition for single-pulse solutions.

\[cl:amaripulsecondition\] There are two pulse solutions when ${u_{\scriptscriptstyle T}
\leq\int_{0}^{(\ln A)/(a-1)}w(x)dx}$ and ${\displaystyle
(\frac{A}{a}-1) < u_{\scriptscriptstyle T}}$ for $A>a$ and $0\le
u_{\scriptscriptstyle T}$ for $A<a$ .

Substituting $E$ and $F$ into (\[eq:am1\]) (or $C$ and $D$ into (\[eq:am2\])), gives an existence condition for a single-pulse: $\Phi(x_{\scriptscriptstyle T})=u_{\scriptscriptstyle T}$, where $$\Phi(x)= \frac{A}{a}(1-e^{-2ax})-(1-e^{-2x}).$$ We term $\Phi(x)$ the "existence function". Two examples are shown in Figs. \[fig:amexist1\] and \[fig:amexist2\] where the curve $\Phi(x)$ crosses $u_{\scriptscriptstyle T}$ twice, implying that there are two single-pulse solutions.

Since $$\lim_{x \rightarrow \infty} \Phi(x)=\frac{A}{a}-1= \left \{
\begin{array}{lcc} <0 & \mbox{if $A<a$} & (\mbox{ Figure
\ref{fig:amexist1}}) \\ \geq 0 & \mbox{if $A \geq a$} & (\mbox{Figure
\ref{fig:amexist2}})
\end{array} \right.,$$ the lower bound of $u_{\scriptscriptstyle T}$ that supports two pulses is $0$ if $A<a$ and the lower bound of $u_{\scriptscriptstyle T}$ that guarantees two pulses is ${\displaystyle \frac{A}{a}-1}$ when $A>a$.

The upper bound on threshold $u_{\scriptscriptstyle T}$ that supports two pulse solutions is the maximum of $\Phi(x)$. Solving $$\begin{aligned}
\frac{d \Phi}{d x}=Ae^{-2ax}-2e^{-2x}=0\end{aligned}$$ gives ${\displaystyle x=\frac{\ln A}{2(a-1)}}$. Thus $\Phi$ reaches its maximum at $$\Phi(x)=\frac{A}{a}(1-e^{-\frac{a \ln A}{a-1}})-(1-e^{-\frac{\ln
A}{a-1}})=\int_{0}^{\frac{\ln A}{a-1}} w(x)dx$$ proving the proposition.

Proposition \[cl:amaripulsecondition\] does not immediately imply that there are two single-pulses because for a small threshold there can exist a dimple-pulse (Fig \[fig:amaridimple\].) In Fig. \[fig:amexist2\], as $u_T$ is lowered, $P$ is the transition point where $u''=0$ and single-pulse <span>**l**</span> transforms into the dimple-pulse ${\bf d}$. The small single-pulse <span>**s**</span> always remains a single-pulse. The transition point $P$ is identified by following $u''(0)$ as a function of $u_{\scriptscriptstyle T}$ using the continuation program AUTO.

In the accompanying paper we compute the stability of these solutions. In agreement with Amari @Amari77 we find that the large pulse is stable and the small pulse is unstable. Additionally, we find that dimple pulse solutions can also be stable.

Solutions for the general case {#sec:eigenvaluestructure}
------------------------------

For the general case of $\alpha \neq 0$, the complex eigenvalues $\omega_1$, $-\omega_1$, $\omega_2$, $-\omega_2$ given by (\[eiv1\]) and (\[eiv2\]) will change form for different parameter values. The transition points for the eigenvalues are given by the relative signs of functions $R$ (\[R\]), $S$ (\[S\]) and $\Delta$ (\[Delta\]). There are three cases: both eigenvalues $\omega_{1,2}$ are real, both are complex or both are imaginary.

We consider the transitions when $\alpha$ is changed for fixed $a$ and $A$. We find that there are five critical points where the eigenvalue structure changes. At $\alpha=\alpha_0\equiv a/(2(A-a))$, $R-S=0$, with $R>0$ and $\Delta>0$. The solutions of the quadratic equation $\Delta(\alpha)=0$ give $\alpha_1$ and $\alpha_3$. At $\alpha_2$, $R=0.$ At $\alpha_4=a/(2(A-a))$, $R+S=0$ with $R<0$ and $\Delta>0$. We arrange $\alpha_i$ ($i=0,1,2,3,4$) in increasing order. $\omega_1$ and $\omega_2$ are complex conjugates for both $\alpha \in (\alpha_1, \alpha_2)$ and $\alpha \in (\alpha_2, \alpha_3).$ In our analysis, we only consider the case where $\alpha>0$ (i.e. the firing rate is increasing with input). The case of $\alpha=0$ with the general connection weight function was fully treated in @Amari77 and is reevaluated in Sec. \[sec:amari\]. Tables \[tab:eigenvalue1\], \[tab:eigenvalue2\], and \[tab:eigenvalue3\] enumerate all the possible forms of $\omega_1$ and $\omega_2$.

  ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
                                    E1                                         E2                                                     E3                                                               E4                                                               E5                                                E6
  ------------- ------------------------------------------ ------------------------------------------- ----------------------------------------------------------------- --------------------------------------------------------------- ----------------------------------------------------------------- ---------------------------------
                              $\triangle >0$                               $\triangle                                           $\triangle >0$                                                    $\triangle=0$                                                    $\triangle<0$                                      $\Delta>0$
                                                                                >0$                                                                                                                                                                                                                        

                                $R<0<|R|$                                                                                           $R<0<S$                                                                                                                                                                            $R<0<|R|$

                                 $|R|<S$                                     $0<S<R$                                                $S<|R|$                                                                                                                                                                             $|R|=S$

   $ \omega_1$                     real                                real$$& imaginary$$                                        $=\omega_2$                                                $=\omega_2^*$, complex                                                $=\sqrt{2R}$                            

   $\omega_2$                   imaginary                             real $$& imaginary$$                                        $=\omega_1$                                                $=\omega_1^*$, complex                                                     $0$                                

    $\alpha$     $(\alpha_{\scriptscriptstyle 4},\infty)$   $(-\infty,\alpha_{\scriptscriptstyle 1})$   $(\alpha_{\scriptscriptstyle 3},\alpha_{\scriptscriptstyle 4})$   $\alpha_{\scriptscriptstyle 1},\alpha_{\scriptscriptstyle 3}$   $(\alpha_{\scriptscriptstyle 1},\alpha_{\scriptscriptstyle 3})$   $\alpha_{\scriptscriptstyle 4}$
  ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

  : Eigenvalue chart when $A>a$

\[tab:eigenvalue1\]

  -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
                                     E1                                                     E2                                                     E3                                                   E4                                                               E5                                                E6
  -------------- ------------------------------------------- ----------------------------------------------------------------- ------------------------------------------ --------------------------------------------------------------- ----------------------------------------------------------------- ---------------------------------
                               $\triangle >0$                                           $\triangle                                           $\triangle >0$                                        $\triangle=0$                                                    $\triangle<0$                                      $\Delta>0$
                                                                                             >0$                                                                                                                                                                                                            

                                   $0<R<S$                                                $0<S<R$                                             $R<0<S<|R|$                                                                                                                                                                $0<R=S$

        $                           real                                            real$$& imaginary$$                                       $=\omega_2$                                             complex                                                       $=\sqrt{2R}$                            
      \omega_1$                                                                                                                                                                                                                                                                                             

    $\omega_2$                    imaginary                                        real $$& imaginary$$                                       $=\omega_1$                                            , complex                                                           $0$                                

     $\alpha$     $(-\infty,\alpha_{\scriptscriptstyle 0})$   $(\alpha_{\scriptscriptstyle 0},\alpha_{\scriptscriptstyle 1})$   $(\alpha_{\scriptscriptstyle 3},\infty)$   $\alpha_{\scriptscriptstyle 1},\alpha_{\scriptscriptstyle 3}$   $(\alpha_{\scriptscriptstyle 1},\alpha_{\scriptscriptstyle 3})$   $\alpha_{\scriptscriptstyle 0}$
  -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

  : Eigenvalue chart when $A<a$.

\[tab:eigenvalue2\]

  -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
                      E1                            E2                                          E3                                     E4                                   E5                    E6
  ------------ ---------------- ------------------------------------------- ------------------------------------------ ----------------------------------- ------------------------------------ -------
                $\triangle >0$                  $\triangle                                $\triangle >0$                          $\triangle=0$                       $\triangle<0$             
                                                     >0$                                                                                                                                        

                   $0<R<S$                        $0<S<R$                                  $R<0<S<|R|$                                                                                           $R=S$

       $                                          real$$                                    imaginary                              $=\omega_2$                    $=\omega_2^*$, complex          $$
   \omega_1$                                                                                                                                                                                    

   $\omega_1$    $\emptyset$                real $$&$$imaginary                            $=\omega_2$                       $=\omega_1^*$, complex                    $ \emptyset$             

    $\alpha$          $$         $(-\infty,\alpha_{\scriptscriptstyle 1})$   $(\alpha_{\scriptscriptstyle 3},\infty)$      $\alpha_{\scriptscriptstyle         $(\alpha_{\scriptscriptstyle       $$
                                                                                                                        1},\alpha_{\scriptscriptstyle 3}$   1},\alpha_{\scriptscriptstyle 3})$  
  -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

  : Eigenvalue chart when $A=a$.

\[tab:eigenvalue3\]

Although both $\alpha_0$ and $\alpha_4$ have the same expression, they do not co-exist. When $A<a$, ${\displaystyle
\alpha_0=\frac{a}{2(A-a)}<0}$ and when $A>a$, ${\displaystyle
\alpha_4=\frac{a}{2(A-a)}>0}$. For all values of $\omega_1$ and $\omega_2$, $u_{\mathrm {II}}(x)$ and $u_{\mathrm {III}}(x)$ always have the form (\[eqa:solregII\]) and (\[eqa:solregIII\]) respectively.

Solutions for real eigenvalues
------------------------------

### Construction of single-pulse solutions {#sec:real}

For $\alpha \in (0,\alpha_1)$, both $\Delta$ and $R$ are positive, so $\omega_1$ and $\omega_2$ are both real. Hence $u_{\mathrm I}(x)$ and $u_{\mathrm {II}}(x)$ have the following form: $$\begin{aligned}
\label{eq:solregI}
u_{\mathrm I}(x) & = &
C(e^{\omega_1x}+e^{-\omega_1x})+D(e^{\omega_2x}+e^{-\omega_2x})+\frac{2(A-a)(\beta-\alpha
u_{\scriptscriptstyle T})}{a-2\alpha(A-a)}\\
\label{eq:solregII}
u_{\mathrm {II}}(x)& = & Ee^{-ax}+Fe^{-x}\end{aligned}$$ When eigenvalues $\omega_1$ and $\omega_2$ are real, $C$ and $D$ must also be real for real $u_{\mathrm I}(x)$. Applying the the matching conditions (\[eq:matchingcondition1\])-(\[eq:matchingcondition5\]) to (\[eq:solregI\]) and (\[eq:solregII\]) yields

$$\begin{aligned}
\label{eq:real1}
Ee^{-ax_{\scriptscriptstyle T}}+Fe^{-x_{\scriptscriptstyle T}}& =&
u_{\scriptscriptstyle T} \\
\label{eq:real2}  C(e^{\omega_1x_{\scriptscriptstyle
T}}+e^{-\omega_1x_{\scriptscriptstyle
T}})+D(e^{\omega_2x_{\scriptscriptstyle
T}}+e^{-\omega_2x_{\scriptscriptstyle T}})+U_0 &=& u_{\scriptscriptstyle
T} \\ \label{eq:real3} \omega_1C(e^{\omega_1x_{\scriptscriptstyle
T}}-e^{-\omega_1x_{\scriptscriptstyle
T}})+\omega_2D(e^{\omega_2x_{\scriptscriptstyle
T}}-e^{-\omega_2x_{\scriptscriptstyle T}}) &=&
-aEe^{-ax_{\scriptscriptstyle T}}-Fe^{-x_{\scriptscriptstyle T}} \\
\label{eq:real4} \omega_1^2C(e^{\omega_1x_{\scriptscriptstyle
T}}+e^{-\omega_1x_{\scriptscriptstyle
T}})+\omega_2^2D(e^{\omega_2x_{\scriptscriptstyle
T}}+e^{-\omega_2x_{\scriptscriptstyle T}})& =&
a^2Ee^{-ax_{\scriptscriptstyle T}}+Fe^{-x_{\scriptscriptstyle T}}- \\ 
& & 2 (a A-1)\beta \nonumber\\
\label{eq:real5}
\hspace{1.3cm}\omega_1^3C(e^{\omega_1x_{\scriptscriptstyle
T}}-e^{-\omega_1x_{\scriptscriptstyle
T}})+\omega_2^3D(e^{\omega_2x_{\scriptscriptstyle
T}}-e^{-\omega_2x_{\scriptscriptstyle T}})& =& (-a^3+2a \alpha
(aA-1))Ee^{-ax_{\scriptscriptstyle T}}+ \\
 & &(-1 +2 \alpha (aA-1))Fe^{-x_{\scriptscriptstyle T}}\nonumber\end{aligned}$$

System (\[eq:real1\]) - (\[eq:real5\]) can be solved for the five unknowns $C, D, E, F$ and $x_{\scriptscriptstyle T}$ using Mathematica @Mathematica, giving an explicit formula for $u_{\mathrm I}(x)$ and $u_{\mathrm {II}}(x)$. The single-pulse is then given by $u_{\mathrm I}(x)$ on $(-x_{\scriptscriptstyle T}, x_{\scriptscriptstyle T})$, $u_{\mathrm
{II}}(x)$ on $(x_{\scriptscriptstyle T}, \infty)$ and $u_{\mathrm
{III}}(x)$ on $(-\infty, x_{\scriptscriptstyle T})$. For the parameter set $(a, A, \alpha, \beta, u_{\scriptscriptstyle T})=(2.6, 2.8, 0.15,
1, 0.400273)$, the solution is $(C, D, E, F, x_{\scriptscriptstyle T}
)=(-0.8532, 1.16865, 2.94108, -0.89571, 0.41902)$. Figure \[fig:0.15alpbumpmatch\] shows a graph of this single-pulse. The height $u_{\mathrm I}(0)$ of the pulse is $0.77892$. Its width is $x_{\scriptscriptstyle T}^{\scriptscriptstyle \mathrm{\bf
l}}=0.41902$. There also exists a second smaller and narrower single-pulse solution to (\[eq:real1\])-(\[eq:real5\]) for the same set of parameters (see Fig. \[fig:0.15alpsmallbigbump\]). The height and the width of this pulse are $u_{\mathrm I}(0)=0.6123$ and $x_{\scriptscriptstyle T}^{\scriptscriptstyle \mathrm{\bf s}}=0.2582$ respectively.

\[fig:0.15alpbumpmatch\]

<span>2.5in</span>

<span>2.5in</span>

When $\Delta=0$ and $R>0$ ($\alpha=\alpha_1$), there are repeating real eigenvalues: $\omega_1$, $\omega_1$, $-\omega_1$, $-\omega_1$, where $\omega_1=\sqrt{R}$. By the symmetry of $u_{\mathrm
I}(x)$, $C1=D1$ and $C2=D2$, so $u_{\mathrm I}(x)$ from (\[eq:generalsolregI\]) can be written as $$\begin{aligned}
u_{\mathrm
I}(x)=C(e^{\omega_1x}+e^{-\omega_1x})
+ Dx(e^{\omega_1x}+e^{-\omega_1x})+U_0.\end{aligned}$$ Applying matching conditions ($\ref{eq:matchingcondition1}$)-($\ref{eq:matchingcondition5}$) gives a similar system to (\[eq:real1\])-(\[eq:real5\]) to which solutions can be found numerically.

### Finding solutions for real eigenvalues using the existence function {#sec:realexistencefunction}

In order to perform numerical continuation on the single-pulse solutions, it is more convenient to utilize the existence function $\Phi(x)$ introduced by Amari @Amari77 and calculated in Sec. \[sec:amari\]. We compute it for the general case by first eliminating the threshold $u_{\scriptscriptstyle T}$ from system (\[eq:real1\])-(\[eq:real5\]) to get an equivalent four equation system

$$\begin{aligned}
\label{eq:ex1}\hspace{1cm} C(e^{\omega_1x_{\scriptscriptstyle
T}}+e^{-\omega_1x_{\scriptscriptstyle
T}})+D(e^{\omega_2x_{\scriptscriptstyle
T}}+e^{-\omega_2x_{\scriptscriptstyle
T}})+U_0 &=& \\
&&\hspace{-1.6cm} \frac{a}{a-2\alpha(A-a)}
(Ee^{-ax_{\scriptscriptstyle T}}+Fe^{-x_{\scriptscriptstyle T}}) \nonumber\\
\label{eq:ex2} 
\omega_1C(e^{\omega_1x_{\scriptscriptstyle
T}}-e^{-\omega_1x_{\scriptscriptstyle
T}})+\omega_2D(e^{\omega_2x_{\scriptscriptstyle
T}}-e^{-\omega_2x_{\scriptscriptstyle T}}) & =&
-aEe^{-ax_{\scriptscriptstyle T}}-Fe^{-x_{\scriptscriptstyle T}} \\
\label{eq:ex3} 
\omega_1^2C(e^{\omega_1x_{\scriptscriptstyle
T}}+e^{-\omega_1x_{\scriptscriptstyle
T}})+\omega_2^2D(e^{\omega_2x_{\scriptscriptstyle
T}}+e^{-\omega_2x_{\scriptscriptstyle T}}) &=&
a^2Ee^{-ax_{\scriptscriptstyle T}}+Fe^{-x_{\scriptscriptstyle T}}- \\ 
& & 2(aA-1)\beta \nonumber\\
\omega_1^3C(e^{\omega_1x_{\scriptscriptstyle
T}}-e^{-\omega_1x_{\scriptscriptstyle
T}})+\omega_2^3D(e^{\omega_2x_{\scriptscriptstyle
T}}-e^{-\omega_2x_{\scriptscriptstyle T}}) &=& (-a^3+2a \alpha
(aA-1))Ee^{-ax_{\scriptscriptstyle T}}+ \\ & & (-1 +2 \alpha
(aA-1))Fe^{-x_{\scriptscriptstyle T}} \nonumber
\label{eq:ex4}\end{aligned}$$

Equations (\[eq:ex1\])-(\[eq:ex4\]) form a linear system in $C$, $D$, $E$, and $F$. To obtain an existence function $\Phi(x)$, we construct coefficient vectors

$m_1=\left( \begin{array}{c} e^{\omega_1x_{\scriptscriptstyle
 T}}+e^{-\omega_1x_{\scriptscriptstyle T}}\\
 \omega_1(e^{\omega_1x_{\scriptscriptstyle
 T}}-e^{-\omega_1x_{\scriptscriptstyle T}}) \\
 \omega_1^2(e^{\omega_1x_{\scriptscriptstyle
 T}}+e^{-\omega_1x_{\scriptscriptstyle T}}) \\
 \omega_1^3(e^{\omega_1x_{\scriptscriptstyle
 T}}-e^{-\omega_1x_{\scriptscriptstyle T}})
\end{array} \right),$ $m_2=\left( \begin{array}{c} e^{\omega_2x_{\scriptscriptstyle
T}}+e^{-\omega_2x_{\scriptscriptstyle T}} \\
\omega_2(e^{\omega_2x_{\scriptscriptstyle
T}}-e^{-\omega_2x_{\scriptscriptstyle T}}) \\
\omega_2^2(e^{\omega_2x_{\scriptscriptstyle
T}}+e^{-\omega_2x_{\scriptscriptstyle T}}) \\
\omega_2^3(e^{\omega_2x_{\scriptscriptstyle
T}}-e^{-\omega_2x_{\scriptscriptstyle T}})
\end{array} \right),$

$m_3=\left( \begin{array}{c} \frac{a}{a -2\alpha( A-a )}\\ a\\ -a^2\\
a^3-2a\alpha (aA-1) \end{array} \right),$ $m_4=\left( \begin{array}{c}
\frac{a}{a -2\alpha(A-a)}\\ 1\\ -1\\ 1-2 \alpha (aA-1) \end{array}
\right),$

$m_0=\left( \begin{array}{c} \frac{(A-a)
\beta}{a-2\alpha(A-a)}\\ 0\\ -2(aA-1) \beta \\ 0 \end{array} \right).$

Let $DET_{ x_{\scriptscriptstyle T}}(\alpha)=\left|
\begin{array}{cccccc} & m_1 & m_2 & m_3 & m_4 & \end{array}\right|,$ where $\left|.\right|$ is the determinant. For parameters $(a, A, \alpha, \beta, u_{\scriptscriptstyle
T})=(2.6,2.8,0.15,1,0.400273)$, the solution $(C, D, E, F,
x_{\scriptscriptstyle T})=(-0.8532, 1.16865,$ $ 2.94108, -0.89571,
0.41902)$ with $DET_{ x_{\scriptscriptstyle
T}}(\alpha)=-243.2415568475$ is given by Mathematica. We use this solution as an initial guess to continue system (\[eq:real1\])-(\[eq:real5\]) using AUTO while following $DET_{ x_{\scriptscriptstyle T}}(\alpha)$ as $\alpha$ decreases to $0$ and then increases to $\alpha_1$. The recorded value of $DET_{ x_{\scriptscriptstyle T}}$ shows that $DET_{x_{\scriptscriptstyle T}}(\alpha) \neq 0$ as $\alpha<\alpha_1$. Therefore we can always solve the linear system (\[eq:ex1\])-(\[eq:ex4\]) by Cramer's rule. The solutions for $E$ and $F$ given by $$E= \frac{\left|\begin{array}{cccccc} & m_1 & m_2 & m_0 & m_4 &
\end{array} \right|} {\left |\begin{array}{cccccc} & m_1 & m_2 & m_3 &
m_4 & \end{array} \right| e^{-ax_{\scriptscriptstyle T}}} ,$$ $$F= \frac{\left|\begin{array}{cccccc} & m_1 & m_2 & m_3 & m_0 &
\end{array} \right|} {\left| \begin{array}{cccccc} & m_1 & m_2 & m_3 &
m_4 & \end{array} \right| e^{-x_{\scriptscriptstyle T}} }.$$ are then substituted back into $u_{\scriptscriptstyle
II}(x)=E(x)e^{-ax}+F(x)e^{-x}$ to obtain the existence function $$\Phi(x)=E e^{-ax}+F e^{-x}=\frac{\left|\begin{array}{cccccc} & m_1 &
m_2 & m_0 & (m_3-m_4) &
\end{array} \right|}{\left|\begin{array}{cccccc} & m_1 & m_2 & m_3 & m_4
& \end{array}\right|}.
\label{existfnc}$$ Figure \[fig:0.15alpexistence\] shows $\Phi(x)$ (\[existfnc\]). $\Phi(x)$ approaches a limit as $x \rightarrow \infty,$ but this limit is different from the limit of $\Phi(x)$ in the Amari case ($\alpha=0$.)

Single-pulses of width $x_T$ are given by solutions of $\Phi(x_T)=u_T$. Since all four eigenvalues are real, there are no oscillations in $\Phi(x)$ and so there are at most two pulse solutions. One is a small single-pulse, and the other is either a large single-pulse or a dimple-pulse depending on the threshold $u_{\scriptscriptstyle T}.$

\[fig:0.15alpexistence\]

### Transition point $P$ between single-pulses and dimple-pulses {#sec:transition}

The existence function $\Phi(x)$ gives a range of thresholds $u_{\scriptscriptstyle T}$ for which there exist two pulse solutions; a large pulse <span>**l**</span> (or dimple-pulse <span>**d**</span>) and a small pulse <span>**s**</span>, or only one small single-pulse solution. The $x$-value of the intersection of $u_{\scriptscriptstyle T}$ and $\Phi(x)$ is the width of a pulse. In figure \[fig:0.15alpexistence\], $x_{\scriptscriptstyle T}^{\scriptscriptstyle {\bf s}}$ is the width of <span>**s**</span>, and $x_{\scriptscriptstyle T}^{\scriptscriptstyle {\bf
l}}$ is the width of <span>**l**</span>. At $P$, the curvature at the peak of the pulse solution is zero (i.e. $u''(0)=0$) as seen in Fig. \[fig:realPbump\]. For this set of parameters, dimple-pulses appear if $u_T$ is between $u_{\scriptscriptstyle
T}^{P}=0.1489$ and $\lim_{x\rightarrow\infty}\Phi(x)$ (See Fig. \[fig:0.15alpexistence\]). Figure \[fig:u2utreal\] shows the continuation plot of $u''(0)$; $u''(0)$ crosses zero at $u_{\scriptscriptstyle T}=u_{\scriptscriptstyle T}^P.$

\[fig:u2utreal\]

\[fig:realPbump\]

### Loss of existence for unbalanced synaptic connectivity {#sec:toomuchexcitation}

An examination of the shape of $\Phi(x)$ shows why single-pulses do not exist when excitation and inhibition are too much out of balance. When excitation dominates, $A/a>1$. For fixed $a,$ $\alpha$ and threshold $u_{\scriptscriptstyle T},$ as $A$ becomes larger, the existence function $\Phi(x)$ moves up and ${\displaystyle \lim_{x \rightarrow
 \infty}\Phi(x)}$ becomes larger. The width of the large pulse <span>**l**</span> (or dimple-pulse) increases (Fig \[fig:bigexcitation\].) When $\Phi(x)$ is tangent to $u_{\scriptscriptstyle T}$ for large $x$ (black curve in Fig \[fig:bigexcitation\],) the width becomes $\infty$ and the pulse no longer exist. The pulse <span>**l**</span> or <span>**d**</span> can be regained by increasing $u_T$. However, for large enough $A/a$, $\Phi(x)$ will become monotonic (see Fig. \[fig:newAaexist\]) and only <span>**s**</span> exists.

\[fig:bigexcitation\]

\[fig:newAaexist\]

When $A/a<1$, inhibition dominates excitation in the network. For fixed $a$ and $\alpha$, $\Phi(x)$ diminishes as $A$ is decreased (ratio $A/a$ becomes smaller.) Eventually, the ratio is small enough to make $\Phi(x)$ negative (see Fig. \[fig:newaAexist\]), and for $u_T>0$, single-pulses no longer exist. Inputs to the neurons in the network never exceed threshold so the neurons cannot fire.

\[fig:newaAexist\]

Solutions for complex eigenvalues {#sec:complex}
---------------------------------

As seen in Tables \[tab:eigenvalue1\], \[tab:eigenvalue2\], and \[tab:eigenvalue3\], the eigenvalues $\omega_1$ and $\omega_2$ form a complex conjugate pair for $\alpha_1<\alpha<\alpha_3$. Thus as long as $\alpha_1<\alpha_3$, complex eigenvalues can be found for arbitrary $a$ and $A$. Suppose $\omega_1=\omega_2^*=p+iq.$ Then $p=(R^2+S^2)^{\frac{1}{4}}\cos \theta,$ $p=(R^2+S^2)^{\frac{1}{4}}\sin
\theta,$ where $\theta=\frac{1}{2}\arctan \frac{\sqrt{|\Delta|}}{2R}$ for $\alpha \in (\alpha_1, \alpha_2)$ or $\theta=\frac{\pi}{2}+\frac{1}{2}\arctan \frac{\sqrt{|\Delta|}}{2R}$ for $\alpha \in (\alpha_2, \alpha_3).$ When $\alpha>\alpha_3$, $\Delta>0$, $R<0$ and ${\displaystyle
S=\frac{\sqrt{\Delta}}{2}<|R|}$. The real parts of $\omega_1$ and $\omega_2$ are both zero and $w_1=iq_1$, $w_2=iq_2,$ where $q_1=\sqrt{|R+S|}$ and $ q_2=\sqrt{|R-S|}$.

### Construction of a single-pulse with complex eigenvalues

To ensure that $u_{\mathrm I}(x)$ is real, $C$ and $D$ must be complex. Imposing symmetry, gives $C=D^{*}$. Setting $C=C_{\scriptscriptstyle R}+iC_{\scriptscriptstyle I}$ implies $D=C_{\scriptscriptstyle R}-iC_{\scriptscriptstyle I}$. Substituting $C$, $D$, $\omega_1$ and $\omega_2$ into (\[eq:generalsolregI\]) for $u_{\mathrm {I}}(x)$ gives $$\begin{aligned}
u_{\mathrm I}(x)=4C_{\scriptscriptstyle
R}\cos(qx)\cosh(px)-4C_{\scriptscriptstyle
I}\sin(qx)\sinh(px)+U_0.\end{aligned}$$ For simplicity, we relabel with $C=4C_{\scriptscriptstyle R}$ and $D=-4C_{\scriptscriptstyle I}$. When $\omega_1$ and $\omega_2$ are both imaginary, we have $$u_{\mathrm I}(x)=C\cos(q_1x_{\scriptscriptstyle
  T})+D\cos(q_2x_{\scriptscriptstyle T})+ U_0.$$ Applying the matching conditions (\[eq:matchingcondition1\])- (\[eq:matchingcondition5\]), results in 5 algebraic equations with unknowns $C,$ $D,$ $E,$ $F$ and $x_{\scriptscriptstyle T}$ which can be solved numerically to obtain the explicit form of $u_{\mathrm I}(x)$. The plots of pulses <span>**l**</span> and <span>**s**</span> are shown in Fig. \[fig:comp1smallbump\].

When $\alpha=\alpha_3$, $R<0$, implying $\omega_1=\omega_2=\sqrt{R}=i\sqrt{-R}$. Let $\omega=\sqrt{-R} \in \Re$. Then $$\begin{aligned}
u_{\mathrm I}(x)=C_1\cos{\omega x}+C_2\sin{\omega x}+D_1x\cos{\omega
  x}+D_2x\sin{\omega x}+U_0. \end{aligned}$$ Since $u_{\mathrm I}(x)=u_{\mathrm I}(-x)$, then $C_2=D_1=0$ leaving $$\begin{aligned}
u_{\mathrm I}(x)=C\cos{\omega x}+Dx\sin{\omega x}+U_0.\end{aligned}$$

<span>2.5in</span>

<span>2.5in</span>

\[fig:comp1smallbump\]

### Finding solutions for complex eigenvalues using the existence function {#sec:comp1existencefunction}

The existence function $\Phi(x)$ with complex $\omega_1$ and $\omega_2$ (Figs. \[fig:comp1exist\] and \[fig:eqeivaexist\]) can be obtained using methods similar to those in Sec. \[sec:realexistencefunction\]. The main difference with the real case is that $\Phi(x)$ for complex eigenvalues can oscillate as seen in Fig. \[fig:comp1exist\]. After the first local minimum between $P_1$ and $P_2$, $\Phi(x)$ will approach a constant with decaying oscillations for increasing $x$. Additionally, if the threshold is between the first local minimum and the next local maximum, there exist more than two pulse solutions. Figure \[fig:comp1dimple\] shows an example where there is a small single-pulse and two dimple-pulses. There is never more than two coexisting pulses for real $\omega_1$ and $\omega_2$, which includes the Amari case, because the existence function $\Phi(x)$ does not oscillate. It is important to note that satisfying the existence condition $\Phi(x)=u_T$ is a necessary but not a sufficient condition for a pulse solution. It is possible to satisfy the matching conditions and not be a pulse. Thus although in principle, an infinite number of pulses could exist, in our experience, we find that most of the larger $x$ solutions are not pulses. As will be shown in the accompanying paper @Guo3, pulse <span>**s**</span> is unstable and pulse <span>**l**</span> is stable. If there are three pulses, the largest third pulse which can be either a single pulse or a dimple pulse is unstable.

\[fig:comp1exist\]

<span>2.5in</span>

<span>2.5in</span>

\[fig:comp1dimple\]

Oscillations in $\Phi(x)$ also exist when the eigenvalues are pure imaginary. As before, more than two pulses, including dimple-pulses, can coexist (see Fig. \[fig:eqeivaexist\]) depending on the threshold $u_{\scriptscriptstyle T}$. Fig. \[fig:eqeivaexist\] shows a special case of a dimple-pulse where the dimple minimum reaches the threshold. If the minimum drops below the threshold, the dimple-pulse breaks into two disjointed single-pulses or a double-pulse. This double-pulse is not a valid solution because it violates the assumptions of the equations from which the solution was derived. However, double pulses can exist and we show this using a separate formalism in Sec. \[sec:doublepulse\].

![Existence function $\Phi(x)$ with imaginary $\omega_1=\omega_2$ for $A= 2.8$, $a=2.6$, $\alpha=\alpha_3$, $u_{\scriptscriptstyle T}^P=0.0967003$. The empty circles are small single-pulses. The solid circles are large single-pulses. The triangle is a dimple-pulse. Point $P$ is where the dimple-pulse (figure \[fig:dimple2double\]) breaks into a double-pulse. The $\times$s are not valid solutions.](eqeivaexist){width="4.5in"}

\[fig:eqeivaexist\]

![The transition from a dimple-pulse to a double-pulse at $P$ with $u_{\scriptscriptstyle T}^P=0.0967003$, and $u(0)=0.0967003$. ](eqeivadimple2double){width="2.5in"}

\[fig:dimple2double\]

### Blow-up for large $\alpha$ {#sec:comp3exist}

For large enough $\alpha$, the large pulse <span>**l**</span> blows up at a critical value $\alpha^0$ and does not exist for $\alpha\ge \alpha_0$. The blow-up occurs in the regime where both $\omega_1$ and $\omega_2$ are imaginary. Thus the height of pulse <span>**l**</span> is $$u(0)  =  C+D+\frac{2(A - a)(\beta - \alpha u_{\scriptscriptstyle
T})}{a - 2\alpha(A - a)},$$ which can be expressed as $$u(0) = \frac{\left| \begin{array}{cccc}
(m_1-m_2) & m_0 & m_3 & m_4
\end{array}\right|}{\left|\begin{array}{cccc} m_1 & m_2 & m_3 & m_4
  \end{array}\right|}, 
\label{numerator}$$ where the coefficient factors $m_1,$ $m_2,$ $m_3,$ $m_4$ for $C,$ $D,$ $E,$ $F$ and $m_0$ are defined in section \[sec:realexistencefunction\]. The blow-up occurs because the denominator of (\[numerator\]) goes to zero at $\alpha=\alpha^0$ while the numerator remains finite, sending the height $u(0)$ of the large pulse to infinity.

We can also see the loss of <span>**l**</span> in the existence function: $$\Phi(x)=E e^{-ax}+F e^{-x}=\frac{\left|\begin{array}{cccc} m_1 & m_2
& m_0 & (m_3-m_4) \end{array}\right|}{\left|\begin{array}{cccc} m_1 &
m_2 & m_3 & m_4 \end{array}\right |}.$$ Figure \[fig:comp3exist\] shows that when $\alpha \geq \alpha^0$, there is always the small single-pulse ${\bf s}$ but no large single-pulse <span>**l**</span>. A third solution (the third intersection of $u_{\scriptscriptstyle T}$ and $\Phi(x)$) could also exist but we have not examined this solution. As $\alpha$ increases, the height of <span>**l**</span> becomes very large but the width of the large pulse remains finite. This can be observed both from the existence function $\Phi(x)$ and the continuation plot (Fig \[fig:heightautopatch0\]) in Sec. \[sec:autoandglobal\].

<span>2.5in</span>

<span>2.5in</span>

Continuation in parameter space {#sec:autoandglobal}
===============================

One of our original goals was to understand how the shape of stationary pulses and their corresponding firing rates change as the parameters of synaptic connectivity and gain are changed. Here we give a global picture in the parameter space of $u_T$, $a$, $A$, and $\alpha$. A difficulty in this undertaking is that as the parameters are altered, the eigenvalue structure will make abrupt transitions. Hence, one must keep track of the eigenvalues and switch the form of the solutions when appropriate to construct a global picture.

As we saw before, the small and large pulses arise out of a saddle-node bifurcation. This gives a minimal condition for when pulses can exist. In Figs. \[fig:widthautopatch0\] and \[fig:heightautopatch0\], we show the large pulse <span>**l**</span> and the small pulse <span>**s**</span> arising from a saddle node bifurcation as $\alpha$ is increased for fixed $a$ and $A$. We have set the threshold to $$\begin{aligned}
u_{\scriptscriptstyle T}^{0}=\int_{0}^{\ln A/(a-1)}w(x)dx\end{aligned}$$ so that the saddle node is exactly at $\alpha=0$.

\[fig:heightautopatch0\]

Note that at the saddle node bifurcation, the pulse arises with nonzero height and width.

We can now track the location of the saddle node and the maximum firing rate of the pulse at the saddle node in parameter space. We reduce the four dimensional parameter space by projecting to the space $(\alpha$, $a/A$, $u_{\scriptscriptstyle T})$. The saddle-node location can be found by setting the threshold $u_T$ to the value of the first local maximum of $\Phi(x)$. This gives an upper bound for allowable thresholds of the gain function to support a pulse solution. As long as $u_T$ is below this upper bound and positive, a single-pulse can exist.

We first set $A=1.5$ and vary the ratio $a/A$ and $\alpha$ to identify the saddle node threshold $u_{\scriptscriptstyle T}$. We then calculate the maximum firing rate $f_{max}$ of the single-pulse solution at this threshold which creates a two dimensional surface in the space of $(a/A, \alpha, u_T)$. We increment $A$ in steps of $1$ and create a set of surfaces. The surface plots of $u_{\scriptscriptstyle T}$ and $f_{max}$ vs $a/A$ and $\alpha$ are shown in Figs. \[fig:globalut\] and \[fig:globalgain\]. Single-pulse solutions exist below a given surface (with $u_{\scriptscriptstyle T}>0$). Depending on the parameters, solutions could include one single-pulse ${\bf s}$, a coexistence of single-pulses <span>**s** </span> and <span>**l**</span> (or a dimple-pulse <span>**d**</span> but in a smaller global range), or coexistence of more than two pulses.

When excitation dominates inhibition (i.e. $a/A$ is small) the single-pulse solution can blow up as mentioned in Sec. \[sec:comp3exist\]. We note that the crucial parameter for maintaining low firing rates is for inhibition to dominate excitation (i.e. $a/A$ to be large). Even for the balanced case of $a=A$, for gain slope $\alpha$ beyond unity, the firing rate rises dramatically. This is in correspondence with observations of numerical simulations @Wang1 [@Wang].

\[fig:globalut\]

\[fig:globalgain\]

Construction of double-pulse solutions {#sec:doublepulse}
======================================

The neural network equation (\[eq:differentiate\]) can also support double-pulse or even multiple-pulse solutions @Guo1 [@Troy2]. Double-pulses are solutions that have two disjoint open and finite intervals for which the synaptic input $u(x)$ is above threshold.

\[def:doublepulse\] <span>**Double-pulse solution**</span>: A solution $u(x)$ of (\[eq:integral\_equation2\]) is called a double-pulse or a 2-pulse if there are $x_1>0$ and $x_2>0$ such that $$u(x) \left \{ \begin{array}{ll}
>u_{\scriptscriptstyle T} & \mbox{$\mathrm{if}$ $x\in(x_1,x_2) \cup
  (-x_2, -x_1)$, $x_{1,2}>0$}\\ 
=u_{\scriptscriptstyle T} & \mbox{$\mathrm{if}$ $x=-x_2,-x_1, x_1, x_2$} \\
<u_{\scriptscriptstyle T} &  \mbox{$\mathrm{otherwise}$}
\end{array} \right.$$ with $$\begin{aligned}
(u,u',u'',u''') \rightarrow (0,0,0,0)\end{aligned}$$ exponentially fast as $x \rightarrow \pm \infty.$ $u$ and $u'$ are bounded and continuous on $R$. $u'',$ $u'''$ and $u''''$ are continuous everywhere for $x \in \Re$ except $x=\pm x_{1,2}$ and bounded everywhere on $R$. $u(x)$ is symmetric with $u''(0)>0;$ $u(0)$ is the minimum between $-x_1$ and $x_1$ $\mathrm{( Fig.}$ $\mathrm{\ref{fig:comp2doublebump})}$.

The approach to find and construct double-pulse solutions is similar to that for single-pulses. The connection function is (\[eq:connection\]) and the gain function is (\[eq:firingrate\]). Laing and Troy @Troy2 found that double pulses can exist for the Amari case ($\alpha=0$). However, for the exponential connection function (\[eq:connection\]), the double pulses are unstable. Coombes <span>*et al.*</span> @Coombes found that double and higher number multiple-pulse solutions could exist in a network with a saturating sigmoidal gain function. As in the single-pulse case, a fourth order ODE on $x \in (-\infty, \infty)$ for double-pulses can be derived: $$\begin{aligned}
\label{eq:4thODE}
\label{eq:double4thode}
\lefteqn{u^{''''}-(a^2+1)u''+a^2u=} \\ \nonumber
&  &
2a(A-a)f\left[u(x)\right]+2(aA-1)
\left\{f[u(x_2)]\Delta_2'(x)-f[u(x_1)]\Delta_1'(x)\right\}-   
\\ \nonumber & &  \mbox{} 2(aA-1)\left\{f'[u(x_1)]u'(x_1)
\Delta_1(x)+f'[u(x_1)]u'(x_1)\Delta_2(x)\right\}- \\  \nonumber & &
\mbox{} 2(aA-1) \frac{d^2f\left[u(x)\right]}{dx^2}                $$ where $$\begin{aligned}
\Delta_1(x) & = & \delta(x-x_1)+\delta(x+x_1) \\
\Delta_2(x) & = & \delta(x-x_2)+\delta(x+x_2) \\
\Delta_1'(x) & = & \delta'(x-x_1)-\delta'(x+x_1) \\
\Delta_2'(x) & = & \delta'(x-x_2)-\delta'(x+x_2) \end{aligned}$$ Double-pulses can be constructed using ODE (\[eq:double4thode\]) and the following set of matching conditions (\[eq:double1\])-(\[eq:double10\]) at both $x_1$ and $x_2$: $$\begin{aligned}
\label{eq:double1}
u_I(x_1) & = & u_{\scriptscriptstyle T} \\
u_{II}(x_1) & = & u_{\scriptscriptstyle T} \\
u_{II}(x_2) & = & u_{\scriptscriptstyle T} \\
u_{III}(x_2) & = & u_{\scriptscriptstyle T} \\
u_I'(x_1) & = & u_{II}'(x_1) \\
u_{I}''(x_1) & = & u_{II}''(x_1)+2(aA-1)f(u(x_1)) \\
u_{I}'''(x_1) & = & u_{II}'''(x_1)+2(aA-1)f'(u(x_1))u'(x_1) \\
u_{II}'(x_2) & = & u_{III}'(x_2) \\
u_{II}''(x_2) & = & u_{III}''(x_2)-2(aA-1)f(u(x_2)) \\
u_{II}'''(x_2) & = & u_{III}'''(x_2)-2(aA-1)f'(u(x_2))u'(x_2)
\label{eq:double10}\end{aligned}$$

In the Amari case ($\alpha=0$), for the same set of values of $a,$ $A,$ $u_{\scriptscriptstyle T}$ we find that there are two coexisting double-pulse solutions. The existence conditions are $$\begin{aligned}
f_1(x_1,x_2)=u(x_1) & = &
\int^{-x_1}_{-x_2}w(x_1-y)dy+\int^{x_2}_{x_1}w(x_1-y)dy =
u_{\scriptscriptstyle T} \\ 
f_2(x_1,x_2)=u(x_2) & = &
\int^{-x_1}_{-x_2}w(x_2-y)dy+\int^{x_2}_{x_1}w(x_2-y)dy =
u_{\scriptscriptstyle T} \end{aligned}$$ Both $x_3=f_1(x_1,x_2)$ and $x_3=f_2(x_1,x_2)$ form two dimensional surfaces in the three dimensional space $(x_1,x_2,x_3)$. The two surfaces intersect in a convex up space curve. The intersection of this space curve with the plane $x_3=u_{\scriptscriptstyle T}$ are widths of candidate double pulse solutions. Since the surfaces do not oscillate for the Amari case there are only two intersection points. These two points give two double pulse solutions which are shown in Fig. \[fig:amaridoublebump\]. For the general $\alpha>0$ case we, have found two coexisting double-pulses as shown in Fig \[fig:comp2doublebump\]. The coexistence of more than two double-pulses for $\alpha >0$ remains an open problem.

![Double-pulse for Amari case in which $\alpha=0$. $A=2.8$, $a=2.6$, $\alpha=0$, $u_{\scriptscriptstyle
    T}=0.26$. For the large double-pulse(blue): $x_1=0.279525$, $x_2=1.20521$. For the small double-pulse (black): $x_1=0.49626$, $x_2=0.766206$. <span data-label="fig:amaridoublebump"></span>](amari2pulse){height="2.4in" width="5in"}

![Two coexisting double-pulses. $A=2.8$, $a=2.6$, $\alpha=0.98$, $u_{\scriptscriptstyle T}=0.26$. For the large double-pulse (blue): $x_1=0.19266$, $x_2=1.38376$. For the small double-pulse (red): $x_1=0.50582$, $x_2=0.752788$.<span data-label="fig:comp2doublebump"></span>](comp2doublebump){height="2.4in" width="5in"}

In the accompanying paper @Guo3 we confirm the Laing and Troy finding @Troy2 that the double pulses in the Amari case are unstable.

Discussion {#sec:conclusions}
==========

In this paper, we consider a population neural network model of the form (\[eq:differentiate\]) with a nonsaturating gain function of the form (\[eq:piecewiseligain\]). We show the existence of stationary solutions that satisfy the equilibrium equation (\[eq:integral\_equation2\]) by explicitly constructing single-pulse solutions for a specific synaptic connection function (\[eq:connection\]). The strategy was to convert the integral equation (\[eq:integral\_equation2\]) into a fourth order ordinary differential equation. A proof for the existence of a single-pulse of (\[eq:integral\_equation2\]) then becomes a proof for the existence of a homoclinic orbit of the ODE. Since the ODE has discontinuities across the threshold points, the ODE on the real line is reduced to three different linear ODEs on three regions separated by threshold points. The matching conditions for the solutions of the ODEs across the threshold points must satisfy a system of five equations. From this system, we are able to construct different single-pulse solutions.

The eigenvalue structure of the linear ODEs is important for determining how many pulses exist. For real $\omega_1$ and $\omega_2$, there are at most two pulses, the small single-pulse and the large one. Amari's case ($\alpha=0$) belongs to this regime. The large single-pulse can transform to a dimple-pulse depending on the threshold value (Fig. \[fig:realPbump\].) If the eigenvalues are complex, there could be a small single-pulse and two large pulses with different widths. Depending on the threshold, these two large pulses could be dimple-pulses (Fig. \[fig:comp1dimple\].) There also exists a transition point where a dimple-pulse breaks into a double-pulse.

There are three ways that the large pulse can disappear. First, for fixed gain $\alpha$ and threshold $u_{\scriptscriptstyle T},$ if the excitation is too strong, <span>*i.e.*</span> ratio ${\displaystyle A/a}$ is large, the width of the large pulse becomes wider and eventually loses existence. Second, with fixed excitation, $i.e.,$ fixed $a$ and $A,$ if the gain is too large, $i.e.,$ $\alpha$ is large, the large pulse increases in height and blows up at a finite value of $\alpha$. Third, with too little excitation or gain, the stable large pulse coalesces with the unstable small pulse and vanishes in a saddle node bifurcation.

The pulses are a proposed mechanism of persistent neuronal activity observed during working memory. Therefore, it is crucial to access their stability. In the accompanying paper, we show that the large pulse is stable and the small pulse is unstable. We also show that dimple-pulses can be stable. We show that single-pulses can exist for a wide variety of gain and connection functions. However, for single-pulses to exist with low firing rates we require the gain to not be too large and inhibition to dominate excitation. This suggests that the cortex could be dominated by inhibition.

<span>**Acknowledgment:**</span> We would like to thank G. Bard Ermentrout, Jonathan Rubin, Bjorn Sandstede and William Troy for illuminating discussions. This work was supported by the National Institute of Mental Health and the A.P. Sloan foundation.

[^1]: Department of Mathematics, The Ohio State University, Columbus, OH 43210 (<span>matthew53@example.com</span>).

[^2]: Department of Mathematics, University of Pittsburgh, Pittsburgh, PA 15260 (<span>matthew53@example.com</span>).

{'source': 'arXiv_out/q-bio0407013_extract_paper1'}