Reservoir Computing using Stochastic p-Bits
Samiran Ganguly1, Kerem Y. Camsari2, and Avik W. Ghosh1
1

Dept. of Electrical and Computer Engineering, University of Virginia, Charlottesville, VA 22904, USA
2
School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
Emails: sganguly@virginia.edu, kcamsari@purdue.edu, ag7rq@virginia.edu

Abstract—We present a general hardware framework for
building networks that directly implement Reservoir
Computing, a popular software method for implementing and
training Recurrent Neural Networks and are particularly suited
for temporal inferencing and pattern recognition. We provide a
specific example of a candidate hardware unit based on a
combination of soft-magnets, spin-orbit materials and CMOS
transistors that can implement these networks. Efficient non
von-Neumann hardware implementation of reservoir
computers can open up a pathway for integration of temporal
Neural Networks in a wide variety of emerging systems such
as Internet of Things (IoTs), industrial controls, bio- and photosensors, and self-driving automotives.
I. INTRODUCTION
Temporal inferencing and learning is believed to be the next
frontier in the discipline of Artificial Intelligence. Along with
development of algorithms for temporal machine learning and
development of hardware that can implement these algorithms
efficiently and locally on chip have the potential to
revolutionize the rapidly emerging era of smart-sensors, selfdriving automotives, and IoTs. Hardware designed specifically
to implement these algorithms can open a pathway for eventual
real-time autonomous in-situ cognition at low energy costs as
well as independence from a cloud based computing backed that
the present day systems need, with major impact on security,
net bandwidth and network disruption resilience.
Reservoir Computing (RC) 1,2 is a prominent software
method that has shown promise in tasks such as learning and
predicting a time series, channel equalization3, acoustic data
processing4, video surveillance5 etc. RC is advantageous due to
the ease of implementation as it avoids the difficult problem of
backpropagation through time6 in Recurrent Neural Networks
and is, therefore, an attractive approach to the problem,
particularly for a hardware implementation.
In this work, using simulation-based studies, we show that
RC methods, in particular Echo-State Networks (ESNs) can be
efficiently implemented using devices such as soft-magnets that
work in the stochastic regime with tunable and predictable noise
profile. We focus on the recently proposed probabilistic (p)bits7 due to the one-to-one mapping between the dynamics of
the networks of p-bits and ESNs. We show p-bit networks can
successfully learn, and predict the output of a deterministic but
chaotic time series, work as temporal auto-encoders, and can
extract a signal from a noisy channel. These simulations show
that such stochastic networks can have wide-ranging
applications in signal processing, smart-sensors, temporal
information compression, and wireless communication.

II.

RESERVOIR COMPUTING

Reservoir Computing, including its two versions. the ESN
and Liquid State Machines (LSMs) are inspired by the
principles of biological neural networks8,9. In these networks
(fig.1), the computation is performed by a collection of loosely,
sparsely, and randomly coupled non-linear units with feedbacks
(recurrence) which: (a) provides a huge expansion of the phase
space, making the task of signal classification easier, and (b)
gives rise to memory states in the network10. The nodes of the
network are “leaky”; therefore, this memory is a short term and
fading one, thus the name “echo-state” networks. The system of
equations is given by:
𝑑𝑥
= −𝜂𝑥 + 𝑘𝑡𝑎𝑛ℎ(𝑊 𝑖𝑛 𝑢 + 𝑊 𝑓𝑏 𝑦 + 𝑊 𝑠𝑒𝑙𝑓 𝑥)
(1)
𝑑𝑡
𝑜𝑢𝑡
𝑦=𝑊 𝑥
(2)
where x is the network state vector, u is the input vector, y is
the output vector, η and k are constants, W’s are
interconnection matrices. In these networks, excitations/
activations of the nodes are temporally correlated with the past
and the present sequences from the input stream, while the
stochasticity enables a short-term fading memory, which then
enables efficient signal pipelining. We can use a linear
combination of these activations to learn a time series data,
classification, and in non-linear filtering tasks. The only
connections adjusted during the training are the reservoir-tooutput ones (Wout) using techniques such as ridge regression.
Reservoir Computers have previously been demonstrated
on a wide variety of systems11,12,13,14. In this paper, we
demonstrate it in compact hardware using p-bits utilizing their
one-to-one correspondence with ESN nodes. These p-bits have
controllable stochastic transfer functions, with built in
switching delay (fig. 2). The controllable stochasticity provides
the leakiness necessary for RC networks, and allows the system
to get out of local minima in the energy landscape and anneal
to the ground state. While stochastic transfer functions are
found in a wide variety of emerging materials, such as phasechange, metal-insulator transition, multiferroics, or possibly
even CMOS working in deep sub-threshold, in this work we
focus on a cell design incorporating super-paramagnets (SPM)
and high spin-orbit materials that offer natural current addition
through the Giant Spin Hall Effect (GSHE).
III. SOFT-MAGNET P-BITS
We introduce the notion of a p-bit and describe one
possible hardware implementation of probabilistic, or pbits7.The stochastic behavior of a p-bit can be compactly
expressed as:
𝑚 = 𝑠𝑔𝑛[𝑟𝑎𝑛𝑑(−1, +1) + 𝑡𝑎𝑛ℎ(𝐼𝑖 )]
3
where at each normalized time step  (=0,1,2...), the bit makes
a random transition to a new state +1 or -1 in the presence of a

normalized biasing current Ii. The time step is assumed as long
enough for past memory of the bit to be lost. In the absence of
any bias current, the magnetization that is produced is a +1 and
-1 with equal probability and a positive or negative bias current
tunes this probability between 0 and 1 (Fig. 3).
The long-time average of the magnetization m (<m>) has a
sigmoidal [~ tanh(Ii)] characteristics and this intrinsically maps
to the physics of low-barrier nano-magnets. Therefore, a
possible CMOS-assisted implementation of a p-bit that can be
interconnected in a hardware implementation is a low-barrier,
circular nanomagnet 7,15 placed on top of a heavy metal with
GSHE (Fig 3.a.) whose charge current can induce a spincurrent to pin the magnetization of the circular magnet in the
plane of the magnet. The GSHE, being a current based
component, allows for addition of input currents naturally
without any extra hardware. A Magnetic Tunnel Junction
(MTJ) using a small read current senses the magnetization. The
voltage output is amplified and isolated by a set of CMOS
inverters that are biased in the middle, relating input currents
to output voltage spikes (between 0 and VDD) that can be tuned
by the charge current flowing in the GSHE, in the presence of
thermal noise on the magnets (Fig 3.b).
The key feature such p-bits exhibit is that their stochasticity
is tunable by an input current, hence they can be
interconnected to demonstrate large scale, robust correlations
(Fig 3.c.).
IV. RESERVOIR DYNAMICS AND EXAMPLE SYSTEMS
We setup p-bits networks of various sizes (N=10, 20, 200,
500, 100) with Win and Wself connection matrices whose
individual entries are chose randomly. One of the
hyperparameters of RC is the spectral radius (maximal absolute
eigen value) of the Wself, and we scale it to be less than one, as
this has been found to create desirable dynamical (echo-state)
properties in the network. Stronger connections can make the
reservoir stiff and give rise to spurious dynamical states16.
For a N = 500 node network (fig. 4.a) excited with a time
varying analog signal, we observe the activations of a few
nodes of the network. We notice that these activations are
correlated with the input signal variation, but different from
each other (fig. 4.b.), as if each node remembers different parts
of the input data stream. These excitations are combined (fig.
4.c) using a linear sum unit and the Wout adjusted to perform
various learning tasks.
We setup following tasks popular in RC literature for our
network as proof-of-concept demonstrations:
A. Chaotic Mackey-Glass System Predictor
Mackey-Glass (MG) equation17 is a time series generator
with periodic but subtly chaotic characteristics having origins
in biology/psychology. The equation is given by:
𝑑𝑥
𝑥(𝑡 − 𝜏)
= 𝛽
− 𝛾𝑥, 𝛾, 𝛽, 𝑛 > 0
𝑑𝑡
1 + 𝑥(𝑡 − 𝜏)𝑛

4

We train out networks (fig. 5.a) on a MGS system with
training datastream/signal of 5000 time steps using ridge
regression to work as unity signal follower (the simplest test
case: Identity function), and then tested on a different sequence
of signal from MGS (fig. 5.b). We found that the network could
reproduce the test signal faithfully with normalized mean
square errors ranging from 1x10-3 to 5x10-4 for N = 10 to 1000
(fig. 5.c). We then use the network as a temporal auto-encoder,
in which the network attempts to reproduce the test signal

looking only at its previously self-generated output. We found
that for small N the networks fails but starts to generate better
results with larger N (fig. 5. d). This shows the possibility of
creating temporal generative models using these networks.
B. Channel Equalizer
We then turn our attention to channel equalization18,19, a
task of practical importance in wireless communication. The
network (fig. 6.a) extracts the original signal d(t) from a noisy
channel q(t) with non-linear and time shift distortions to
generate an input sequence u(t) from d(t) and given by:
3

𝑢(𝑡) = ∑

𝑛=1

𝐴𝑛 ∑

7

𝜏=−2

𝐵𝑘 [𝑑(𝑡 − 𝜏)]𝑛 + 𝑟𝑛𝑑(−𝑐, 𝑐) 5

We train the network to learn to “invert” q(t) by using d(t)
as the learning target and u(t) as the training signal. After
training, we test the network and we find that for moderate
sized networks (N=100), the symbol error rate (normalized
difference between d(t) and output y(t) over a range of t), SER
can theoretically be zero (fig. 6.b). In a practical circuit, SER
will be limited by the values of elements in Wout matrix that
can be implemented due to component fabrication constraints.
V. DISSIPATION IN P-BIT BASED RESERVOIRS
For any new nano-device/circuit proposal, it is critical to
provide estimate of energy dissipation for its evaluation as a
possible technology of interest. While metrics with wide
consensus (e.g. E-D product) are available for Boolean gates,
it is not always clear what should be the equivalent figure of
merit for the kind of computation we are proposing,
considering that implementation details, circuit design, and
bias point choices can have a strong impact on such metrics.
Therefore, we merely provide estimates for the I2R power
dissipated in various components of a single p-bit under
moderate overdrive conditions20 as listed in the tab. 1. a, b.
We build the buffer using two inverters in series and can
show21 using a predictive model for 14nm FinFETs22 that the
dynamic dissipation in the buffer is about 150 μW. Further this
sets the bias voltage that can be used in the circuit (here Vdd =
0.8V). As a result, the dissipation in the reader unit is about 20
μW, while in our case GSHE writer dissipates a negligible
power of about 0.2 μW for a net write current of 15 μA. These
calculations show that for a dissipative cost of just over two
CMOS inverters we can create a compact RC node with very
high functionality-to-power ratio. Using low power transistors
can reduce these numbers even more, making it an attractive
candidate for building temporal Neural Networks.
REFERENCES
[1] Jaeger H. (2001) GMD Report 148, GMD
[2] Maass W. et al. (2002) Neural Computation, 14(11):2531-2560
[3] Jaeger H. and Haas H. (2004). Science, 304:78-80, 2004
[4] Triefenbach, Fabian, et al. Advances in neural information processing systems. 2010
[5] A. Jalalvand, et al.. 7th IEEE CICSyN, Riga, 2015
[6] Werbos P.J. (1990) Proc. of the IEEE, October, 78(10):1550-1560
[7] Camsari, Kerem Yunus, et al. Physical Review X 7.3 (2017): 031014
[8] Dominey P.F. (1995) Biol. Cybernetics, Vol. 73, 265-274
[9] Pascanu R. and Jaeger H. (2010). Neural Networks 24(2), 199-207
[10] Lukoševičius, Mantas. Neural networks: tricks of the trade. Springer Berlin Heidelberg, 2012
[11] Kulkarni, Manjari S., and Christof Teuscher. NANOARCH, 2012
[12] Schrauwen, Benjamin, et al. Neural networks 21.2 (2008): 511-523
[13] Van der Sande, Guy et al. Nanophotonics 6.3 (2017): 561-576
[14] Vandoorne, Kristof, et al. Nature communications 5 (2014)
[15] Debashish et al., IEDM 2016
[16] Buehner M. and Young P. (2006) IEEE TNN, 17(3):820-824
[17] Mackey, Michael C., and Leon Glass. Science 197.4300 (1977): 287-289
[18] Boccato, Levy et al. IJCNN, 2011
[19] Paquot, Yvan, et al. Scientific reports 2 (2012)
[20] Faria, Rafatul, et al. IEEE Magnetics Letters (2017)
[21] Ganguly et al., IEEE JxCDC, 2016
[21] Predictive Technology Model. http://ptm.asu.edu/

a.

b.

c.

Fig. 1. General schematic of a reservoir computer. The
reservoir is a network of sparse and randomly connected
neurons (black arrows) captured by the weight matrix Wself. The
reservoir x(t) (connected by Win) processes the input bit stream
u(t) and produces the output bit stream y(t) (feedback to
reservoir by Wfb) as a response. The reservoir-to-output
connection Wout (red arrows) is the only layer trained in RC.

• Stochastic
Transfer function

• Signal Addition
• Delay

Fig. 2. Generic circuit representation of a reservoir node
element. Input side provides a delay element (τ = R inCin), and
an adder for time varying input signals, while the output side is
a controlled voltage/current generator that produces a time
varying output signal given by a transfer function which is a
random number generator with controllable statistical properties
(mean and variance).

Fig. 3. Hardware implementation of Reservoir Computing.
a. A possible implementation of RC nodes built using superparamagnets driven by spin-orbit torques. The readout is through
an MTJ, which forms a voltage divider pair with the pull up
resistor with symmetric mid-point bias (see ref. 7 for details). b.
The output of this unit is a random number generator whose
statistical properties are controlled by the net signal at the input
node. c. The nodes can then be connected with either conductors
(Gc) of randomly chosen magnitudes (for the reservoir), or for the
Wout connections (shown in red) using a programmable
mechanism, a few examples of which are floating gates on
transistors operating in subthreshold regime (V w < Vt),
multiferroics, or phase-change materials/memristors.

b.

a.

500

c.

Fig. 4. Example of dynamical activations in reservoir. a. A 500 node RC with randomly connected weight matrices. b. Example
of dynamical activations on nodes numbered 1, 10, 30, and 50. Each node activation is subtly different but correlated with input signal
u(t) and from Wself connections with other nodes. c. All the activations put together show temporal correlations with the input signal
u(t) which is then used to construct y(t) through adjustable matrix Wout calculated using ridge regression on training signal.

b.
a.

N

c.

d.

Fig. 5. Mackay-Glass system predictor. a. Reservoirs of varying sizes (N=20, 200, 1000) were setup to act as a unity signal follower
(simplest test case) and tested on a MG system, which is a periodic but subtly chaotic time series. b. An example comparison between
the training data set and the test sequence. c. Comparison between test and RC output signals. Reservoirs of all the sizes could
reproduce the test signal. d. RC run in a generative mode, an example of a temporal auto-encoder where the network tries to generate
the test signal looking only at its self-generated previous outputs. It can be seen that low N (one of the hyperparameters) reservoirs
fail spectacularly, while higher N helps in generating a better fit.
Parameter
Units
Value
a.
100

b.

SPM U
SPM Volume
GSHE θ
GSHE Volume
GSHE ρ
MTJ TMR
MTJ RA
Rup
Write current
Vdd

kT
nm3
nm3
μΩ-cm
Ω-μm2
kΩ
μA
V

1 (thermal limit)
πx50x50x1
0.33
50x50x2
170
100%
100
15
15
0.8

Table.1. a. Parameters chosen for various materials/
components needed to build the p-bit.
Component
MTJ Reader
GSHE Writer
Spintronic Total
Rup
Buffer (dual inverter design)
Silicon Total
Node Total

Dynamic Power
Dissipated (μW)
10 (for reqd. Vdd)
0.2
10.2
10 (for reqd. Vdd)
150
160
170.2

Fig. 6. A Non-Linear Channel Equalizer. a. Datastream d(t) is passed
through a channel q(t) that causes non-linear distortions as well time Table 1. b. Dissipation in the various components of the
shifts to the datastream. b. A N=10 RC can reproduce the original p-bit. The dissipation is set primarily due to the
datastream d(t) with perfect fidelity from the distorted data u(t) (SER~0). requirements of the silicon components.

