Learning Representations from Road Network
for End-to-End Urban Growth Simulation
Saptarshi Pal1 and Soumya K Ghosh1

arXiv:1712.06778v3 [] 7 Feb 2018

1

(Department of Computer Science and Engineering, Indian
Institute of Technology Kharagpur, India.)
February 8, 2018
Abstract
From our experiences in the past, we have seen that the growth
of cities is very much dependent on the transportation networks. In
mega cities, transportation networks determine to a significant extent
as to where the people will move and houses will be built. Hence,
transportation network data is crucial to an urban growth prediction
system. Existing works have used manually derived distance based features based on the road network to build models on urban growth. But
due to the non-generic and laborious nature of the manual feature engineering process, we can shift to End-to-End systems which do not rely
on manual feature engineering. In this paper, we propose a method
to integrate road network data to an existing Rule based End-to-End
framework without manual feature engineering. Our method employs
recurrent neural networks to represent road network in a structured
way such that it can be plugged into the previously proposed End-toEnd framework. The proposed approach enhances the performance in
terms of Figure of Merit, Producer’s accuracy, User’s accuracy and
Overall accuracy of the existing Rule based End-to-End framework.

Keywords— Recurrent Neural Networks, Representation learning, Spatial Data Mining, End-to-End learning, Urban Growth.

1

Introduction

Urbanization is one of the major issues which has been recognized by the
United Nations. The United Nations World Urbanization Prospects have
1

pointed out the imminent rise in the urban population which is expected in
the coming years1 . This has led to a growing concern as to how cities can be
planned such that uncontrolled urban growth can be controlled.
One of the solutions which have been proposed in the previous works is
to build a simulator which can learn patterns from past growth and simulate
the future conditions ([13, 19, 11]). Significant work has been carried out in
simulating urban growth in many major cities in the world. The problem
though is that the process of simulation is laborious and non-generic due
to manual feature engineering from various data sources ([15]). The manual feature engineering process mainly consists of generating distance based
features, for instance, distance from roads, distance from railways etc.
In order to reduce the dependency on manualy derived distance based features, a Rule based End-to-End framework have been proposed in [15]. The
Rule based End-to-End framework uses satellite imagery and urban built-up
maps to learn patterns of urban growth and simulate future growth. The
work ([15]) also shows empirically that the proposed End-to-End framework
provides better performance measure than the existing learning based methods.
Transportation networks are a prominent feature in an urban landscape
and people generally find it convenient to build establishments considering
the availability of roads or railways. Hence, it can be expected that a road
network data is an important constituent in urban growth prediction model.
Moreover, as a data source, plenty of crowd sourced as well as legacy data of
roads are available online and with government organizations. Therefore, it
is important to make use of such data to refine the process of urban growth
modeling in an End-to-End fashion.
As of now, the Rule based End-to-End framework uses only satellite raster
image as data source without feature engineering to simulate urban growth.
Therefore, to maintain consistency in the framework it is also required that
the road network be incorporated in a way which does not require feature
engineering. Transportation networks have been used in several other works
in deriving distance based features. Distance from roads or highways are an
important feature which has been considered in the works by [13, 19, 10, 14].
In these works, only a particular distance based metric (euclidean) has been
used to compute distance. It is true that distance from roads determines
urban growth but this may not necessarily mean it has to be a particular
distance metric (say euclidean distance). The use of a particular distance
metric reduces the generic nature of the model by making it rigid. Hence, we
1

http://www.un.org/en/development/desa/publications/2014-revision-worldurbanization-prospects.html

2

intend to use road network in a fashion which does not require computing a
fixed manually selected distance metric.
One of the primary challenges in incorporating road network data is due
to the fact that roads are represented in vector form and the Rule based
End-to-End framework is designed to take input raster images only. This is
because the framework is based on cellular automata which assumes space as
a discrete array of cells and raster representation of data matches well with
this assumption. However, road network is represented in terms of polylines
consisting of sequences of coordinates with no assumption akin to discrete
array of cells in a cellular automata. Therefore, we need to find a way to
represent road network so that they can be incorporated into the Rule based
End-to-End framework without reducing the performance of the simulation.
Our proposed method utilizes concepts of recurrent neural networks ([6])
and autoencoders ([23]) to represent road network in an unsupervised way.
In more common terms, this is referred to as Representation learning ([2]),
which involves automatic discovery of representations for feature detection,
classification or model building purposes. Representation learning have been
utilized in several works starting from image recognition ([1]), video sequences
([20]), speech sequences ([4, 3]), text sequences ([22]), etc for achieving higher
performances. Since road network are sequences of coordinates similar to
texts, video, and speech, hence one can attempt to represent them using
recurrent neural networks.
In this paper, we propose a novel method of integrating road network
into the Rule based End-to-End framework. Our proposed solution utilizes
the fact that road network in vector form is a sequence of points and hence
can be represented using recurrent neural networks. Following the representation, we have successfully integrated the road network representation into
the End-to-End framework and have achieved superior performance. Our
main contributions in the work are given as follows.
• Utilizing recurrent neural networks to develop a method of representing
road network in an End-to-End fashion (without feature engineering).
• Successfully integrating the generated representation into the End-toEnd framework while achieving superior performance over the existing
framework.
• Additionally, we also show that our proposed method performs better
than a naive baseline method for incorporating road network to the
End-to-End framework.
The rest of the sections are organized as follows. In section 2, we explain
the preliminaries of the methods used in the proposed methods. Section 3
3

describes our proposed methods of representing road network along with the
procedures. Section 4 presents results and discussions of the experiments conducted in the region of Mumbai, India. Finally, section 5 provides conclusion
and future research directions.

2

Preliminaries

In this section, we discuss the Rule based End-to-End Learning framework,
Recurrent Neural Networks (RNN), Long Short Term memory (LSTM) cells
and autoencoders. We also provide a naive baseline method to incorporate
road network data into Rule based End-to-End framework in order to show
the effectiveness of our method.

2.1

Rule Based End-to-End framework for Urban Growth
Prediction

The Rule based End-to-End framework ([15]) is a supervised learning framework based on cellular automata model which uses satellite raster data to
predict urban growth without manually selected distance based features. The
idea is to reduce the dependency on fixed distance metrics from the modeling
process and provide better results in terms of four metrics namely Figure of
Merit, Producer’s accuracy, User’s accuracy and Overall accuracy ([17]).
The framework utilizes satellite raster and builtup images to develop a
cellular automata (CA) model. The built-up images consists of built-up
information at time t (represented by lpt ) and has the same resolution as the
raster image. The urban growth CA model can be described using a state
(Stp ), a neighborhood criterion (N ), a transition function (eqn. 1) and an
update function (eqn. 2). The state of the cellular automata at point p and
time t is defined as a triple given as < lpt , τpt , Rp >, where
• lpt is a binary variable representing Builtup (SB ) or Non-Builtup (SN B ),
• τpt is a transition indicator which can take four indicators namely Non
Built-up to Non Built-up (CNNBB ), Built-up to Built-up (CBB ), Non Builtup to Built-up (CNBB ) and Built-up to Non Built-up (CBN B ) and
• Rp represents raster variable at point.
The generalized form of the two functions (update and transition) in the
End-to-End framework are given as follows.

4

τpt+1 = fT (lpt , N (lpt ), φlen
raster (Rp , N (Rp )))

(1)

The function φlen
raster is a encoding function to encode neighborhood information of a cell into a fixed length representation of size len. This is
important because satellite raster data is an unstructured source of data
which needs to be converted to a structured form in order to fit into a supervised learning model. The encoding function φlen
raster is developed using a
specialized neural architecture known as an autoencoder [15].

Spt+1

(
τpt+1 ∈ {CNBB , CBB }
(SB , τpt+1 , Rp )
=
(SN B , τpt+1 , Rp ) τpt+1 ∈ {CNNBB , CBN B }

(2)

The important aspect to determine in eqn. (1) is a way to build function
fT so that enhanced performance in terms of F oM, P A, U A and OA can
be achieved. In order to do so, the framework involves two stages, namely
Data Representation which include formation of a data and a label matrix,
and Knowledge Representation which includes training a classifier on the data
and label matrices. The trained classifier has been considered as a knowledge
representation of the urban growth pattern ([15]). The framework is called
Rule based as experiments have shown that Decision tree and Ensembles of
Decision tree have provided better results when compared to other classifiers.
One of the drawbacks of the End-to-End framework is that it is based
on a cellular automata model. Since initial assumption of a CA model includes a discrete array of cells, hence raster data with same resolution can be
easily integrated into the framework. However, many datasets such as road
network, railways etc. happen to be in vector form and are not easily integrable to the framework. This limits the utility of the framework in terms of
various types of information which can be used to build prediction models.
Hence, it is important to develop techniques to include these datasets but
in an End-to-End fashion in order to minimize human effort and maximize
performance.
2.1.1

A Baseline method for incorporating road networks

We present a baseline naive method which can be used to incorporate road
networks to the Rule based End-to-End framework without manual feature
engineering. The method includes rasterizing of the road network with the
same resolution as of the raster R and then adding the newly formed raster
as a new band to R. Subsequent to this, the same procedure is followed
5

as in Rule based End-to-End framework to get the urban growth model.
This two-step addition to the framework is a trivial way of plugging road
networks but this method drastically reduces the performance of End-to-End
framework (see Section 4.3). This is possibly because during rasterizing with
a particular resolution, information is lost. Hence in this paper, we present
a method with which we can improve over the previous framework.

2.2

Recurrent Neural Networks

Recurrent Neural Networks are a type of artificial neural networks where we
have feedback from the output of a node back to the network. Unlike feed
forward neural networks, recurrent neural networks can remember information from previous executions thus giving an impression of memory ([12]).
Hence these networks have the ability to process variable size sequence data
and generate fixed length representations.
Figure 1 depicts a schematic of a recurrent neural network. The variable
ht in the diagram represents the memory of the recurrent neural network. A
recurrent neural network can be unrolled with a fixed time steps as shown
in the figure to form a feed forward network. Unrolling the network is useful
during training the network as these networks are trained using backpropagation algorithm. Since multiple time steps are included in training the
network, the algorithm often suffers from vanishing gradient problem ([16]).
The generalized equation of a recurrent neural network can be written as,
ht = f ([ht−1 , Xt ])

(3)

where ht is the output as well as memory variable, Xt is the input to the
network and f the function depicting a neural unit.

2.3

Long Short Term Memory

Long Short Term Memory (LSTM) is a specialized recurrent neural unit
developed by [7] that deals with the vanishing gradient problem of recurrent
neural networks. It consists of recurrent gates which can remember and drop
information according to its parameters. The parameters of the remember
and forget gates can be learned during the gradient descent algorithm. Due to
this property, LSTM can learn tasks that require memory of events occurred
in distant past ([22]).
Figure 2 shows structure of a basic lstm cell. The LSTM cells consist
of three sigmoid layers, a tanh layer, and four pointwise operations. The
governing equations of the LSTM cell are as follows.
6

Figure 1: Recurrent Neural Network

Figure 2: A basic LSTM cell

7

Ct = (Ct−1 × σ([Xt−1 , ht−1 ])) + (σ([Xt−1 , ht−1 ]) × tanh([Xt−1 , ht−1 ]))

(4)

ht = σ([Xt−1 , ht−1 ]) × tanh(Ct )

(5)

Variables Ct and ht in eqn. (4) and (5) are considered to be the long
term and short term memory respectively. Equation (4) determine which
information to add/remove from Ct . From the information of the long term
Ct−1 , short term ht−1 and current input Xt , we determine the output ht .
The paramters of the cell are adjusted with the input sequence data using
stochastic gradient descent algorithm.

2.4

Autoencoders

Autoencoders are neural network architectures which consist of an encoder
and a decoder and is used to generate representations in an unsupervised
manner from data ([23]). Autoencoders encode an input vector to an encoded
representation followed by decoding the representation back to a vector of the
same size to that of the input vector. The parameters of the encoder and the
decoder are estimated by minimizing the error between the decoded and the
original vector. Hence, they are useful in pretraining a deep neural network
with many layers when labeled data is not present or is not in sufficient
quantity.
The encoder and decoder can be mathematically represented as follows.
p = f (We x + b)

(6)

x0 = f (Wd p + bd )

(7)

The objective function optimization to find parameters < We , Wd , b, bd >
are given as follows.
1 X 0
|x − x|2
(8)
N
In this paper, we have used the above components and concepts to develop an architecture to generate fixed length representations from the road
network data and integrate into the End-to-End framework. The addition
of road network data to the framework improved the performance of the
End-to-End framework on urban growth prediction on the city of Mumbai.
minθ

8

Figure 3: Flowchart of the process of generation of fixed length representation

3

Methodology

In this section, we discuss the methodology of generating fixed length representations from road network using a dynamic recurrent autoencoder and
incorporating it into the End-to-End framework. A flowchart of the procedure is shown in Fig. 3.
• The process uses road network data and generates a list of variable
length sequences which we call Position Based Representation (PBR)
vector. The sequence is position based because it depends on the position of a cell in the cellular automata model as in eqn. 1 (Rule Based
End-to-End framework ).
• From the generated variable-sized sequences, we generate fixed length
representations which can be incorporated in the End-to-End framework. Fixed length representations are important because most classifiers, like KNN, SVM, ANN, take fixed length feature vectors.
• Finally, we incorporate the fixed length representation of the sequences
(PBR) into the End-to-End framework and build models.

3.1

Sequence Generation from road networks

The sequence generation step of the process flowchart generates sequences
from the road network such that it conforms to the cellular automata model
in eqn. 1. The updated eqn. 1 after adding a road network term is stated as
len
τpt+1 = fT (lpt , N (lpt ), φlen
raster (Rp , N (Rp )), φroad ((reg(p) ∪ reg(N (p))) ∩ Rn )) (9)

9

, where Rn denotes road network, reg(p) denotes a geographical region represented by a cell or cells and φlen
road is a function which returns
a fixed length representation of length len from a variable sized sequence.
φlen
road ((reg(p) ∪ reg(N (p))) ∩ Rn ) is a fixed length representation obtained
from the road network. The term (reg(p) ∪ reg(N (p)) is required because in
the End-to-End framework, we have assumed a neighborhood criterion N ()
when assuming cellular automata behaviour which means a particular cell is
only dependent on neighborhood cells. Inorder to fulfill this assumption, we
generate a extract road fragments present in the neighborhood of a cell p to
form a Position Based Representation (PBR) Vector (Discussed in Section
3.1.1).
An issue is the variable size of the roads in a road network due to which it
is non-trivial to structure the data in a relational form. Hence, we have used a
Dynamic Recurrent Neural Network Autoencoder (discussed in Section 3.2)
architecture to transform road sequences to a fixed length representation.
This is useful because fixed length representations can be effortlessly used as
feature vectors of a model.
3.1.1

Position Based Representation vector (PBR)

PBR vector is a portion of a road network which intersects with the region
represented by a cell and its neighborhood in the cellular automata model
of the End-to-End framework. The definition indicates that PBR vectors
depend on a cell and the neighborhood criterion of the End-to-End framework. A possible superimposition of cells of a cellular automata is depicted
in Figure 4. The cell size depends on how the cellular automata is defined
but currently for brevity, we can assume them as pixels of the satellite image
raster. The generation of PBR vectors is given in Algorithm 1.
Each road which intersects with a cell or its neighborhood will generate
a PBR vector. Hence there can be multiple PBR vectors for a single point.
For instance in Fig. 4, in the rectangular box p intersects with both road 1
and 2. Hence, there will be two PBR vectors.
The procedure to generate a list of PBR vectors is given in Algorithm 1
and is composed of two steps (two outer loops).
• The first part of the procedure uses two custom functions namely
coord2pixel and pixel2bbox, which can be easily developed if someone
is using ESRI shapefile2 formats and standard Geotiff3 raster formats.
We consider a matrix of lists H of size equal to that of the built-up
2
3

http://www.esri.com/library/whitepapers/pdfs/shapefile.pdf
https://trac.osgeo.org/geotiff/

10

Figure 4: Cell and its Neighborhood superimposed on a road network
raster where we store vector ids where a road intersects with a pixel.
H works similar to a chained hash table4 for the next part in which
we generate the PBR vectors according to the neighborhood criterion.
The hash table H reduces the search time by storing the road vector
ids v. During preparation of H it is possible that two coordinates ci
and ci+1 fall on two distant points pi and pi+1 . Since the network is
connected, therefore all the points falling in the straight line between pi
and pi+1 must also be connected. In order to achieve this we have used
Bresenham’s line drawing algorithm5 (line(p, q)) to detect the points
which fall between pi and pi+1 .
• The second part of the algorithm involves generation of bounding boxes
bbox from each pixel P and its neighborhood N (p) followed by performing spatial intersection ∩s with the road vectors of vector ids present in
positions {p, N (p)} of H. Spatial intersection (∩s ) is an intersection of
two geometries to produce another geometry, for instance, the spatial
intersection of two non-parallel lines gives a point.

3.2

Dynamic Recurrent Neural Network Autoencoder
(DRNNAE)

Dynamic Recurrent Neural Network Autoencoder is a recurrent neural network which can learn representations from variable length sequences in an
4
5

http://www.geeksforgeeks.org/hashing-set-2-separate-chaining/
http://www.idav.ucdavis.edu/education/GraphicsNotes/Bresenhams-Algorithm.pdf

11

Algorithm 1 Sequence Generation Procedure
Input
Bt ← Built-up raster at time t
Rv ← Road network Vector Data
d ← Number of decimal places to consider in a coordinate system
Variables
H ← A two dimensional array of lists of size same as Bt
Custom functions
coord2pixel(c) ← Function which inputs a coordinate and outputs a pixel.
pixel2bbox(p, Bt ) ← Function to convert a pixel to its corresponding
bounding box.
line(p, q) ← Function which uses Bresenham’s line algorithm to find pixels
falling on a line between p and q
∩s ← Intersection of two geometries to provide another geometry (spatial
intersection)
Output
Rx ← List containing Position Based Representation (PBR) Vector of
Road network
Procedure
for all vector v ∈ Rv do
for all {ci , ci+1 } in v do
pi ← coord2pixel(ci )
pi+1 ← coord2pixel(ci+1 )
for all p ∈ line(pi , pi+1 ) do
if v ∈
/ H[p] then
H[p] ← H[p] ∪ vid
end if
end for
end for
end for
for all p ∈ H do
bbox ← pixel2bbox(q), ∀q ∈ {p, N (p)}
for all v ∈ H[p] do
templist ← v ∩s bbox // ∩s is spatial intersection
templist ← {xp , yp }, ∀p ∈ templist
Rx ← Rx ∪ templist
end for
end for
return Rx
12

Algorithm 2 Fixed length Representation generation
Input
Bt ← Built-up raster at time t
Rx ← List containing Position Based Representation (PBR) Vector of
Road network
epochs ← Number of Epochs of training
repsize ← Size of the fixed length representation
Variables
drnnae ← {lstmenc , lstmdec , repsize } Dynamic Recurrent Neural Network
Autoencoder
sdrnnae ← {drnnaelat , drnnaelon } Spatial Dynamic Recurrent Neural
Network Autoencoder
Custom functions
mean(matrix, axis) ← Function to compute mean of elements on a particular axis (row-wise or column-wise)
train(autoencoder, f v) ← Function to train an autoencoder with feature
vectors f v
Output
Rfp lv ←Fixed length Representation vector for pixel p in Bt
Procedure
for i ← 1 to epochs do
for all batchx ∈ Rx do
train(sdrnnae, batchx )
end for
end for
Rf lv ← lstmenc .encode(Rx)
for all p ∈ Bt do
Rfp lv ← mean(r, axis = 0), ∀r ∈ Rfp lv
end for
return Rf lv

13

Figure 5: Dynamic Recurrent Neural Network Autoencoder
unsupervised manner. Figure 5 shows the diagram of the autoencoder. The
architecture is composed of two components namely, an RNN encoder and
decoder. The encoder encodes the features, whereas the decoder decodes it
back to the original input which is similiar to an Autoencoder (discussed in
Section 2.4). This assists us in training the architecture in an unsupervised
manner.
From Section 2.2, we have seen that a recurrent neural network can be
unrolled into a number of basic cells. Due to this property, a recurrent neural
network can unroll itself into variable length according to a sequence. For
instance, for a sequence of length twenty, we unroll the RNN for twenty steps
and for a sequence of length thirty in the same dataset, we unroll the RNN
thirty times. In each of the cases, the output ht from eqn. (3), is of fixed
dimensionality. Thus, the recurrent neural network is capable of generating
fixed sized representations from variable sized sequences in the same dataset.
In practice, recurrent neural networks face a problem during training
which is called the vanishing gradient problems [21]. In order to avert the
problem, we have used a specialized recurrent basic cell which is the LSTM
(discussed in Section 2.3). LSTM is capable of running on sequences of long
sizes because of the unique ability to remember long-term as well as shortterm information ([9]). This makes it suitable for learning long as well as
short sized variable length sequences.
The architecture is composed of an encoder and a decoder, descriptions
of which are given as follows.
• Figure 6(a) illustrates the RNN Encoder architecture. There are k
14

(a) LSTM encoder

(b) LSTM decoder

Figure 6: Dynamic Recurrent Neural Network (a) Encoder (b) Decoder
streams of LSTM sequences which ultimately results in a k sized representation of the input vector X of size m (provided that the LSTMs
have different parameters). It may be noted that m can vary according
to the size of |X|. Hence the guiding equation for the encoder is given
as follows.

k
Ctk , hkt = flstm
(ht−1 , Xt , Ct−1 )

(10)

• Figure 6(b) illustrates the RNN Decoder architecture. The k sized
representation by the LSTM sequences are used to generate m sized
sequences. The guiding equation for the decoder is as follows.

0
Ct0 , h0t = flstm (h0t−1 , W ht + b, Ct−1
)

(11)

• The objective function for estimation of parameters is given as follows.

E=

1 X 0
|ht − Xt |2
N

(12)

The procedure for generation of fixed length representation is given in
Algorithm 2. The algorithm trains a SDRNNAE (discussed in Section 3.2.1)
which is composed of two DRNNAE because the PBR vectors have two dimensions viz latitude and longitude. It involves training the autoencoder
using stochastic gradient descent and then generating encoded feature vectors. Since for certain cases, we can have more than one fixed length vectors,
we resolve it by taking mean of the vectors row-wise.
15

Algorithm 3 Spatial Dynamic Recurrent Neural Network Autoencoder
Non-trainable Parameters
lseqmax ← Maximum length of sequence
nhidden ← Number of hidden LSTM units
Sm ← Length of mth sequence
Trainable units and parameters
flstm ← A Basic cell of LSTM as shown in Fig. 2.3
[W, B] ← Weights and Biases.
LSTM encoder for latitude
k
t
lat
), ∀k ∈ 1, 2, 3, ..nhidden and t ∈ {1, 2, ..Sm }
, Ct−1
(hkt−1 , Xm
Ctk , hkt ← flstm
LSTM decoder for latitude
c ← Welat h + Belat
lat
0
Ct0 , h0t ← flstm
(h0t−1 , c, Ct−1
) and t ∈ {1, 2, 3, ...Sm }
0
lat 0
Xm ← Wd h
Minimization
P 0 criterion
E ← S1m
|Xm − Xm |2
LSTM encoder for longitude
k
lon
), ∀k ∈ 1, 2, 3, ..nhidden and t ∈ 1, 2, ..Sm
(hkt−1 , Ymt , Ct−1
Ctk , hkt ← flstm
LSTM decoder for longitude
c ← Welon h + Belon
0
lon
) and t ∈ {1, 2, 3, ...Sm }
(h0t−1 , c, Ct−1
Ct0 , h0t ← flstm
lon 0
0
Ym ← W d h
Minimization
P 0 criterion
E ← S1m
|Ym − Ym |2

16

3.2.1

Spatial Dynamic Recurrent Neural Network Autoencoder

In this work, we have used two DRNNAE for representation two axes of the
coordinate system to generate fixed length representation. The description
of the Spatial Dynamic Recurrent Neural Network Autoencoder in Algorithm
3. There are two encoders and decoders which are trained separately for
sequences of latitude and longitude coordinates. The model generates fixed
length representations of size 2nhidden . The algorithms of training recurrent
neural networks can be obtained from several other works ([21, 6]).

3.3

Features of the Dynamic Recurrent Neural Network Autoencoder

The proposed architecture for generating fixed length representation from
road networks has the following qualities.
• The algorithms for generation of fixed length representations are unsupervised. There is no requirement of any manual labeling in application
of both the algorithms (Algorithm 1 and 2). This is useful as there are
large repositories of transportation data available which can be utilized
for prediction purposes without manual labeling or feature engineering.
• The algorithms generate representations which are of fixed size. Fixed
sized representations have enormous utility because they can be used
in machine learning models as training data to find patterns. Hence
given a representation, different applications can be build using it, thus
making the modeling process robust.
• No manual feature engineering is involved in the process of generation of
fixed length representation. Hence, the process is generic and depends
largely on the data provided and the hyperparameters of the training
process.
Finally, the architecture comes with a drawback. Since the representations generated by the architecture are numerical in nature, therefore it
provides us no clue as to what it means. Hence, evaluation is only limited to
visualization and various kinds of accuracy metrics for different applications.
Furthermore, since the network can go to large depths, computation time for
estimating parameters of the encoder as well as encoding process increases.

17

Time step % transformed
1991 − 2001
15%
2001 − 2011
10%

% persistent
85%
90%

Table 1: Number of pixels transformed vs number of pixels persistent

4

Experiments and Results

In this section, we provide details of the experiments and inferences which
have been carried out on the region of Mumbai (latitude: 19.0760◦ N, longitude: 72.8777◦ E). Mumbai is the capital city of Maharashtra and one of the
major cities of India which has seen urbanization in last 20 years according
to the Census of India. According the reports by the Census, population
of Mumbai has steadily risen from approximately 9 million in 1991 to more
than 12 million in 2011.
The experiments have been conducted in a Virtual Machine (VM) running in an Open Stack based cloud infrastructure. The VM consists of 8
VCPUs, 16 GB RAM and Ubuntu 14.04 as operating system.

4.1

Data collection and Preprocessing

We have two kinds of data requirement for performing experiments – one
is raster images for year 1991, 2001 and 2011 and road network data. The
raster images are downloaded from United States Geological Survey (USGS)
website and the road network data for the region of Mumbai have been collection from the Open street maps data portal6 . The extracted region of
Mumbai from the satellite image consists of 972280 pixels. It is important
to ensure whether both the data are following the same coordinate reference
frame before starting experiments. From the raster images of three time
steps we have derived the urban built-up maps. The segmentation method is
maximum likelihood classification which is a semi-automatic method of classification of the raster images. The generated maps are verified using Google
timelapse7 , Google Maps8 as well as previously published works on Mumbai
[13, 19, 18]. The number and percentages of transition and persistent pixels
are shown in Table 1. The raster, built-up images and road network are
shown in Fig. 7.
The preprocessing consists of the generation of PBR vectors from the road
network data by employing Algorithm 1. As discussed in Section 3.1, the
6

https://www.openstreetmap.org/
https://earthengine.google.com/timelapse/
8
https://www.google.com/maps
7

18

(a) Raster 1991

(b) Built-up 1991

(c) Built-up 2001

(d) Built-up 2011

(e) Roads OSM

Figure 7: Dataset of the Mumbai, India area
algorithm comprises formation of a matrix H of lists of vectors and thereby
generating PBR from the road network. The structure H is a crucial data
structure which has the same number of rows and columns as the image
raster and each position is a list of vectors of roads which passes through
that position. In figure 8(a), we depict a visualization of the matrix H by
generating a binary image where a non-white pixel at a position indicates
a nonempty list of vectors. The structure H is important as it reduces the
time for generating the PBR vectors by acting as a lookup table.
From the structure H, Algorithm 1 generates PBR vectors. We have
considered neighborhood criterion N () in Algorithm 1 as Moore neighborhood of radius 1 which gives the maximum length of a PBR vector as 18.
This means, that the Dynamic Recurrent Neural Network Autoencoder has
to unroll at maximum up to 36 time steps. If we take in terms of a feed forward neural network, then this equivalent to a 36-layer feed forward neural
network. Hence, we can also call this architecture a deep architecture.

19

(a) H matrix

(b) Cost optimization

Figure 8: (a) Visualization of the H matrix. White pixels indicate nonzero
list of road vectors. (b) Cost optimization of the SDRNNAE.

4.2

Training and Representation

The list of sequences generated from the previous step has been used for training a Dynamic Recurrent Neural Network Autoencoder (Section 3.2). The
number of sequences generated from the road network is equal to 1181974.
We have used stochastic gradient descent with batches of size 100000 to train
the autoencoder by varying the number of time steps and size of fixed length
representation with a learning rate of 0.1. After the training process is done,
the trained architecture is used to generate a fixed length representation (see
Algorithm 2). The architecture has been developed using tensorflow 9 library
of python.
For validation of unsupervised methods, there are two kinds of approaches
namely, intrinsic and extrinsic. Extrinsic methods use available ground truth
whereas intrinsic methods do not use any ground truth data for validation
([5]). For extrinsic validation, we have used the validation criteria of urban
growth (F oM, P A, U A and OA) to quantitatively measure the representation
quality. For intrinsic verification, we have performed qualitative (visual)
verification of reconstructed PBR from the original PBR.
The four validation metrics (F oM, P A, U A and OA) by ([17]) are dependent on 5 variables given as follows.
• A = Area of error due to observed change predicted as persistence.
• B = Area correct due to observed change predicted as change.
9

https://www.tensorflow.org/

20

• C = Area of error due to observed change predicted in the wrong
gaining category.
• D = Area of error due to observed persistence predicted as change.
• E = Area correct due to observed persistence predicted as persistence.
Figure of Merit (F oM ) provides us the amount of overlap between the observed and predicted change. Producer’s accuracy (P A) gives the proportion
of pixels that model accurately predicted as change, given that the reference
maps indicate observed change. User’s accuracy (U A) gives the proportion
of pixels that the model predicts accurately as change, given that the model
predicts change. The equations of the metrics are given as follows.

F oM =

B
A+B+C +D

(13)

PA =

B
A+B+C

(14)

UA =

B
B+C +D

(15)

B+E
A+B+C +D+E

(16)

OA =

We have validated our representation technique based on how these four
metrics vary as the size of the fixed length representation and the number
of iteration is varied. There are three divisions of experiments based on the
size of feature count which is shown in Fig. 9 and 10. We also determine the
effectiveness of the training algorithm by checking the value of the objective
function (eqn. 12) as the training proceeds. The cost optimization graph is
given in Fig. 8(b).

4.3

Results and Discussion

The results presented in Fig. 9 and 10 indicates that there is a rise in
the performance metrics (eqn. 13, 14, 15, and 16) with increase in length of
fixed length feature vectors. However, the rate of increase is not constant and
21

Figure 9: Variation of metrices with length of fixed length representation –
Mumbai 1991-2001.

22

Figure 10: Variation of metrices with length of fixed length representation –
Mumbai 2001-2011.

23

reduces as the feature length is increased. This is possibly due to the increase
in the number of dimensions in the data which brings in the issue of curse of
dimensionality. In high dimensional spaces, a finite dataset consisting of a
fixed number of points turns sparse due to which predictive power of machine
learning models reduces ([8]).
On comparison of improvement of the fixed length representation technique with the baseline method, as discussed in Section 2.1.1, we find that
our method performs better (Figure 11). In the baseline method, the performance metrics decreases than the former Rule based End-to-End framework, whereas our method gives enhanced performance. This indicates that
our method is generating meaningful representations from the road network
data. A summary of improvements over baseline method is stated below.
• 20% improvement in Figure of merit.
• 17% improvment in Producer’s accuracy.
• 10% improvement in User’s accuracy.
• 3% improvment in Overall accuracy.
A summary of improvement over the existing Rule based End-to-End
framework on performance metrics is given as follows.
• 0.8% improvement in Figure of Merit.
• 0.9% improvment in Producer’s accuracy.
• 0.6% improvement in User’s accuracy.
• 0.2% improvment in Overall accuracy.
The baseline method works poorly due to the rasterization of the road
network which causes loss of much of the spatial information present in the
network. Contrary to that in our method, the spatial information is preserved
in the encoding done by the SDRNNAE, the extent of which depends on the
encoding size. Due to this, we see improvement in the performance metrics.
However, the increase is not arbitrary and is limited by the resolution of
the built-up image data which we have generated from the satellite imagery.
Since road network vector data is a finer source of data, therefore to fully
recognize its capability it is important to have a finer resolution of built-up
information, which is not available to us currently.
Figure 12 shows an extract from the original PBR and the reconstructed
PBR. The reconstruction has been carried out from encoded representations
24

(a) 1991-2001

(b) 2001-2011

Figure 11: Performance analysis of fixed length representation with baseline
and existing method.

25

(a) Original PBR

(b) Reconstructed PBR

Figure 12: Visualization of PBR vectors – original vs reconstructed after
training.
of size 10. The reconstruction is crude but it gives us an idea that the LSTM
decoder is able to decode the representations from the encoded representations by the LSTM encoder. We have used this to qualitatively verify
our training process and hence can be considered as an intrinsic validation
process. In short, reconstruction gives us an idea of the goodness of the
representation.

5

Conclusion

In this paper, we proposed a method for generating fixed length representations to incorporate road network to Rule based End-to-End framework. By
incorporating road network using our method, we have observed a rise in the
performance metrics of urban growth. However, the algorithms for generation
of fixed length representation are time-consuming. Moreover, comprehending the fixed length representations is a challenging task. Further work in
this area can be done on addressing these challenges as well as incorporating
other forms of vector data as in point and polygon data.

References
[1] V. Badrinarayanan, A. Kendall, and R. Cipolla. Segnet: A deep convolutional encoder-decoder architecture for image segmentation. arXiv
preprint arXiv:1511.00561, 2015.
26

[2] Y. Bengio, A. Courville, and P. Vincent. Representation learning: A
review and new perspectives. IEEE transactions on pattern analysis
and machine intelligence, 35(8):1798–1828, 2013.
[3] A. Graves and N. Jaitly. Towards end-to-end speech recognition with
recurrent neural networks. In ICML, volume 14, pages 1764–1772, 2014.
[4] A. Graves, A.-r. Mohamed, and G. Hinton. Speech recognition with deep
recurrent neural networks. In Acoustics, speech and signal processing
(icassp), 2013 ieee international conference on, pages 6645–6649. IEEE,
2013.
[5] J. Han, J. Pei, and M. Kamber. Data mining: concepts and techniques.
Elsevier, 2011.
[6] S. S. Haykin. Neural networks and learning machines, volume 3. Pearson
Upper Saddle River, NJ, USA:, 2009.
[7] S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural
computation, 9(8):1735–1780, 1997.
[8] G. Hughes. On the mean accuracy of statistical pattern recognizers.
IEEE transactions on information theory, 14(1):55–63, 1968.
[9] Y. LeCun, Y. Bengio, and G. Hinton.
521(7553):436–444, 2015.

Deep learning.

Nature,

[10] Y.-P. Lin, H.-J. Chu, C.-F. Wu, and P. H. Verburg. Predictive ability of
logistic regression, auto-logistic regression and neural network models in
empirical land-use change modeling–a case study. International Journal
of Geographical Information Science, 25(1):65–87, 2011.
[11] Y. Liu. Modelling urban development with geographical information systems and cellular automata. CRC Press, 2008.
[12] T. M. Mitchell. Machine learning. 1997. Burr Ridge, IL: McGraw Hill,
45(37):870–877, 1997.
[13] H. S. Moghadam and M. Helbich. Spatiotemporal urbanization processes
in the megacity of mumbai, india: A markov chains-cellular automata
urban growth model. Applied Geography, 40:140–149, 2013.
[14] S. I. Musa, M. Hashim, and M. N. M. Reba. A review of geospatial-based
urban growth models and modelling initiatives. Geocarto International,
pages 1–21, 2016.
27

[15] S. Pal and S. K. Ghosh. Rule based end-to-end learning framework for
urban growth prediction. arXiv preprint arXiv:1711.10801, 2017.
[16] R. Pascanu, T. Mikolov, and Y. Bengio. On the difficulty of training recurrent neural networks. In International Conference on Machine
Learning, pages 1310–1318, 2013.
[17] R. G. Pontius, W. Boersma, J.-C. Castella, K. Clarke, T. de Nijs, C. Dietzel, Z. Duan, E. Fotsing, N. Goldstein, K. Kok, et al. Comparing the
input, output, and validation maps for several models of land change.
The Annals of Regional Science, 42(1):11–37, 2008.
[18] A. Rienow and R. Goetzke. Supporting sleuth–enhancing a cellular
automaton with support vector machines for urban growth modeling.
Computers, Environment and Urban Systems, 49:66–81, 2015.
[19] H. Shafizadeh-Moghadam, J. Hagenauer, M. Farajzadeh, and M. Helbich. Performance analysis of radial basis function networks and multilayer perceptron networks in modeling urban change: a case study. International Journal of Geographical Information Science, 29(4):606–623,
2015.
[20] N. Srivastava, E. Mansimov, and R. Salakhudinov. Unsupervised learning of video representations using lstms. In International Conference on
Machine Learning, pages 843–852, 2015.
[21] I. Sutskever. Training recurrent neural networks. University of Toronto,
Toronto, Ont., Canada, 2013.
[22] I. Sutskever, O. Vinyals, and Q. V. Le. Sequence to sequence learning
with neural networks. In Advances in neural information processing
systems, pages 3104–3112, 2014.
[23] P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol.
Stacked denoising autoencoders: Learning useful representations in a
deep network with a local denoising criterion. Journal of Machine Learning Research, 11(Dec):3371–3408, 2010.

28

