Can a neural network be of variable depth?
&quot;Wide and Deep network&quot;  was used in a 2016 paper.

$\hspace{5cm}$Wide &amp; Deep Learning for Recommender Systems
You may create using keras Concatenate layer
concat = keras.layers.Concatenate()([input, hidden2])


References to read -
The paper
Google blog
Another paper