Scientific explanation of Skip Connections
I recently read this paper which proposed a new technique without using skip-connections.It is proposed that the same accuracy can be achieved by increasing the width of the network rather than depth.