n_input input layer ( pixelsn_hidden st hidden layer n_hidden nd hidden layer n_hidden rd hidden layer n_output output layer ( - digitsthe following diagram shows visualization of the architecture we've designedwith each layer fully connected to the surrounding layersdiagram of neural network the term "deep neural networkrelates to the number of hidden layerswith "shallowusually meaning just one hidden layerand "deepreferring to multiple hidden layers given enough training dataa shallow neural network with sufficient number of units should