title: How to interpret weight distributions of neural net layers
body: <p>I have designed a 3 layer neural network whose inputs are the concatenated features from a CNN and RNN. The weights learned by network take very small values. What is the reasonable explanation for this? and how to interpret the weight histograms and distributions in Tensorflow? Any good resource for it?</p>
  
  <p>This is the weight distribution of the first hidden layer of a 3 layer neural network visualized using tensorboard. How to interpret this? all the weights are taking up zero value?</p>
  
  <p><img src="https://i.stack.imgur.com/5Xaqa.png" alt=""></p>
  
  <p>This is the weight distribution of the second hidden layer of a 3 layer neural:</p>
  
  <p><img src="https://i.stack.imgur.com/Ux9Tg.png" alt=""></p>