title: How to define weight decay for individual layers in TensorFlow?
body: <p>In CUDA ConvNet, we can write something like this (<a href="https://code.google.com/p/cuda-convnet/wiki/LayerParams" rel="noreferrer">source</a>) for each layer:</p>
  
  <pre><code>[conv32]
  epsW=0.001
  epsB=0.002
  momW=0.9
  momB=0.9
  wc=0
  </code></pre>
  
  <p>where <code>wc=0</code> refers to the L2 weight decay.</p>
  
  <p>How can the same be achieved in TensorFlow?</p>