title: Setting batch_size in data_param for Caffe has no effect
body: <p>When I set <code>'batch_size'</code> in <a href="https://github.com/BVLC/caffe/blob/master/models/bvlc_googlenet/deploy.prototxt" rel="nofollow">deploy.prototxt file</a> in Google deep dream <em>bvlc_googlenet</em> to lower GPU memory requirements, it has no effect on speed nor memory requirements. It's as if it was ignored. I know the file itself (deploy.prototxt) is being used because other changes are reflected in results so that's not the issue. I also tried to set batch_size on all related layers as well ("inception_4c/1x1", etc), again no difference.</p>
  
  <p>This is how I'm setting it:</p>
  
  <pre><code>layer {
    name: "inception_4c/output"
    type: "Concat"
    bottom: "inception_4c/1x1"
    bottom: "inception_4c/3x3"
    bottom: "inception_4c/5x5"
    bottom: "inception_4c/pool_proj"
    top: "inception_4c/output"
    data_param {
      batch_size 1
    }
  }
  </code></pre>
  
  <p>When I time the runtime of the script, it's the same with batch_size 1 and with batch_size 512, there is no difference.</p>
  
  <p>What am I doing wrong?</p>