title: Unsupervised pre-training for convolutional neural network in theano
body: <p>I would like to design a deep net with one (or more) convolutional layers (CNN) and one or more fully connected hidden layers on top.<br>
  For deep network with fully connected layers there are methods in theano for unsupervised pre-training, e.g., using <a href="http://www.deeplearning.net/tutorial/SdA.html">denoising auto-encoders</a> or <a href="http://www.deeplearning.net/tutorial/rbm.html">RBMs</a>.</p>
  
  <p>My question is: How can I implement (in theano) an unsupervised pre-training stage for convolutional layers?</p>
  
  <p>I do not expect a full implementation as an answer, but I would appreciate a link to a good tutorial or a reliable reference.</p>