title: How much VRAM do I need for training a Keras model
body: <p>Hello I recently started my bachelor Project in which I need to train a LSTM model which has following structure</p>
  <p>inputs (InputLayer)         [(None, None, 80)]        0</p>
  <p>masking (Masking)           (None, None, 80)          0</p>
  <p>lstm (LSTM)                 (None, None, 100)         72400</p>
  <p>outputs (TimeDistributed)   (None, None, 39)          3939</p>
  <p>=================================================================</p>
  <p>Total params: 76,339</p>
  <p>Trainable params: 76,339</p>
  <p>Non-trainable params: 0</p>
  <pre><code>inputs = tf.keras.Input(shape=(None,nb_features), name = 'inputs')
      
      x = tf.keras.layers.Masking(mask_value = data.MASK_VALUE)(inputs)
      
      x = tf.keras.layers.LSTM(hidden_units,
                               return_sequences = True,
                               dropout = dropout_rate)(x)
  
      dense = tf.keras.layers.Dense(nb_skills, activation = 'sigmoid')
      outputs = tf.keras.layers.TimeDistributed(dense, name = 'outputs')(x)
  </code></pre>
  <p>Now my qeustion how much VRAM I need for training. I have a 2080ti with 11GB of VRAM inside my Station and I dont know if that is enough. Maybe there is some helpful site which calculates something like that. I try to find it myself but I dont think that something like that exists yet.</p>
  <p>Thanks for your help</p>