Initial values of memory and previous block output in LSTM?
Either you use a zero vector state for both (most commonly used), or you can use other approaches such as described in this article.

I have personally always used zero vectors.