h in LSTM increasing in size?
o(t) is not the result of concatenation of h(t-1) and x(t), but a simple matrix multiplication.
See wikipedia for further details:

https://en.wikipedia.org/wiki/Long_short-term_memory