What if we input sequence data to feedforward network? One main advantage of RNN is the ability to take input of variable length like the case of sequences.
However, what if we neglected this case and assumed some applications that may accept some fixed window of input. For example, the weather prediction. We may input the temperature of the last 300 days for example to allow the network to predict the new temperature. We may fix this window of 300 all the time so that we have a fixed-length input.
My question now is what if we neglect the RNN in this case and input this window of 300 days into a feedforward network with 300 input dimensions and one output that is doing regression for it?
What will be the output as compared to RNN? In other words, why I should use RNN in this case?
A finite impulse response (FIR) RNN can be expressed as a directed acyclic graph (DAG), hence it can be represented as a FFNN. So, you could theoretically make an equivalent FFNN to an RNN in this situation.
In terms of performance between non-equivalent models, an RNN would probably be better because, as they are inherently designed for sequential data. In the case of weather stat prediction, the temporal nature of the sequence elements would need to be learned by a FFNN, whereas an RNN would have in-built knowledge of such relationships. The RNN would also be able to more easily take advantage of &quot;memory&quot; via the common gating mechanisms as seen in LSTMs and the like.