How to predict past test set on time series data using LSTM
The best answer I found is here

Unfortunately I couldn't get it to work for my solution but reworked my solution and just incremented the sliding window, appended that answer to my test data, and iterated like that.