Views Infinite Scroll Set default page with position
I know this answer seems to be (might be) a bad solution but it works. Use the code window.history.back() for "Back to previous Page" link like follows

&lt;input type="button" value="Back to previous Page" onclick="window.history.back()" /&gt;

                             OR

&lt;a href="#" onclick="window.history.back()"&gt; Back to previous Page &lt;/a&gt;


As far as I know this is browsers default behavior. So it works. 

I've tested it and working on latest version of all major browsers. 

Hope it helps.