Does SQL Server allow moving backwards with standby file?
You must restart the restore sequence.

I believe SQL Server could theoretically allow  moving backwards in time because the logs contain both undo and redo information. But this is either not implemented or it is not possible for some reason.