Postgresql requested starting point is ahead of the WAL flush position of this server
I ended up deleting the slave and redeploying a new one with the "new" basebackup.

Obviously this is not ideal, but it works. It's a last resort solution. It's literally setting up that part of the environment fresh.