Can't get past the PIN-screen of my newly bought used S4
So you have resetted the device? 
Or was the resetting to factory defaults not working? 

Boot into the recovery ( volume UP + power button - press both until the screen turns on and release the power button then) and then perform a factory reset from there. This should delete all user data and your phone should restart to the initial startup configuration.