Can I use a bench power supply as a substitute for a 9V DC adapter?
Is it possible? Yes.  That's pretty much what bench power supplies are for.
Set the current limit to something low.  Set the voltage to 9V before you make the connection.  Make sure you get the + and - the right way round.
You need to use the + and - outputs.  + and GND alone won't do anything.