Allow system to sleep even with audio stream running
You can use a third party tool like Power Manager to make your Mac sleep after a period of inactivity.



Unlike OS X's Energy Saver, Power Manager can put your unused Mac to sleep even when an application or process has requested otherwise. 

Disclaimer: I wrote Power Manager and can answer comments about how it works.