Delay when using the volume buttons
Typing sudo killall coreaudiod in the terminal fixed the issue straight away for me.

It also removed the delay on the keyboard brightness buttons.
Issue started after going back to internal speakers after streaming audio through airport.