How do I say "I've got all his albums"?
光盘 = Disk =  

So that's a huge no-no.

唱片 is more of a old fashion way of saying album. So I personally recommend 专辑.

So the result would be: 他的专辑我都有。or 我有他所有的专辑。