Simple solution for driving a large-ish RGB LED array with PWM
There's a bunch of LED driver ICs, for instance TLC5951DAP. See it in use here: 
Mbled

Similar problems has been solved in a few open source projects, like Peggy2.
The chip Peggy2 is using seems to be going out of production, MBI5026 might be a replacement.