Media Gallery not using lightbox and required libraries are in place. What is wrong?
As Bala Varadarajan suggested. I gave sites/all/libraries/colorbox/ and all its contents full Read/Write permissions.

The lightbox is working now.