What are these light like panels on the overhead bins of Boeing 737?
They are indeed emergency cabin lighting. See, for instance, this photo of a similarly configured 737 interior.

(Łukasz Stawiarz - JetPhotos.net)