How to watch photo sphere taken on another device offline on android?
In answering my own question, got the answer on https://productforums.google.com/forum/#!topic/photos/SbXGsiE7HLE 
Pasting it here anyway so anyone else stumbling over this post gets it as well :-)

Downloaded Photo Spheres will be opened by the card board app as spheres rather than plane images.