Oculus rift (or, what do other eye placements see?)
It would probably be quite disorienting, maybe even make you sick.

There is a much more limited fun classroom demo that my institution uses with kids, where they wear goggles that shift their view a couple degrees to the left (this demo is quite common, you can find many examples on YouTube as well). They stand a couple meters from a wall and throw a ball at a target: inevitably, they miss wide right for the first few throws, but eventually they adapt and hit the target no problem; then when they remove the goggles, they miss again to the left.

So, your visual system can adapt to some shifts in visual field. However, if the view was very skewed, oriented for example like the eyes of cattle, on the sides of the head, it would be much more difficult to adapt to where it feels natural. I would expect the strategy people would use would be to attend to only one visual field or the other, since there is no longer any binocular area of vision, sort of like if you would look as far to the right as you possibly can you see a lot of visual space with only one eye.

An important element to immersive VR is that you feel like you are actually having the experience - in VR when you have some sort of joystick or controller to manipulate, for example, it is really helpful to orient people by allowing them to see the controller in virtual space. Providing the eyes with very unusual inputs is going to make it much harder to maintain the illusion.