Connectors for horizontal and vertical mount
If the requirement is "as few additional components as possible", then the answer is probably some kind of edgecard connector. This requires only one additional component, probably a connector mounted on the main card. Connection to the daughter card is made through a pattern etched in copper on the daughter card. 



It should be possible to find a family of connectors that allows either a horizontal or vertical connection.