up until that time , they had been living in adequate quarters in the main house , working all hours , and enjoying each other , but mary quickly picked up on where ryan was going with the house idea .