Identifying Lego set from 1980's
My closest bet would be the Car Repair Shop. However, there are lots of other sets that could match the description.

Edit #1:

The other potential candidates:


Weekend Home
Auto Workshop
Holiday Home
Houses
House with Roof Windows
Holiday Villa


In case none on these is what you are looking for, you could take a look at Bricklink and browse the results.

Edit #2: 

Based on the picture you added, the 730-2 BASIC Building Set seems the most likely choice (it has both minifigs, the broom, the shovel, the faucet, the slanted windows). There are also many pieces from other sets: both the blue and the red-yellow propeller, the yellow spaceship engine besides the male figure, etc.