My husband is again wanting to get into residential real estate investment (purchasing and then renting)

I'm against it for moral reasons (limiting supply of first-time buyer properties for couples/new families)

Am I the only one who has an ethical problem with this?