Why activity makes me material & full of desires?
What really matters for a lay person as per Buddhist teaching is whether you are at least a Sotapanna which assures you the enlightenment withing seven births. As far as you have the right livelyhood you do not have to worry being materialistic and being rich.