Why aren't more prostate glands just removed?
Your question is along the lines of "Many women will develop breast cancer, especially later in life. Why don't they just remove their breasts after menopause, because they won't need them for breast feeding?" There are a lot of disadvantages and only questionable advantages.

Chief among the effects of removing the prostate are urinary incontinence and erectile dysfunction. That area of the body is very highly innervated, and it is nearly impossible to just remove the prostate without damaging anything else. While it is true that many men will develop prostate problems as they get older, they can frequently be treated medically, or just observed for any dangerous changes. Benign prostate hyperplasia is just that - benign - so there's no need to undergo a major operation with significant side effects. Additionally, many prostate cancers are so slow-growing that they never metastasize or pose any threat, so they are simply monitored and treated medically as needed.