But even if you’ve had this problem for a while, there are ways to get rid of chest fat. Eat Healthier. If you’re overweight and have man boobs, you need to cut down on the fat. The first thing you have to do is find your ideal body weight and make the effort to reach that. Start by removing junk and processed food from your diet and replace them with fiber and protein rich foods.