Activities such as rowing and boxing with a bag will help tone back muscles and burn fat all over, which makes a great exercise for back fat. Try this calorie-blasting rowing machine workout. In the weight room, bent-over flys work muscles in the upper back and are an ideal exercise for back fat reduction. Hold a dumbbell in each hand and bend over at your hips. Then, draw your arms out to each side, raising them to shoulder height.