Is a second bachelors degree worth it?
Unless you have in mind a second degree in a completely different field, I think you'd be spinning your wheels.  You can probably take those physics and math courses in post-baccalaureate status; check with the institution from which you got your degree.

If you are thinking of a second bachelor's degree in a field similar to your first, go for the master's degree in that field instead.  Your freshman year GPA will probably not keep you out of most programs since you have a solid record in your final years.  Presumably you'd get good recommendations from your upper division professors.