His successful collegiate coaching career, however, saw an unceremonious end when he was relieved of his duties by Duke Athletics Director Joe Alleva just a year into Alleva's tenure, after only six wins in his last three seasons.
In addition, under Goldsmith's tenure, Duke's football program was ordered to pay walk-on kicker, Heather Sue Mercer, $2,000,001 in nominal and punitive damages for its discriminatory treatment of her during her time on the team.