 While Walsall actually gave permission for Lee to speak to Plymouth, and Lee publicly turned the job down, Walsall owner Jeff Bonser claimed that if Lee was truly committed then he wouldn't have even spoken to Plymouth, and that as his actions were tantamount to misconduct, he would not receive any compensation (though Bonser eventually paid up Lee's contract after intervention from the League Managers Association).However, his sacking also coincided with a bad run of results for Walsall including a 6–1 home defeat to Coventry City.Colin Lee began his fourth full-time manager's job in July 2005 with Millwall, succeeding Steve Claridge who had been sacked after just 36 days at the helm by the club's new owners.