This a bad way to frame moves, they always carry a degree of risk. If that's how teams thought they'd never make any moves.

Brown set a bar and in year one and has operated below it since then. You have nothing to lose by firing him, you're already below expectations