 Justice Frankfurter actually vowed to stay on the Supreme Court long enough so that Judge Kaufman would be too old to replace him. That's how personal Justice Frankfurter took it. The criticism he was subjected to for decades over the Rosenberg case. The irony? His rulings after the Rosenberg trial were consequential. A 1961 school desegregation case in New Rochelle, New York, was the first in the North.