Brick texture - controlling the randomness
OK well as usual, an hour after you ask you find the solution...

Turns out I was misunderstanding how the brick texture works - it doesn't generate a discrete set of colors, it draws a new random color for each brick. So each color is random across the entire color spectrum, and I can classify them using a ColorRamp after all.