Nucleophilicty order of various nucleophiles
Like most concepts that are not captured by a single number, nucleophilicity is not a simple (or at least, relatively simple) concept like acidity.

Nucleophilicity depends a lot on orbital alignment and interaction, in addition to thinking about charges. It's also confusing because nucleophility is not always married to the stability of the adduct. For example, iodide is a great nucleophile, but alkyl iodides are also highly reactive.

In your specific case, since the two nucleophiles have the same charge, you should look at other factors. Bromide is significantly larger than hydroxide, and it is a much better nucleophile, at least when we're considering carbon electrophiles. Indeed, we see bromide used in nucleophilic catalysis but not hydroxide.