"Symmetrize armature" flips bones vertically
It turned out that I had an unapplied rotation to the mesh. For reference for anyone with a similar problem: go to object mode, select everything, ctrl+A, apply everything. Then make sure any of your mirror effects still work because now the axis may have changed. Symmetrize works now.