Fixed reindexing arith with duplicates
Closes https://github.com/pandas-dev/pandas/issues/35194

Still need to run ASV on this. This was a regression from 0.25.x to 1.0. It doesn't have to go in 1.1, but probably better for 1.1.0.rc0 than a 1.1.1 release.