What does this piece do that came with my disc brake?
These things are called tightening plates or lock washers. Your suggestion was righ in where it goes, here's an exploded diagram and installed photo: