When I edit a display within a view, it changes other displays too
Never mind! I figured it out... Each display was still overriding the others, but I found where to change that and everything is good!

For anyone else with the same question: 
When you click on a filter criteria, you can select options in the drop down at the top of this overlay which specifies whether you would like to apply the changes to all displays or just this page.