Suggestions on how to fill gaps at all of my windows
Most of these types of windows rely on weather seals that look like brushes and they do ok when new but compress and leak after a few years.
Without replacing those brushes on the sashes you have 2 choices.
Either use the weather seal rope caulk which can be removed without damaging the window or use the heat shrink plastic window covers.