Rewire attic fan from switched to always-on
Supply that fan switch you say is fitted for code purposes from the supply to the light switch, it will then be on all the time depending on its thermostat setting.

Leave the other light switches as is.