Does prolonged exposure to low pitch but low volume noise affect hearing or stress?
Basically you are asking: (1) does the low-pitch noise affect my hearing sensitivity; (2) has the noise aggravated hearing loss acquired earlier in life; (3) if the noise can induce stress and (4) if the noise may cause tinnitus (kind of a hidden question).

(1) Is the ventilator noise damaging?: Noise-induced hearing loss typically occurs at high sound levels. Occupational safe noise levels are set at around 85 dB SPL (Nat. Stand. Occupational Noise). This is comparable to listening to traffic on a busy road from 10 meters away for 8 hours/day for 5 days/week (see wiki on sound levels), or a diesel truck at 15 meters going 64 km/h. If you can still talk normally, the noise cannot be much more than 60 dB SPL, which is normal conversational level (see sound chart). So the ventilation noise is not bad for your ears as it is well below 85 dB SPL.

(2) Does the noise aggravates present damage?: Similarly to the answer under (1), the noise is not loud enough to be regarded damaging even with existing hearing loss.

(3) Does it cause stress? As @anongoodnurse suggested: yes it causes stress, apparently. Every unpleasant sensation will do so to a certain level.         

(4) Effects of the noise on tinnitus: Typically, tinnitus is caused by hearing loss (see cause of tinnitus) and the pitch of tinnitus often coincides with the lost frequencies (see cause and effect of tinnitus). So if your "bad behaviors" at youth refer to loud music, then it is probably noise-induced hearing loss that has resulted in a dip at your hearing acuity at 4 kHz (the 4-kHz notch). In effect, the tinnitus you are experiencing will be around this frequency and therefore high-pitched. As the loudness of the ventilator is too low to cause damage, it is probably unrelated to your tinnitus.