In people with asthma who are allergic to mold, breathing in spores can also cause asthma attacks. In addition to people with allergies and asthma, others who may be more sensitive to the effects of mold include: Infants and children. The elderly.