In most cases, the answer is no.. Hearing loss may occur at birth, or as the baby grows. The following are reasons that may cause a baby to have a hearing loss at the time of birth or as the baby grows: 1  Low Apgar score – a score of 0-4.  Low birth weight – weighing less than 1,500 grams or 3.3 lbs at birth.