Kittens will nurse on the mother cat or a bottle with kitten milk replacer for five to 10 minutes or until they are full. Newborn kittens will generally nurse until they are four weeks old. Learn more about nursing kittens from a veterinarian in this free video on kitten care.