Babies are born with a piece of cartilage in their knee joint which forms during the embryonic stage of fetal development. So yes, babies do have kneecaps made of cartilage. These cartilaginous kneecaps will eventually harden into the bony kneecaps that we have as adults.