Why do rubber duck antennas have this metal part, while other antennas do not?
The cutaway picture looks like a coaxial sleeve antenna.  Section 3 in the linked reference discusses this type of antenna.
edit: also see figure a on page 11 (assymetrically-fed sleeve dipole)