ATmega 328p Using crystal with fuses set to "ceramic resonator"
The start-up time may not be sufficient for the crystal oscillator to get moving. 

Usually the settings for crystal oscillators will work okay with the more forgiving ceramic resonators, but the reverse is not true. The datasheet warns in particular about using the shortest start-up time with crystals at all, or the medium start-up time with crystals that are close to the maximum frequency for the chip.