Making a CNN for phoneme classification
Yes you can, a few years ago I made a simple CNN for a single Arabic phoneme classification. You can use spectogram or using MFCC / MFSC as features, as long all data has the same size (use padding or cropping if needed).

You may need RNN if you want to combine some phonemes to recognize a single word or longer.