Any process that stops, prevents, or reduces the frequency, rate or extent of the chemical reactions and pathways resulting in the formation of proteins by the translation of mRNA in a mitochondrion.
negative regulation of mitochondrial protein synthesis