Any process that stops, prevents, or reduces the frequency, rate or extent of phytoalexin metabolism, the chemical reactions and pathways involving phytoalexins.
negative regulation of phytoalexin metabolism