Any process that decreases the rate, frequency or extent of the enlargement or overgrowth of all or part of the heart due to an increase in size (not length) of individual cardiac muscle fibers, without cell division.
negative regulation of cardiac muscle hypertrophy