The "H" in the name of Hungary (and Latin Hungaria) is most likely due to early historical associations with the Huns, who had settled Hungary prior to the Avars.
The Hungarian endonym is Magyarország, composed of magyar ('Hungarian') and ország ('country').