 Gausta was born on the Gausta farm in Mæl parish in the municipality of Tinn in Telemark county, Norway.In 1867, Gausta immigrated to America with his parents and four sisters, settling on a farm near Harmony, Minnesota.Gausta entered a training program for parochial school teachers at Luther College in 1872.