Most / Least Educated Cities in GA. The average temperature of Ellijay is 58.65°F, which is lower than the Georgia average temperature of 62.30°F and is higher than the national average temperature of 54.45°F.