Augusta, New Jersey. Augusta is an unincorporated community located within Frankford Township, in Sussex County, New Jersey, United States. As of the 2010 United States Census, the population for the ZIP Code Tabulation Area 07822 was 887. Augusta is the home of the New Jersey State Fair and the Sussex County Farm and Horse Show.