FontAwesome character added via CSS only appears when logged in
Is it possible that your CSS rule is in the CSS for your administrative theme (by default "Seven"), but not in the theme for your public (non-logged-in) users (by default "Bartik")? 

If so, you need to copy this CSS fragment into the public theme too.