How can I make a fieldgroup visible only to admin users?
You are probably using 1.x version of field_group module (which is the recommended version).

This problem has been solved (for most cases) in this issue. You could try the 2.x-dev version or use a simple JQuery script to remove the empty elements.