Add a field to a global set
See here for how to add a field to a user's field layout.

Users, Globals, Tags, Categories, etc. are all elements in Craft so they behave very similarly.

You can also check out Craft's own InstallService's private _createDefaultContent() method for examples on how Craft creates the default content on a fresh install of Craft.