#value or #default_value missing from field in $form array
See Why is hook_form_alter() so messy? for a bit of background, but basically you need to drill further down into the array.

Assuming it's a standard text field you would set, for example, the default value like so:

$form['field_name'][LANGUAGE_NONE][0]['value']['#default_value'] = 'foo';