Field is not removed from 'field_config_instance'
If you've got a fair amount of data, you'll need to allow cron to run a few times, or else do a larger batch purge

field_purge_batch(10)

Will only delete 10 records.


  $batch_size: The maximum number of field data records to purge before
  returning.