title: Eval after every train epoch
body: <p>Trying to get a workflow using tensorflow object detection API.</p>
  
  <p>I have created a tfrecords for my training set (4070 images) and my validation set (1080 images).</p>
  
  <p>Training goes for 400 iterations then switches to evaluation where it takes a quite a long time (about 10 minutes) then proceeds to repeat the evaluation for ever. I've been confused why I'm getting poor performance but it seems that I train for only 10mins despite running for 24hours.</p>
  
  <p>Eval config is</p>
  
  <pre><code>   eval_config {
    num_visualizations: 30
    num_examples: 30
    eval_interval_secs: 600
    max_evals: 1
    include_metrics_per_category: true
    batch_size: 1
  }
  eval_input_reader {
    label_map_path: "D:/src/Wind/WindObjectDetector/data/labels.pbtxt"
    shuffle: false
    num_epochs: 1
    num_readers: 1
    tf_record_input_reader {
      input_path: "D:/src/Wind/WindObjectDetector/data/val.record"
    }
    sample_1_of_n_examples: 1
  }
  </code></pre>
  
  <p>Training config:</p>
  
  <pre><code>train_config {
    batch_size: 8
    data_augmentation_options {
      random_horizontal_flip {
      }
    }
    data_augmentation_options {
      ssd_random_crop {
      }
    }
    optimizer {
      rms_prop_optimizer {
        learning_rate {
          exponential_decay_learning_rate {
            initial_learning_rate: 0.0010000000474974513
            decay_steps: 1017
            decay_factor: 0.949999988079071
          }
        }
        momentum_optimizer_value: 0.8999999761581421
        decay: 0.8999999761581421
        epsilon: 1.0
      }
    }
    fine_tune_checkpoint: "D:/src/Wind/WindObjectDetector/experiments/test2/tl/model.ckpt"
    from_detection_checkpoint: true
    num_steps: 25400
  }
  </code></pre>
  
  <p>What I really want is the workflow I had doing regular image classification and segmentation. That is, train for one epoch (num_images//batch_size iterations). Then evaluate on validation set for one epoch then repeat. So every loop I see every image once and evaluate on every (validation) image once. At this point I'd be happy to just have it train.</p>