title: Performance Issue: rejected execution of org.elasticsearch.ingest.PipelineExecutionSService
body: <p>I've struggled to transfer 500 Million documents, which are shipped from Windows IIS logs, from kafka to elasticsearch. At the beginning of shipping process, Everything is good. </p>
  
  <p>From Kafka-manager dashboard, I could see the speed of document out/bytes is about 1 million per minutes. </p>
  
  <p>After one week, The speed of out/bytes is decreased to 200K per minutes. I thought that it has some problem. As I opened elasticsearch log file, I could see numerous of ERRORs. </p>
  
  <p>Error is the below statement. </p>
  
  <blockquote>
    <p>[ERROR][o.e.a.b.TransportBulkAction] [***-node-2] failed to execute
    pipeline for a bulk request org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: rejected execution of org.elasticsearch.ingest.PipelineExecutionSService$..... on EsThreadPoolExecutor </p>
  </blockquote>
  
  <p>At the first time, I thought it was a problem of thread pool deficiency..
  But tuning write thread pool is not strongly recommended by elasticsearch forum.</p>
  
  <p>At the second time, it came from ingest-geoip because error statement said that "ingest.PipelineExecution....", So i simplified geoip filter in my logstash configuration. that is, turn off geoip.</p>
  
  <p>Also, Tried to reduce the number of pipeline worker, and the number of batch size in logstash config. </p>
  
  <p>Everything'd failed... There is no hope for overcoming this error.</p>
  
  <p>Help Genius!</p>
  
  <p><a href="https://i.stack.imgur.com/Gjy5s.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/Gjy5s.png" alt="enter image description here"></a></p>