title: Too many documents: an index cannot exceed 2147483519 but readers have total maxDoc=2147483531
body: <p>Looking for better solution to avoid lucene's hard limit on total doc's. Is there a way to increase the limit. </p>
  
  <p>We are running DSE Search on one of the Datacenter and we are hitting the lucene's hard limit on number of Documents. </p>
  
  <p><strong>Possible solutions thought were:</strong><br>
  1) Add new node, so data gets redistributed with new tokens and search can be functional. Not viable for this in our case as of now.<br>
  2) Decomission one of the node and rebuild the node by <strong>increase the num_token so that it can accomodate lucene docs in more number of partitions(**Its my assumption)</strong>.  </p>
  
  <p><strong>FYI:</strong> I know that DSE prefers single token for Search but my organisation is using virtual token system.</p>
  
  <p><strong>Below is the actual log from system log file.</strong></p>
  
  <pre><code> Caused by: org.apache.lucene.index.CorruptIndexException: Too many documents: an index cannot exceed 2147483519 but readers have total maxDoc=2147483531 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/data/cassandra/data/solr.data/keyspace.table_name/index/segments_2lj")))
  </code></pre>
  
  <p>Any suggestions appreciated.</p>