12. A computer implemented method for improving indexing throughput, the computer implemented method comprising: receiving one or more documents for indexing; based on a document type, a document size and a processing priority, categorizing the one or more documents; assigning buckets to the categorized one or more documents according to the document type, the document size and the processing priority; calculating a document type priority for the document type of the one or more documents in the assigned buckets, wherein the document type priority is calculated as a function of an extraction efficiency for extracting content from the one or more documents for the corresponding document type; and based on the calculated document type priority, a bucket type and number of threads available to process the buckets, scheduling the buckets for indexing process.
13. The computer implemented method of claim 12 , wherein categorizing the one or more documents based on the document type comprises calculating a small document limit for the document type.