1. A method for deploying a document classification system comprising: deploying a document classification system with a first classification engine configuration, including generating a plurality of classifications with which a document is associated and ranking the classifications based on a probability of correctness for each of the classifications; automatically redeploying the document classification system with a second classification engine configuration in response to a cost function based on a user preference regarding one or more cost factors selected from a throughput-performance cost factor indicating a number of documents processed by the document classification system in a given amount of time, a minimum distance cost factor indicating a minimum distance that a document classification is from the classified document's assigned class, a severity of errors cost factor indicating a severity of an error made in classifying and indexing a document, a licensing cost factor indicating a licensing cost for using a classification engine, a differential training cost factor indicating a particular type of ground truth document being analyzed, a retraining cost factor indicating retraining of the document classification system based on additional documents added to a set of ground truth documents, and a system resource cost factor indicating a relative amount of resources available for document classification on a front end of the document classification system and document indexing on a back end of the system.