9. A non-transitory computer-readable storage medium containing instructions, that when executed, control a computer system to be configured for: receiving a plurality of medical documents, the plurality of medical documents including a first set of medical documents in a first format and a second set of medical documents in a second format, wherein the first format is an image-based format and the second format is in a structured data format, and wherein the structured data format is in a non-image text data organized by fields and respective values; determining a schema, the schema including a plurality of categories determined based on an expected structural content in the first set of medical documents or second set of medical documents; determining indices from the plurality of categories to be used for tagging the first set of medical documents and the second set of medical documents when converted into the image-based format based on a review of an organizing principle to which a common set of descriptors can be identified to tag and organize images of the first set of medical documents and the second set of medical documents; converting the non-image text data of the second set of medical documents into images in the image-based format based on the determined indices, wherein the second format is removed in the conversion and content included in each image is determined based on the determined indices applying to the fields and respective values; indexing images of the first medical documents and the images of the second medical documents in the image-based format by associating the determined indices based on the schema with content determined from the first and second medical documents; and storing the images of the first set of medical documents and the images of the second set of medical documents in the image-based format with the indices to allow searching of both the first set of medical documents and the second set of medical documents together based on a search query.
9. A non-transitory computer-readable storage medium containing instructions, that when executed, control a computer system to be configured for: receiving a plurality of medical documents, the plurality of medical documents including a first set of medical documents in a first format and a second set of medical documents in a second format, wherein the first format is an image-based format and the second format is in a structured data format, and wherein the structured data format is in a non-image text data organized by fields and respective values; determining a schema, the schema including a plurality of categories determined based on an expected structural content in the first set of medical documents or second set of medical documents; determining indices from the plurality of categories to be used for tagging the first set of medical documents and the second set of medical documents when converted into the image-based format based on a review of an organizing principle to which a common set of descriptors can be identified to tag and organize images of the first set of medical documents and the second set of medical documents; converting the non-image text data of the second set of medical documents into images in the image-based format based on the determined indices, wherein the second format is removed in the conversion and content included in each image is determined based on the determined indices applying to the fields and respective values; indexing images of the first medical documents and the images of the second medical documents in the image-based format by associating the determined indices based on the schema with content determined from the first and second medical documents; and storing the images of the first set of medical documents and the images of the second set of medical documents in the image-based format with the indices to allow searching of both the first set of medical documents and the second set of medical documents together based on a search query. 10. The non-transitory computer-readable storage medium of claim 9 , further comprising: receiving the search query; and determining search results for the search query using the indices associated with the first set of medical documents and second set of medical documents, wherein the search results include a subset of medical documents from the first set of medical documents and second set of medical documents that are determined to match the search query.