Fragment-based models are known to provide complementary approaches to periodic calculations, which can be essential when the computational cost of hybrid functionals or post-Hartree Fock, wavefunction methods become computationally unfeasible, and GGA methods are not sufficiently accurate. This work has demonstrated an approach to rapidly improve anisotropic, atomic multipole-based force field lattice energies by correcting two-body interactions to a quantum chemical level of theory, and the application of this approach to structure prediction of organic molecular crystals. By replacing significant force field twobody interactions with PBE-D3, B3LYP-D3, or MP2 dimer interaction energies, without further geometry optimization, we observe improvements to the ranking of experimentally known crystal structures within the sets of predicted structures in almost all cases, and good ranking of experimental structures is maintained in cases where the force field performs well. The results are systematically improved from GGA to hybrid functional, and the largest improvements observed when MP2 is used for the dimer energy corrections. The MP2 fragment-corrected model also provides polymorph lattice energy differences that are in excellent agreement with experimental measurements, and with the results of fully periodic, dispersion-corrected DFT methods. Thus, the QM fragment-correct force field lattice energy models will increase our confidence in the energetic ordering of predicted crystal structures, which will improve the reliability of crystal structure prediction methods in applications such as pharmaceutical polymorph screening and computer-guided materials discovery. Furthermore, the approach is generalizable to any quantum chemical method, such as higher level correlated wavefunction methods and larger basis sets, potentially offering further improvements than those demonstrated here.