Python De-Linearize Colors
CoDEmanX's link had a way to fix this. It's more of a work around than a solution, but I can just change the display device in the "Scene" tab to None. This allows me to export the colors exactly as seen in Blender. It might mess up rendering a bit, but these are models for a game and in my case I don't need to render in Blender. One speed bump, though, is that any colors set before changing it will be messed up and will need to be corrected.