Single Cell Battery Protection ICs
The BQ24075 does not offer any feature to prevent the cell from
  over-discharging though.
  
  After reviewing the datasheet for the BQ24075, it does mention a
  typical UVLO of 3.3V. Seems awfully high when the cell can go down to
  2.5V


You may be confusing the protection on the INPUT voltage pins with battery voltages.  

You also seem confused on the cutoff.  A battery charger is going to try and charge a dead battery so there is no low battery voltage cutoff. 

The only battery voltage a charger must know is the max charge voltage.  

You may be thinking of low battery indication.  Some chargers have a LBO that can be used to shut down or reduce the load.  The BQ24075 is a basic no frills charger targeted at small devices where real estate is at a premium.  Features take pins and consequently, real estate.  If you want a more full featured charger look at the MCP73871 

BTW: Just because the cutoff is 2.5V does not mean you should allow the battery to discharge that low.  I would not discharge below 3V.  Discharging below 2.8V can damage the battery.