Charging Lithium ion battery with a modified charger
The original charger had only 4.2V which leaves no room for a charger driver

This means the charger had the charging logic inside.

A diode is still conducting a small current even under it's forward voltage.

You better use a dedicated module like this one that can be modified for 500mA, using a diode will overcharge or even destroy your battery