Charging li-ion cell using constant-voltage
You should use a module like tp4056. This can charge li-ion and li-poly with an auto-cut mechanism. This is the safest way to charge a battery. You can easily get them at any store.
The thing is constant high voltage can damage your battery after some months of usage. So you have to increase the voltage in steps.