Using li-ion battery in place of a lead acid one in a desk lamp
No, it is not fine.  Lithium batteries have different charge profiles, and must be managed more closely than the relatively forgiving lead-acid batteries.  Doing this could result in dead battery, or even fire.  And, you don't even seem to know the nominal voltage of the lead-acid battery.

All around BAD IDEA