does 4 amps make a big difference?
You may freely have batteries of the same voltage and chemistry connected in parallel, regardless of their capacities, and charge and discharge them as one.

However, there are several precautions to observe.

Lead acid batteries are not always the same 'chemistry' for charging. The two main types are wet cell, and sealed gel cell. With the former, you fully charge with a constant current, as you are able to top up the water lost. With the latter, you use a constant voltage, and at full charge the current falls low enough that the cell is able to recombine its gases internally to retain its water.

You will probably be lucky in that, as both batteries were from an emergency lighting system, they are overwhelmingly likely to both be gel cells, as emergency systems tend to float charge their batteries to keep them in readiness.

Assuming they are both the same type, then it's good to have them at the same voltage before you connect them.

Lead acid cells can support very high output currents, so it's essential to fuse protect the wiring from them. This really means one fuse per battery, which has the added advantage of protecting either battery from a short failure in the other.