Voltage rating and tantalum capacitors
4&nbsp;V tantalum capacitors will be just fine, but personally I love the ceramic ones so much. Also, each µF of a ceramic capacitor is "better" than a tantalum one due to lower ESR.

So before going for tantalum, I would check the price of ceramic capacitors with a better dielectric which still gives you 4.7&nbsp;µF at 85&nbsp;°C (185&nbsp;°F).

You should check your LDO specification on ESR limits. Some might oscillate with too-low ESR. And if it's stable with a 1&nbsp;µF ceramic one at 85&nbsp;°C - I would personally stay with ceramic. Just more reliability.