Is it possible to reduce the number of capacitors in the ft232h recommended configuration?
Trust me, a datasheet configuration doesn't guarantee good operation. You may find that you'll need more, not less, capacitors in various places - the layout is said to contribute the equivalent of half of your BOM in unexpected parasitics and interactions.

I would suggest not deviating from the initial configuration on your first pass. You can always test removing some caps and if the performance is acceptable, leave them not populated in the final product.

Also, avoiding tantalum where practical is a good approach. Ceramics are safer if the board is handled and built properly (mechanical stress is their only real weakness).