Can a 2018 Mac mini support dual 4k monitors at 60 Hz?
Yes, the 2018 Mac Mini can support dual 4k monitors at 60 Hz connected the way you indicate. I have this setup myself. There are no caveats.

Note: You do not need an "adapter" as such. You just need ordinary, passive cables from Thunderbolt 3 to DisplayPort.