Officers received a report of an attack on a woman, 19, at Gorsedd Gardens near Cardiff Civic Centre at 04:30 BST on Thursday.
Police said the man, 23, from Cardiff, had been arrested on suspicion of sexual assault.
He has been taken to Cardiff Bay police station.
A man has been arrested in connection with an alleged sex attack at gardens in Cardiff city centre.