For male mistress, the more general term "lover" can be used, but it does not carry the same implications.
In 18th and 19th-century Italy, the terms cicisbeo and cavalier servente were used to describe a man who was the professed gallant and lover of a married woman.