In 1869/1870, Alexei had an affair with Alexandra Zhukovskaya, daughter of poet Vasily Andreyevich Zhukovsky, who was eight years older than he was.
Upset by his son's affair, Alexander II even refused to grant Alexandra Zhukovskaya a title, which would have officially recognized the Grand Duke's paternity, even if illegitimate.