Williams was also an acclaimed translator, notably of Sophocles' Women of Trachis and Euripides' The Bacchae, as well as of the Polish poet Adam Zagajewski and the French poet Francis Ponge.
He also published several children's books.