Restore directory under ~/Library from TimeMachine
I found a kludge, which enabled me to restore the file, although I am not entirely comfortable with this.

I added ~/Library to the Sidebar, it then showed in TimeMachine.