Why is this NOT joseki?
I don't think it's that the joseki move is forcing, it's more that the joseki move is better.  5 here is pretty sad for White.  For 4 to be joseki, you would need a response to this move that turns out better than the accepted sequence for White.

$$ ----------
$$ ..........|
$$ ..........|
$$ ..3.2.....|
$$ ..54..1...|
$$ ..........|