Mousekeys with External Keyboard
Thanks 13ruce1337, KeyRemap4MacBook did the job and I get to use hjkl!

The description of cmd + S + D and then holding S + D sounds very awkward in words but in practice it feels reasonable if you just want to click a single item. "High Speed Mode" is a nice convenience.