OS X's FileVault password screen extremely unresponsive
This is normal on FileVault enabled MacBook. There is about 10 seconds latency on my late 2013 rMBP. I suggest to wait a bit more time as the problem improved dramatically two weeks later after I turned it on.