Remove the "Change keyboard" button in lollipop The button interferes with typing. My hand accidentally hits the button constantly prompting a pop up. Very annoying. 

The button is in the lower right corner:
It should only show up if you have more than 1 keyboard active. Deactivate one or more keyboards.