Software recommendation for FAST entry of equations
On Windows, there is the Math-o-mir software. It should be able to provide all you asked for (rapid math typing, keyboard and mouse entry, basic CAS), but it requires some learning time to achieve speeds comparable to pencil-and-paper.