What's the best way/tool to cut a strip of drywall out of my window boxes?
The right tool in this case is the good old fashioned razor knife.  (handle with a razor blade in it).  Like this:  

I suggest utilizing a strait edge to make sure you cut a good line.  I personally use my 4' aluminum level.