controlling the ke yboard and mouse with gui au tom at ion knowing various python modules for editing spreadsheetsdownloading filesand launching programs is usefulbut sometimes there just aren' any modules for the applications you need to work with the ultimate tools for automating tasks on your computer are programs you write that directly control the keyboard and mouse these programs can control other applications by sending them virtual keystrokes and mouse clicksjust as if you were sitting at your computer and interacting with the applications yourself this technique is known as graphical user interface automationor gui automation for short with gui automationyour programs can do anything that human user sitting at the computer can doexcept spill coffee on the keyboard think of gui automation as programming robotic arm you can program the robotic arm to type at your keyboard and move your mouse for you this technique is particularly useful for tasks that involve lot of mindless clicking or filling out of forms