title: How to get information out of the GUI in order to automate tasks with pyautogui
body: <p>I've been doing some simple automations with pyautogui, and one of the biggest challlenges I've found is that pyautogui is blind. It can't see what's going on in the GUI. I would like to extract some of this information so I could write more intelligent programs. I've been thinking in the possibility of taking an screenshot and comparing it with a few possible scenarios and taking decisions acording to that (But it seems a waste of resources). That is only an idea. 
  I would like to ask you if you know some simple way to make this kind of scripts "less blind". </p>