title: How to get real time log analysis
body: <p>My application constructs a lot of logs every day.  I used to use crontab and some Java application to store these data into MySQL. Otherwise I have a manage system , and its functions mainly based on the analysis of these data in MySQL. My application is not running on a single web-app server. So it is not a good way to analyze data based on the log files directly. But as the log file is bigger and bigger, it's a long time for crontab to store log files completely, I cannot have a real time analysis. So what optimization can be done to get a real time analysis?</p>