How to manage very large amount of data in mysql I have a table in MySQL in which I write logs of users in a specified format. It have just 2 columns:id (auto-increment), log. Currently data is very less, so I'm using this.

Now there is a requirement which involves insertion of very large amount of data, (may be 60-70x of current), that may even involve concurrent insertion of even approx 2000 record. It will obviously slow down our system, and cant be used in production environment. Moreover database size will become an issue.

I need some ideas that will serve my purpose.
Use a "staging table".  Insert the unprocessed data into a separate table, then remove it when processed.

How big will the table eventually become?  A million row -- no problem.  A billion rows -- let's discuss more details.

For really high speed ingestion, see my blog.