best way to log large amounts of data I'm building a new logging system for our company. I'm wondering about the best way to store about 50-100GB data each year.

I'm looking at both MySQL and MongoDB. I'm considering MongoDB because it looks easy to expand to lots of data and it works pretty fast. I'm considering MySQL because I've used it before.

We have a log database today in MySQL which uses InnoDB and foreign keys. It has over 200GB data. It's not working well and the database crashes whenever I try to remove anything from it. I'm not the one who built it, I'm just trying to fix the problem.

I hope people out there know a good way to log this amount of data. I just need a reliable way to store and a simple way to query. I'm open to other options.

The logs are generated on separate servers, gathered to a central log server and imported. I'm building an API to access them when we need to query them.
ELK Stack is a good choice, even though i use elastic search + gray log for logging purposes. Experience with elastic search, several hundreds of GB are not an issue, u can in any case, easily increase capacity adding new nodes to it.

Graylag has an API which you could use in any other app