I have about 100GB of data saved in ~10MB .csv files. How can I optimize lookup speed for several thousand queries to this data? Specifically, I don't know what technologies to consider or how to estimate relative performance.

Each file is unique to a date, and contains data for multiple people, for example:

```
...
2005-07-03, "Daffy Duck", ...
2005-07-03, "Daffy Duck", ...
2005-07-03, "Mickey Mouse", ...
2005-07-03, "Mickey Mouse", ...
...

```

I want to pull all of the info corresponding with a given date/name, for several thousand date/name pairs. The equivalent SQL query would be `SELECT * FROM myDB WHERE Date='2005-07-03' AND Name='Mickey Mouse'`.

Currently I haven't loaded the data into a database. To execute my "queries", I locate the appropriate date file and filter the lines by the name I am looking for. Would I get performance improvements storing the data in a relational database, noSQL database, or in any other way? If so why and by how much?