Non-random access on a fastq file
You don't have a RAM problem because you only have about:


  10-20 reads that I want to access from each file.


Please go for (2). If you are concerned about RAM usage, you may selectively write some of your data back to disk.

Tens of thousands of 10-20 reads is not a problem for modern computing.