title: How to get the time needed for decompressing large bz2 files?
body: <p>I need to process large bz2 files (~6G) using Python, by decompressing it line-by-line, using <code>BZ2File.readline()</code>. The problem is that I want to know how much time is needed for processing the whole file.</p>
  
  <p>I did a lot searches, tried to get the actual size of decompressed file, so that I can know the percentage processed on-the-fly, and hence the time remaining, while the finding is that it seems impossible to know the decompressed file size without decompressing it first (<a href="https://stackoverflow.com/a/12647847/7876675">https://stackoverflow.com/a/12647847/7876675</a>).</p>
  
  <p>Besides that decompressing the file takes loads of memory, decompressing takes a lot of time itself. So, can anybody help me to get the remaining processing time on-the-fly?</p>