title: Importing and parsing a large CSV file with go and app engine's datastore
body: <p>Locally I am successfully able to (in a task):</p>
  
  <ul>
  <li>Open the csv</li>
  <li>Scan through each line (using Scanner.Scan)</li>
  <li>Map the parsed CSV line to my desired struct</li>
  <li>Save the struct to datastore</li>
  </ul>
  
  <p>I see that <a href="https://developers.google.com/appengine/docs/go/blobstore/reference#NewReader" rel="nofollow">blobstore has a reader</a> that would allow me to<a href="https://developers.google.com/appengine/docs/go/blobstore/" rel="nofollow"><code>read the value directly using a streaming file-like interface.</code></a> -- but that seems to have a limit of 32MB. I also see there's a bulk upload tool -- bulk_uploader.py -- but it won't do all the data-massaging I require and I'd like to limit writes (and really cost) of this bulk insert.</p>
  
  <p>How would one effectively read and parse a very large (500mb+) csv file without the benefit of reading from local storage?</p>