title: making elasticsearch and bigquery work together
body: <p>I have a web app that displays the analysis data in browser with elasticsearch as backend data store.</p>
  
  <p>Everything was cool as elasticsearch was handling about 1TB data and search queries were blazing fast.</p>
  
  <p>Then came the decision to add data from all services into the app, close to a peta byte, and we switched to bigquery.[yes, we abandoned the elasticsearch and started querying bigquery directly ].</p>
  
  <p>Now users of my app are complaining that their queries are slow, they are taking seconds (4~10~15), which used to display under a second before.</p>
  
  <p>Naturally the huge amount of data here is to be blamed but I am wondering if there is a way to bring back elasticsearch into the game and make elasticsearch and bigquery play together nicely so that I can get the petaytes of storage from bigquery but still retain the lightspeed search of elasticsearch.</p>
  
  <p>I am sure I am not the first one to face this issue rather I believe I am bit late to the bigquery party so I should be able to reap the benefits of delayed entry by getting all the problems already solved.</p>
  
  <p>Thanks in advance if you can point me to the right direction.</p>