title: 20 Billion Rows/Month - Hbase / Hive / Greenplum / What?
body: <p>I'd like to use your wisdom for picking up the right solution for a data-warehouse system.
  Here are some details to better understand the problem:</p>
  
  <p>Data is organized in a star schema structure with one BIG fact and ~15 dimensions. 
   <br />
  20B fact rows per month
   <br />
  10 dimensions with hundred rows (somewhat hierarchy)
   <br />
  5 dimensions  with thousands rows
   <br />
  2 dimensions with ~200K rows
   <br />
  2 big dimensions with 50M-100M rows</p>
  
  <p>Two typical queries run against this DB </p>
  
  <p><strong>Top members in dimq:</strong></p>
  
  <pre><code>select    top X dimq, count(id) 
  from      fact 
  where     dim1 = x and dim2 = y and dim3 = z 
  group by  dimq 
  order by  count(id) desc
  </code></pre>
  
  <p><strong>Measures against a tuple:</strong></p>
  
  <pre><code>select    count(distinct dis1), count (distinct dis2), count(dim1), count(dim2),...
  from      fact 
  where     dim1 = x and dim2 = y and dim3 = z 
  </code></pre>
  
  <p><strong>Questions:</strong></p>
  
  <ol>
  <li>What is the best platform to perform such queries 
  <br /></li>
  <li>What kind of hardware needed 
  <br /></li>
  <li><p>Where can it be hosted (EC2?)</p>
  
  <p><br />
  (please ignore importing and loading issues at the moment)
  <br /></p></li>
  </ol>
  
  <p>Tnx,
   <br />
  Haggai. <br /></p>