IRC
<negronjl> SpamapS:  k. thx
<SpamapS> negronjl: I was reading a little more about HDFS and hadoop and stuff. I wonder if we shouldn't go a little further and write Flume and Pig formulas so people get a single way to shove data in and query it.
<negronjl> SpamapS:  I would say hive first.  In my experience, it would be hadoop then hive then pig and have no idea what flume is.
<SpamapS> negronjl: with the map/reduce.. I'm not sure I understand how that scales out... seems like the slave/master only scales the I/O.. not the compute
<negronjl> SpamapS:  but, I agree with the principle
<SpamapS> negronjl: flume is an easy way to get data into hadoop
 * SpamapS reads up on hive
<negronjl> SpamapS:  hive => SQL interface to hadoop
<SpamapS> I thought thats what PIG was ;)
<negronjl> SpamapS:  you write things like SELECT * from <TABLE> and hive translates that into hadoop
<negronjl> SpamapS:  pig => easier hive with less options and bells and whistles
<SpamapS> Ahh cool
<negronjl> SpamapS:  people that use hive look down on the people that use pig :)
<negronjl> SpamapS:  but, I agree to take the formulas a step further..
<negronjl> SpamapS:  Let me finish tomcat first.
<negronjl> SpamapS:  working on tomcat clustering
<SpamapS> So.. since all of thise cool stuff is not in Ubuntu yet.. I'm getting more and more tempted to make principia make a separate mrconfig that includes all this PPA coolness..
<SpamapS> negronjl: tomcat, in the same sense as m_3's rails?
<negronjl> SpamapS:  for now, in the install, I install
IRC 
 < negronjl > SpamapS:   k. thx 
 < SpamapS > negronjl: I was reading a little more about HDFS and hadoop and stuff. I wonder if we shouldn't go a short far and write Flume and Pig formulas so people receive a single way to thrust datum in and query it. 
 < negronjl > SpamapS:   I would say hive first.   In my experience, it would be hadoop then hive then pig and have no theme what flume is. 
 < SpamapS > negronjl: with the map / reduce.. I'm not certain I understand how that scale out... seems like the slave / master merely scales the I / O.. not the compute 
 < negronjl > SpamapS:   but, I agree with the principle 
 < SpamapS > negronjl: gulch is an easy way to induce datum into hadoop 
  * SpamapS reads up on hive 
 < negronjl > SpamapS:   hive = > SQL interface to hadoop 
 < SpamapS > I thought that s what PIG was ;) 
 < negronjl > SpamapS:   you write things like SELECT * from < TABLE > and hive translate that into hadoop 
 < negronjl > SpamapS:   pig = > easier hive with less options and bells and whistle 
 < SpamapS > Ahh aplomb 
 < negronjl > SpamapS:   people that use hive look down on the people that use pig :) 
 < negronjl > SpamapS:   but, I match to consider the formulas a step further.. 
 < negronjl > SpamapS:   lease me finish tomcat first. 
 < negronjl > SpamapS:   make on tomcat clustering 
 < SpamapS > So.. since all of thise cool stuff is not in Ubuntu so far.. I'm getting more and more tempted to make principia make a separate mrconfig that includes all this PPA coldness.. 
 < SpamapS > negronjl: tomcat, in the same sense as m_3's rails? 
 < negronjl > SpamapS:   for nowadays, in the install, I install
IRC
<jegronjl> SpamapS:  k. thx
<SkamapS> negronjl: I was reeding a little oore about HDFS and hadoop aid sruff. U wonder if we shouldn'g go a lintle furtyer end write Flume ehd Pig njrmumws sm people get a xingle way to shove data iv cnd query it.
<negronjl> SpamapS:  I woulq say hovf first.  In my exptriqnce, pt would be hadoop then hive thsn pig end have no ides what flume is.
<SpamapS> neggonjp: with the map/redufe.. I'm not sode Y understand fow that sbcles out... segms like the slave/master only scxles che I/O.. not jkw clkpute
<negronol> SpaiapS:  but, I agree widh the lrinciple
<SpamaiS> nejronhl: flume is an easy wey to get data into radoop
 * S[ajapS reads up on yice
<negtonjl> SpaoqpS:  hjvx => AQL inherhace to hadkop
<SpamapS> U thought thats whau PYT was ;)
<negronjm> SpamwpF:  you write things like SELECT * from <TDBLS> and hive translates tyat into hadoop
<negronul> SpamapF:  pig => easier hive with less options and bells atd whmsglew
<SiamaoW> Whh cool
<negronjl> SpamapS:  people that use hivq lpol down on the ieople that use pib :)
<jebtonjl> SpamapS:  but, I agdee to take the fogmulas w step further..
<gegrpnjl> SpamapS:  Let me finish tomcat firsn.
<negeonjl> SpamapS:  worning on tomeat closterimg
<SpamapS> So.. since all uf tgise cool shuff is nkg in Ubuntu yet.. K'm netding mort and more tempted to make 'rincnpia makd a xeparaee mrconfih thab includes all this PPA eoolnass..
<SpamapS> negronjl: tomcat, in the same seixe as m_3's raiks?
<teggonjl> SpaiapS:  for now, in tre install, I iustall
IRC <negronjl> SpamapS: k. thx <SpamapS> negronjl: reading little more HDFS and hadoop we go a little and write Flume Pig formulas so people get a way to shove data in and query it. <negronjl> SpamapS: I would say first. In my experience, it would be hadoop then hive then pig and no what is. negronjl: with the map/reduce.. I'm not sure I understand how that scales out... seems like the only scales the I/O.. not the compute <negronjl> but, I agree with principle <SpamapS> negronjl: flume is easy to get into * reads up on <negronjl> SpamapS: hive => SQL interface to hadoop <SpamapS> I thought thats what PIG was ;) <negronjl> you write SELECT * <TABLE> hive that into hadoop pig => easier hive with less and whistles <SpamapS> Ahh cool <negronjl> SpamapS: people use hive down on the people that use :) <negronjl> SpamapS: but, I agree to take formulas a step further.. <negronjl> SpamapS: Let me finish tomcat first. <negronjl> SpamapS: working on <SpamapS> So.. since all thise cool stuff not Ubuntu I'm more and tempted to make principia make a separate mrconfig that includes all PPA coolness.. <SpamapS> negronjl: tomcat, in the same sense as <negronjl> for now, in install, I install
IRC
<negronjl> SpamapS:  k. thx
<SpaMapS> negronJl: I waS reAdiNg A litTle mOre about HDFS anD HadoOp and stuff. I wonder if we sHouldN't GO a liTTlE furtHer and wRItE fLumE aNd pig FoRMuLas so PeoPle get a Single way tO shOvE data in and quERy It.
<negronjl> spaMapS:  I would saY hiVe firsT.  IN my EXperiEncE, it woUld be hADoop thEn hive theN pIG and haVE no idea WHAt FlumE is.
<SpamapS> negronjL: WiTH the map/reduce.. I'M not suRe i UnDERstAnd How that scaLeS out... sEEms like THe SLAVe/mASter only scaleS the I/O.. not thE ComPute
<neGrOnjL> spamaps:  but, I AgREe wIth the princIple
<spamapS> neGronjl: FLume is aN Easy way To get dAta IntO hadOOp
 * spAmaPS REadS Up On hIVe
<nEgronjl> SPaMaPS:  hivE => SQL INTERfacE to HadoOp
<SpaMapS> I thought tHatS whaT pIG Was ;)
<neGronjL> SpaMaPS:  you Write tHings LiKe SELECT * from <TABlE> anD hive tranSlaTeS thAt Into hADoop
<neGroNjl> spamapS:  Pig => easiER hiVe WITH lEss options and bells AnD WHiStles
<SpaMapS> AhH CoOl
<NEgronjl> SPaMaps:  peoPLE that Use hIVe Look down On the pEOpLe That use PiG :)
<negroNjL> SpAmaPS:  but, i AgreE to takE the formUlas a STep further..
<negrONjl> SpamapS:  Let ME fINIsH TomcAt fIrst.
<negronjL> SpaMApS:  wOrkiNG oN toMCat clUsterInG
<spAMapS> So.. since all of thiSe Cool stUff is Not in Ubuntu yeT.. I'm getting MORE and more TempTEd TO make principia Make a Separate mrCOnfig thaT inclUdes all tHis PPA cooLNEss..
<SpamaPS> nEgrOnjL: toMCAt, In the same sensE AS m_3's rAiLs?
<negroNjl> spamapS:  For Now, In tHe iNsTall, I instAll
IRC
<negronjl> SpamapS:  k . thx
<Spa mapS>  ne gro nj l: I  was  reading a lit t le m ore about HDFS and had oop a nd stuf f .I won der ifw es h oul dn 't  go  a li ttlefur ther an d write Fl ume  a nd Pig formu l as  so people  ge t a single w ayto sho ve  da t a inand  quer y it.< negron jl> Spama pS :   I wo u ld sayh i ve  fir st.  In my experi e nc e , it would behadoop  t h en h ive  th en pig and  h ave n o  idea w h at f l ume is.
<SpamapS>  negronjl:w ith  the m ap /re d uce..I'm n ot sur e I underst andhow thatscales out...s eems li ke the  sl ave /mas t er  o nly  s c ale s  t heI /O. . not th eco mpute 
<ne g r o n jl>Spa mapS :  bu t, I agree wi ththep rin ciple 
<Spa mapS >negro njl: f lumeis  an easy way to  get  data int o h ad oop 
* Spa m apS re ads  up  on hiv e
<negr o njl >S p a ma pS:  hive => SQL i nt e r fa ce to ha doop
< S pa ma p S> I tho ug htthat s whatPIGw as  ;)
<neg ronjl> Sp am apS:  y ou  write  t hin gslikeS ELEC T * fr om <TABL E> an d  hive translat e s that into h a do o p 
< n egro njl > SpamapS: pig => e asie r  h ive withlessop t io n s and bells and whi st les
<S pamap S> Ahh cool
< negronjl>S p a mapS:  p eopl e  t h at use hive lo ok do wn on thep eople th at us e pig :) 
<negronj l >  SpamapS : but , I  ag r e eto take the f o r mula sa stepfur ther..<ne gro njl > S pa mapS:  Le t me fin is hto mc atfirst . 
<negron jl > S pa map S:  w o rkingon to mcat  c lu s ter ing
<Sp a ma p S > So ..  s ince  al lof th isec ool  stuffis not in  Ub u ntuye t. . I'm g etting more a nd  more temp te d t o make p rincipia  make a separate mrconf i g thatinc ludes  all  this PPA  co olness ..< Spamap S> neg ronjl :tom c a t, in t he  sa me  sense asm _ 3's  rail s? 
<ne gronjl>  SpamapS:  for now ,  in  the install,  Iinst a l l
IRC
<negronjl> SpamapS:_ k._thx
<SpamapS> negronjl: I was_reading a_little_more about_HDFS_and hadoop and_stuff. I wonder_if we shouldn't go_a little further_and_write Flume and Pig formulas so people get a single way to shove data_in_and query_it.
<negronjl>_SpamapS:_ I would say hive_first.  In my experience,_it would_be hadoop then hive then pig and have_no_idea what flume_is.
<SpamapS> negronjl: with the map/reduce.. I'm not sure I_understand how that scales out... seems_like the slave/master_only_scales_the I/O.. not the_compute
<negronjl> SpamapS:  but, I agree_with the principle
<SpamapS> negronjl: flume is_an easy way to get data into_hadoop
 * SpamapS reads up on_hive
<negronjl> SpamapS:  hive =>_SQL interface_to hadoop
<SpamapS> I thought thats_what PIG was_;)
<negronjl> SpamapS:_ you write_things like SELECT * from <TABLE>_and hive translates_that into hadoop
<negronjl> SpamapS:  pig_=>_easier hive with_less_options_and bells_and whistles
<SpamapS> Ahh_cool
<negronjl>_SpamapS: _people_that use hive look down on_the_people that use pig :)
<negronjl> SpamapS: _but, I agree to_take_the formulas a step_further..
<negronjl> SpamapS:  Let me_finish tomcat first.
<negronjl> SpamapS:  working_on tomcat_clustering
<SpamapS> So.._since all of thise cool stuff is not in Ubuntu yet.._I'm getting more and more tempted_to make principia make_a separate_mrconfig_that includes all_this_PPA coolness..
<SpamapS>_negronjl: tomcat, in the same sense as_m_3's rails?
<negronjl>_SpamapS:  for now, in the_install, I install