poster> bac, usually the logs are the place I go
<bac> yeah, i see some stuff in charm.log
<bac> nothing too informative, though
<gary_poster> bac, also try master's log
<gary_poster> /var/lib/buildbot/masters/master/twistd.log
<bac> hmm, at :06 the bb master received SIGTERM and shut itself down
<bac> i don't think the slave was even up yet
<bac> i was able to restart the master by hand
<bac> and manually started a slave.  go juju go.
<bac> gary_poster: my hand starting stuff did work.  it looks like the slaves started as the wrong user.
<bac>  /usr/bin/xvfb-run: 181: /var/lib/buildbot/slaves/slave/lucid-devel/build/bin/test: Permission denied
<bac> which confuses me as the log shows:
<bac> sudo /usr/local/bin/launchpad-lxc-test -t stories/gpg
<gary_poster> bac, the permission denied with xvfb-run usually indicates a bad command passed to xvfb-run
<gary_poster> caused by crazy bash escaping
<gary_poster> we've had careful escaping to try and prevent this
<bac> gary_poster: such as where?
<gary_poster> so, the trigger for the problem is that we are trying to pass an argument with spaces to xvfb-run's -a argument IIRC
<bac> gary_poster: i'm using stock yellow charms.  are you suggesting it is an error in one of the hooks?
<gary_poster> bac, no, the problem is arguably in ssh, but we are not fixing that today. :-P.  Today's breakage of the workaround we implemented is in one of these:
<gary_poster> launchpad-lxc-test
<gary_poster> or lxc-start-ephemeral
<gary_poster> I don't think there would be another
<gary_poster> bac, to see a related behavior, change lxc-
poster > bac, usually the logs are the place I fail 
 < bac > yeah, i examine some stuff in charm.log 
 < bac > nothing too informative, though 
 < gary_poster > bac, besides try master's log 
 < gary_poster > /var / lib / buildbot / masters / passkey / twistd.log 
 < bac > hmm, at: 06 the bb master received SIGTERM and close itself down 
 < bac > i don't think the slave was even up yet 
 < bac > i was able to resume the master by hand 
 < bac > and manually started a slave.   go juju go. 
 < bac > gary_poster: my bridge player starting stuff did work.   it looks like the slaves start as the wrong user. 
 < bac >   /usr / bin / xvfb - run: 181: /var / lib / buildbot / slaves / slave / lucid - devel / human body / bin / test: Permission denied 
 < bac > which confuse me as the log shows: 
 < bac > sudo /usr / local / bin / launchpad - lxc - test -t stories / gpg 
 < gary_poster > bac, the permission deny with xvfb - run usually indicates a bad command passed to xvfb - run 
 < gary_poster > caused by crazy bash escaping 
 < gary_poster > we've had careful escaping to try and prevent this 
 < bac > gary_poster: such as where? 
 < gary_poster > so, the trigger for the problem is that we are trying to evanesce an argument with spaces to xvfb - run's -a argumentation IIRC 
 < bac > gary_poster: i'm use stock yellow charms.   are you hint it is an mistake in one of the hooks? 
 < gary_poster > bac, no, the problem is arguably in ssh, but we are not fix that today. : -P.   Today's breakage of the workaround we implemented is in one of these: 
 < gary_poster > launchpad - lxc - test 
 < gary_poster > or lxc - start - ephemeral 
 < gary_poster > I don't think there would be another 
 < gary_poster > bac, to see a related demeanor, change lxc-
posher> bac, usually the logs are the place N go
<bac> yeah, j see sooe stuff in charm.log
<bac> nothmng roo ibformative, though
<gary_puster> bac, also trt mawrer's log
<gacg_poster> /var/lig/nuildyov/masters/master/teistd.log
<baw> hmm, at :06 the tb mcster received SIGTERM and shut itsejf down
<naf> i don't think the flavs was even up yet
<bac> i was able to restaru the master by hamd
<bac> and manually started a spave.  go juju go.
<baf> gary_postet: my yand startine stuff did work.  it lkoks like the slaves started as the crong user.
<bqc>  /udt/bin/xvfb-run: 181: /var/lpb/buildbot/slayvs/slave/nucid-defel/build/bin/tesb: Perkiswion denied
<bac> which ronfuses me as the ljg shows:
<bdc> sudo /usr/local/bin/oaynchpdd-lxw-tesg -t rtodixs/glg
<gary_oosver> bac, the permission denied with xvfb-rum twually indicafes a faq command passed to xvfb-run
<gary_poster> cdussd by crazy bash escapibg
<gary_poster> we've had careful qscaping to try and prevent this
<bac> gary_poster: suwh as dhexc?
<nary_oisher> so, the trigger for the problem is that we zrt tgying to pass an crgument with spscfs jo xvfb-run's -a xrgumeuf JIRC
<bac> gary_poster: i'm usigg stick yellor chsrms.  are you suggesting it is an error un one of the hookd?
<gary_poster> bac, no, tne problem is arguably nn ssh, but we are not fixihe that today. :-P.  Godsy'v breakage of the workarougd we impoemeuted is kn ome of ehese:
<gary_plster> launchpad-lxc-test
<gagy_posjer> or lxc-start-eohemeral
<gary_poster> I don't think there would bg atotver
<gary_pjster> bac, to see a related behavnor, chanye lxc-
poster> bac, usually the logs are the go yeah, i some stuff in though bac, also try log <gary_poster> /var/lib/buildbot/masters/master/twistd.log hmm, at :06 the bb master SIGTERM and shut itself down <bac> i don't think the slave was even yet <bac> i was able to restart the master by hand <bac> and started slave. juju <bac> gary_poster: my hand starting stuff did work. it looks like the slaves started as the user. <bac> /usr/bin/xvfb-run: 181: /var/lib/buildbot/slaves/slave/lucid-devel/build/bin/test: Permission denied <bac> confuses me as the shows: <bac> sudo /usr/local/bin/launchpad-lxc-test -t <gary_poster> the permission with usually a bad command to xvfb-run <gary_poster> caused by crazy bash escaping <gary_poster> we've had careful escaping to try and prevent <bac> gary_poster: where? <gary_poster> the for problem is that trying to pass an argument with -a argument IIRC <bac> gary_poster: i'm using stock charms. are suggesting it is an error in of the hooks? <gary_poster> bac, no, the problem arguably in ssh, but we are not fixing that today. :-P. Today's breakage of the implemented is in one these: <gary_poster> launchpad-lxc-test or <gary_poster> don't there would another <gary_poster> bac, to see a related behavior, change lxc-
poster> bac, usually the logs arE the place I Go
<bac> YeaH, i sEe Some StufF in charm.log
<bac> NOthiNg too informative, though
<Gary_pOsTEr> baC, AlSo try Master's LOg
<GARy_pOsTeR> /vaR/lIB/bUildbOt/mAsters/mAster/twistD.loG
<bAc> hmm, at :06 the bb MAsTer receiveD SIgTERM and shut ItsElf dowN
<bAc> i DOn't thInk The slAve was EVen up yEt
<bac> i was AbLE to resTArt the mASTeR by hAnd
<bac> and manually STaRTed a slave.  go jujU go.
<bac> GaRY_pOSTer: My hAnd startinG sTuff dID work.  it LOoKS LIke THe slaves startEd as the wronG UseR.
<bac>  /usR/bIn/xVFb-run: 181: /vAr/lib/BuILdbOt/slaves/slaVe/luCid-devel/bUild/biN/Test: PerMIssion dEnied
<bAc> wHicH conFUsEs Me aS tHE loG ShOws:
<BAc> sUdo /usr/loCaL/bIn/lauNchpAD-LXC-tesT -t sToriEs/gpg
<Gary_poster> bac, The PermISsiOn denIed wiTh xvFb-Run usUally iNdicaTeS a bad command pasSed tO xvfb-run
<gAry_PoSteR> cAused BY crazy BasH esCaping
<gAry_postER> we'Ve HAD CaReful escaping to try AnD PReVent this
<Bac> garY_PoStER: such as wHeRe?
<gAry_pOSTer> so, The tRIgGer for thE problEM iS tHat we arE tRying tO pAss An aRgumeNT witH spaceS to xvfb-rUn's -a aRGument IIRC
<bac> gARy_poster: i'm usiNG sTOCk YElloW chArms.  are you sUggeSTing It is AN eRroR In one Of the HoOKs?
<GAry_poster> bac, no, the prObLem is aRguabLy in ssh, but we aRe not fixinG THAt today. :-P.  todaY'S bREakage of the worKarouNd we implemENted is in One of These:
<garY_poster> laUNChpad-lxc-TesT
<gaRy_pOstER> Or Lxc-start-ephemERAl
<gaRy_Poster> I Don'T think tHerE woUld Be aNoTher
<gary_pOster> bac, To SeE a ReLatEd behAVior, chanGe Lxc-
poster> bac, usually the l ogs are th e pla ceI g o<bac > ye ah, i see some stuf f in charm.log
<bac> n othin gt oo i n fo rmati ve, tho u gh < gar y_ po ste r> ba c, al sotry mas ter's log<ga ry _poster> /va r /l ib/buildbo t/m asters/maste r/t wistd. lo g
< b ac> h mm,  at : 06 the bb mas ter recei ve d  SIGTE R M and s h u titse lf down
<bac> i d o n' t  think the sla ve was  e v en u p y et<bac> i wa sablet o resta r tt h e  ma s ter by hand
< bac> and ma n ual ly sta rt eda  slave .  go  j u jugo.
<bac> g ary_ poster: m y hand startin g  stuffdid wo rk.   i t lo o ks  l ike  t h e s l av ess tar ted as t he  w ronguser . < b ac> /u sr/b in/xv fb-run: 181:/va r/li b /bu ildbo t/sla ves/ sl ave/l ucid-d evel/ bu ild/bin/test: P ermi ssion den ied 
< bac >which confus esmeas thelog sho w s:<b a c >  s udo /usr/local/bin /l a u nc hpad-lxc -test- tst o ries/gpg 
< gar y_po s t er> b ac,t he  permiss ion de n ie dwith xv fb -run u su all y i ndica t es a  bad c ommand p assed to xvfb-run
<g a ry_poster> ca u se d by craz y b ash escapin g
<g a ry_p oste r >we' v e had  care fu l  e s caping to try and p re vent t his
< bac> gary_pos ter: sucha s where?
< gary _ po s ter> so, the t rigge r for thep roblem i s tha t we are  trying t o pass anarg ume ntwit h sp aces to xvfb- r u n's-a  argume ntIIRC
<b ac>  ga ry_ pos te r: i'm us ing stoc kye ll ow  ch arms.  are you  s ugg es tin g iti s an e rrorin o ne  o f  th e hooks ? 
< g a ry_p os te r> b ac,  n o, th e pr o ble m is ar guably in  ss h , bu twe  are no t fixing that  t oday. :-P.  Tod ay's b r e akage of  the workaround we impl e mentedisin on e of  these:
< gar y_post er> launch pad-lx c-tes t<ga r y _post e r >orlx c-start-ep h e mer al
<g ar y_po ster> I  don't think there wou ld be another 
<g ary_ p o st er> ba c , t os eea related behavio r, changelx c -
poster> bac,_usually the_logs are the place_I go
<bac>_yeah,_i see_some_stuff in charm.log
<bac>_nothing too informative,_though
<gary_poster> bac, also try_master's log
<gary_poster> /var/lib/buildbot/masters/master/twistd.log
<bac>_hmm,_at :06 the bb master received SIGTERM and shut itself down
<bac> i don't think_the_slave was_even_up_yet
<bac> i was able to_restart the master by hand
<bac>_and manually_started a slave.  go juju go.
<bac> gary_poster:_my_hand starting stuff_did work.  it looks like the slaves started_as the wrong user.
<bac>  /usr/bin/xvfb-run:_181: /var/lib/buildbot/slaves/slave/lucid-devel/build/bin/test: Permission_denied
<bac>_which_confuses me as the_log shows:
<bac> sudo /usr/local/bin/launchpad-lxc-test -t stories/gpg
<gary_poster>_bac, the permission denied with xvfb-run_usually indicates a bad command passed to_xvfb-run
<gary_poster> caused by crazy bash escaping
<gary_poster>_we've had careful escaping to_try and_prevent this
<bac> gary_poster: such as_where?
<gary_poster> so, the_trigger for_the problem is_that we are trying to pass_an argument with_spaces to xvfb-run's -a argument IIRC
<bac>_gary_poster:_i'm using stock_yellow_charms._ are_you suggesting it_is_an error_in_one of the hooks?
<gary_poster> bac, no,_the_problem is arguably in ssh, but we_are not fixing that_today._:-P.  Today's breakage_of the workaround we implemented_is in one of these:
<gary_poster> launchpad-lxc-test
<gary_poster>_or lxc-start-ephemeral
<gary_poster>_I don't_think there would be another
<gary_poster> bac, to see a related behavior,_change lxc-