phan age ▁moved ▁several ▁times ▁in ▁Manh attan . ▁▁ 1 8 6 3 ▁ri ots ▁ ▁In ▁March ▁ 1 8 6 3 , ▁cons cription ▁in ▁the ▁United ▁States ▁became ▁str ic ter , ▁and ▁the ▁federal ▁government ▁used ▁a ▁lot tery ▁system ▁to ▁choose ▁citizens ▁for ▁the ▁draft . ▁ ▁Those ▁chosen ▁could ▁h ire ▁a ▁substitute ▁or ▁pay ▁the ▁government , ▁but ▁most ▁working - class ▁men ▁could ▁not ▁afford ▁substitution , ▁while ▁black ▁men ▁were ▁in el ig ible ▁for ▁the ▁draft ▁( they ▁were ▁not ▁considered ▁citizens ▁of ▁the ▁United ▁States ▁at ▁the ▁time ). ▁ ▁Working - class ▁white ▁males , ▁fur ious ▁about ▁the ▁federal ▁draft ▁laws , ▁ri oted ▁and ▁attacked ▁federal ▁buildings ▁and ▁black ▁neighborhood s . ▁ ▁The ▁Col ored ▁Or phan ▁As yl um ▁was ▁burn ed ▁down ▁by ▁Irish ▁mob s ▁on ▁July ▁ 1 3 , ▁ 1 8 6 3 , ▁during ▁the ▁first ▁day ▁of ▁the ▁New ▁York ▁D raft ▁Ri ots . ▁ ▁A ▁polic eman ▁was ▁killed ▁while ▁leading ▁the ▁children ▁out ▁the ▁back ▁door ▁to ▁escape . ▁ ▁Reb u ild ing ▁The ▁as yl um ▁was ▁re built ▁by ▁the ▁Qu akers ▁in ▁ 1 8 6 7 ▁on ▁ 1 4 3 rd ▁Street ▁and ▁Amsterdam ▁Avenue . ▁The ▁operation ▁moved ▁to ▁a ▁new ▁building ▁in ▁ 1 9 0 7 , ▁in ▁River dale , ▁Bron x . ▁▁ ▁At ▁the ▁new ▁site , ▁the ▁or phan age ▁adopted ▁a ▁new