He was born in Ely Place, Holborn in London, the son of the eminent architect, Sir Charles Barry and Sarah Rowsell, and had four brothers; Charles Barry (junior), Edward Middleton Barry, John Wolfe-Barry and Godfrey Barry.
hiː wʌz bˈɔːɹn ɪn ˈiːli plˈeɪs, hˈɑːlbɔːɹn ɪn lˈʌndən, ðə sˈʌn ʌvðɪ ˈɛmɪnənt ˈɑːɹkɪtˌɛkt, sˌɜː tʃˈɑːɹlz bˈæɹi ænd sˈɛɹɚ ɹˈoʊzl, ænd hæd fˈoːɹ bɹˈʌðɚz; tʃˈɑːɹlz bˈæɹi dʒˈuːnjɚ, ˈɛdwɚd mˈɪdəltən bˈæɹi, dʒˈɑːn wˈʊlfbˈæɹi ænd ɡˈɑːdfɹi bˈæɹi.