Face perception models propose that different facial attributes are processed by anatomically distinct neural pathways that partially overlap. Whether these attributes interact functionally is an open question. Our goal was to determine if there are interactions between age and ethnicity processing and, if so, at what temporal epoch these interactions are evident. We monitored event-related potentials on electroencephalography while subjects categorized faces by age or ethnicity in two conditions: a baseline in which the other of these two properties not being categorized was held constant and an interference condition in which it also varied, as modelled after the Garner interference paradigm. We found that, when participants were categorizing faces by age, variations in ethnicity increased the amplitude of the right face-selective N170 component. When subjects were categorizing faces by ethnicity, variations in age did not alter the N170. We concluded that there is an asymmetric pattern of influence between age and ethnicity on early face-specific stages of visual processing, which has parallels with behavioural evidence of asymmetric interactions between identity and expression processing of faces.