What is meant by 'simultaneously computing' all partial derivatives of an arithmetic circuit?
The new circuit will have multiple output gates, each one computing a different partial derivative. See for example Definition 2.1 and the ensuing proof in lecture notes of Wigderson.