Despite his merits, Caesarius was not appointed to higher offices in the following years, when Rufinus was in power as magister officiorum and praetorian prefect of the East.
After Rufinus had been killed in November 395, Caesarius succeeded him as praetorian prefect of the East.