and if the prefect kept ignoring their requests , there could be serious risk of rioting with nefarious consequences for all , especially the welfare of the thousands of pilgrims now within the city walls .