1. A method, in a data processing system, for managing a multi-tenant software application adapted to serve a plurality of tenants, the method comprising: receiving a deletion request for deleting one of the tenants from the plurality of tenants, responsive to receiving the deletion request, disabling an instance of the software application associated with the tenant to be deleted, deleting the disabled instance of the software application associated with the tenant to be deleted after a protection period from the deletion request, receiving an addition request for adding a new tenant to the software application, and allocating an instance of the software application for the new tenant to a selected instance of the software application, the selected instance being selected between one of a set of one or more available instances of the software application and a new instance of the software application according to an indication of the number of the tenants allocated to each available instance of the software application reduced according to the number of the disabled tenants thereof.