The rest of the universe would have to be empty, because if there are any other objects in the universe at a temperature above absolute zero, the momentum carried by their black body radiation will slow the orbiting object.