Scare Them Off To keep the birds away entirely, you might need to actively chase them off. ... For a little extra deterrence, set up a few decoys of birds of prey, such as hawks and owls. These can help discourage new swallows from investigating the area. Eventually, however, the swallows will realize the birds are decoys.