Method 1 of 3: Getting Rid of Flies with Home Remedies. 1. Set a trap with dish soap. Pour 1 inch (2.54 cm) of liquid dish soap into a jar and add 1 inch (2.54 cm) of water. The flies will be attracted to the soap and drown in the water. 1  Use fruit flavored dish soap for best results.2  An apple scented soap or lemon soap may provide better results, for example.3  Add a drop or two of apple cider vinegar if you do not seem to be catching many flies.4  The vinegar will attract flies to the jar.. Mix a natural fly repellent in a spray bottle. Flies will stay away from the scent of cayenne pepper. Mix a little in a spray bottle with water. 1  Spray the cayenne mixture in doorways, window sills and other cracks and corners where flies might try to come in.