 This phase II trial studies how well erlotinib hydrochloride and bevacizumab work in treating patients with stage IV breast cancer. Erlotinib hydrochloride may stop the growth of tumor cells by blocking some of the enzymes needed for cell growth. Monoclonal antibodies, such as bevacizumab, may interfere with the ability of tumor cells to grow and spread. Giving erlotinib hydrochloride and bevacizumab may be an effective treatment for breast cancer. 