 This pilot clinical trial studies the side effects and how well durvalumab and tremelimumab work in treating patients with microsatellite stable colorectal cancer that has spread to the liver. Monoclonal antibodies, such as durvalumab and tremelimumab, may interfere with the ability of tumor cells to grow and spread. 