Gastrointestinal stromal tumors (GIST) have a variety of appearances and can present as an intraluminal, extraluminal, solid or ulcerated mass. We present an unusual case of a patient presenting with pain, elevated white count, and computed topography (CT) findings suggesting an abscess containing bone. CT guided drainage was performed, and resulted in bowel perforation, leading to surgical intervention and the diagnosis of an ulcerated gastrointestinal stromal tumor containing bone.