Actinomyces Odontolyticus is a gram-positive bacillus, usually found in the oropharynx, gastrointestinal and urogenital tracts, as commensal flora. Infections caused by this organism are rare but may occur, more commonly in immunocompromised patients. We report a case of a 54-year-old man, who presented to the emergency department (ED), with fever and chills. The patient had undergone an implantable cardioverter defibrillator (ICD) insertion, 5 months prior to his arrival, and was diagnosed with Actinomyces Odontolyticus bacteremia, during the hospitalization. Transesophageal echocardiogram (TEE) revealed vegetations on the tricuspid valve and the ICD electrode. This is the first reported case of ICD related Actinomyces endocarditis and bacteremia based on our literature review. This case emphasizes the importance of probing for the source of actinomyces infection, while considering the indolent properties of the disease.