Rumors have existed since the 1960s that Monroe had affairs with Robert Kennedy or John Kennedy , or both . Monroe reportedly had affairs with both President John F. Kennedy and his brother Senator Robert Kennedy .