Williams, for part of his career, was managed by Frank "Blinky" Palermo, who later was suspected of having ties to organized crime. According to Williams, he was blackballed by the boxing managers guild when he sought to manage himself. Palermo informed him he could resolve his problems with the guild, and Williams agreed to let Palermo manage him. Williams testified before the Kefauver Commission that Palermo did not arrange for him to throw any fights, but that he shorted him his share of his purses. Nevertheless, Williams did claim to have taken a dive against Chuck Davey, a much hyped contender for the welterweight crown. Testifying before Congress, 1961 In 1961 Williams testified before Congress on antitrust in boxing. In his testimony, Williams stated that all boxers are asked to take bribes and that he was boycotted as a result of trying to manage himself. He explained that he could not get a fight because he did not use a manager and that he could not book a fight until he found a manager from the manager's guild. He explained that he did not receive his share of his purse in two fights which included Jesse Flores in Yankee Stadium, for the lightweight title on September 23, 1948 and Beau Jack at Shibe Park in Philadelphia, on July 12, 1948 and September 23, 1948. In those fights the money owed him was $32,500 and $32,400. He testified he told the boxing association to temporarily hold on to the money for these two fights for tax purposes. Later when he asked for his money, he discovered that his shares of the profits had been taken by his manager, who claimed to have fallen on hard times and spent it. Williams still had to pay the taxes on his share of the profits, though he never received them. He further testified that his manager was offered $30,000 for him to throw a championship fight against Freddy Dawson in Philadelphia on December 5, 1949, though he declined. He testified that ten minutes before the fight he heard the judges being told if he did not win by a knock out that the fight would go to Dawson. Williams won the fight and told the media afterwards that he had heard a rumor that the fight would be fixed to go to Dawson by decision of the judges if he did not win by