(CNN) -- The man closest to Tiger Woods when he plays golf says he had no idea about the extramarital affairs that have sidelined Woods from the game. 

Steve Williams, Woods' caddy and confidant for nearly a decade, talked to New Zealand's TV3 about the scandal. 

"I knew nothing," Williams said in an interview posted on the station's Web site Thursday. "I don't need to clarify it, extend that answer. I knew nothing." 

Williams said he's heard the calls from some that he should be fired for not preventing Woods' downfall. "In some people's perception, I'm involved with it, and I've committed a crime or done wrong," he said. 

"If the shoe was on somebody else, I would say the same thing, it would be very difficult for the caddy not to know," he said. "But I'm 100 percent telling you, I knew nothing, and that's that." 

Williams' wife, Kirsty, defended her husband, insisting he would not have been able to keep the secret from her or Woods' wife, Elin Nordegren. 

"The four of us are so close," she told TV3. "Being so close, he couldn't know and not say something to Elin or myself. You know, it's just, that's the way it is." 

Woods, 34, apologized last month in a tightly controlled televised statement for his "irresponsible and selfish" behavior, which he said included infidelity. 

The February 19 statement was his first public appearance since he crashed his black Cadillac Escalade into a fire hydrant and a tree near his home in November. The crash and reports about why it happened sparked a barrage of infidelity allegations against the golfer, who has two children with his wife. 
And who spoke to TV3?
Elin Nordegren