Can't understand a variable in the formula used to determine CDTY to set duty cycle of PWM on cortex M3 (SAM3X8E)
"fchannel_x_clock" is the frequency of the clock that you select when you program the PWM clock generator for that channel.

Take a look at section "38.6.1 - PWM Clock Generator" in that datasheet that you linked to.