EMI Filter for Buck Converter
Are you really sure you did the computation correctly?
In equation (5) Cfb can be negative only if is negative either of

Lf : negative inductor? no, check
The thing after that? no, it's squared so it can't, check

Given that there are no complex numbers in that formula I don't get how you can get a negative value