Pretty sure Imu stated in Egghead arc that those who inherit the will of D are natural enemies of the World nobles, basically those living in Marie Jois so I really don’t think your theory that Roger might have been a holy knight adds up