The Dueling Bandit variant was introduced by Yue et al. (2012) [REF] to model the exploration-versus-exploitation tradeoff for relative feedback.
More recently, researchers have generalized algorithms from traditional MAB to dueling bandits: Relative Upper Confidence Bounds (RUCB),[REF] Relative EXponential weighing (REX3),[REF] Copeland Confidence Bounds (CCB),[REF] Relative Minimum Empirical Divergence (RMED),[REF] and Double Thompson Sampling (DTS) [REF].