Learning comparisons
The classical solution is to try a one-class SVM applied only to the elements ranked above the others - you can read some papers about it looking by SVM rank or SVM ranking that will show you why that works.