We begin by describing the user study design adopted here, and then follow by providing details on the neural network methodology applied to ranking compounds based on implicit user feedback. We finally describe the active learning strategy applied over the different rounds of the study and briefly showcase the developed platform for data collection.