where -s j,t + C σ j,t (n s j,t ) -1 2 on the right-hand side corresponds to the standard form of the upper-confidence bound for the negative average score, where the first and second terms are often called the exploitation and exploration terms, respectively, with the balance being determined by the parameter C. Notably, the dependence of the second term on the number of node selections is simply assumed to be inversely proportional to the square root of the number of selections at node j. The variation of C is examined in the main text and the Supporting Information (Figure ). The TS policy is defined as follows: