Reward learning initialization. De Cao and Kipf report divergence when training with any reward contribution to the generator loss during the early epochs of training. In our initial studies we observed quite similar results (accompanied by strikingly poor validity scores). To overcome these issues we follow the lead of De Cao and Kipf and train the generator with no reward loss contribution for the first half of training.