What is a GP? A GP is a stochastic process that treats the value of the objective function at any given point in feature space, f (x), as a random variable. Specifically, GPs assume the joint distribution of any finite collection of function values, say at points {x 1 , x 2 , ..., x m } on its domain, follows a multi-