what does `a factor of K-fold` mean in GPU-based training?
The author here refers to a comparison between older and most recent implementations of deep learning algorithms regarding execution time (accelerating processing speed). It just means that "they used GPUs and achieved x40 better execution time". It has nothing to do with K-Folds.