Born in Louisville, Kentucky, Browning was the youngest of eight children.
He displayed considerable athletic prowess from an early age, and in 1877 began playing for a local semipro team, the Louisville Eclipse, and pitched an exhibition win against a National League team.