Walton was born to Thomas Gibson Walton and Nancy Lee Walton . He was part of the Walton family , which is one of the richest families in the world . Walton decided to concentrate on the retail business instead of the shopping centers and opened larger stores which were called `` Walton 's Family Center . ''