He was born in Baghdad, (some say in 1902 - although his true birth year isn't known for sure), then part of the Ottoman Turkish vilayets, to Rabbi Katchouri Diba ben Aziza, who was a spice trader.
As a youngster, Kaduri excelled in his studies and began learning Kabbalah while still in his teens, a study that would last his entire life.