Born in Provence, France, the son of a Marseille jeweller, Joseph showed musical talent as a youngster and in 1913 was sent to Paris, with silver flute in hand, to further his studies.
At the outbreak of the First World War in 1914, Joseph and his brother joined the army.