Yasujirō suffered a case of cerebral anemia on 23 April 1964, and died peacefully at home on 26 April 1964, of a cerebral hemorrhage at the age of 75.
Following his death, the empire was formally divided between Seiji and his younger half-brother Yoshiaki; Seiji receiving the retail portion and Yoshiaki taking the commercial portion.