Kumquats came from China ( they are known in literature of the 12th century ) , and have long been cultivated there and in Japan . The earliest historical reference to kumquats appears in literature of China in the 12th century . They have long been cultivated in Japan , Taiwan , the Philippines and southeast Asia .