Both terms refer to treatments, like herbs or acupuncture that are out of the medical mainstream. But complementary medicine is when these therapies are used along with traditional Western medicine. Alternative medicine is when these approaches are used instead of traditional medicine.