Because cod liver oil contains quite a bit of vitamins D and A, it is also possible that side effects can occur due to toxicities from either of these vitamins. There is some concern that long-term use of cod liver oil could increase the risk of skin cancer.