The coconut flavor comes from the coconut cream between the layers of the cake . Coconut cream is made from the liquid that is on the surface of coconut milk . While some recipes do not call for coconut flavor in the cake itself , there are others that replace the milk with coconut milk and\/or use coconut extract .