Could I continue in my preferred field whilst working on a post-doc in a different field?
There are many whom I know have done their post-docs in a field far different from their primary area of research and work. I don't see this as a problem. Post-docs and PhD dissertation may also widely differ from person to person. I have not seen such a phenomenon affecting their career.