What are the most usual Chinese terms for permanent markers vs. whiteboard markers
As others have mentioned, when you are using borrowed words you can sometimes get stuck with misunderstandings especially if you go to a market or book store to buy this item rather than going to a stationary or art store.

My suggestion is to take a glossy piece of cardboard and then ask for a 马克笔 (mǎkè bǐ).

If you are provided with what appears to be a whiteboard marker I would politely test it on the cardboard and if it is a white board marker I would say 我要擦不掉的那种. I think this should get you what you are after.

我要擦不掉的那种 (wǒ yào cā bú diào de nà zhǒng) = "I want the kind that cannot be wiped off"

我要 = I want

擦不掉 = cannot be wiped off

的那种 = the kind

This might also help if they show you a thin marker pen:

我要粗一点的 (wǒ yào cū yīdiǎn de) = I want a thicker one