Is it wrong to consider an allosteric inhibitor a non-competitive inhibitor?
No, you cannot assume that an allosteric inhibitor is non-competitive. "Allosteric" refers to the location of binding, whereas terms like competitive, non-competitive, uncompetitive, or mixed inhibition refer to how (or if) the binding of the inhibitor affects binding with the substrate.

The Wikipedia page on competitive inhibition is a reasonable source for this question.

A competitive inhibitor is one that prevents binding of the normal substrate(s) at the active site. It is possible to achieve this either by literally getting in the way by binding in the active site or by binding elsewhere, causing a conformational change that prevents binding the active site. Both cases are considered competitive inhibition because of how they influence substrate binding.