Reactivity of boron towards acids
To illustrate Oscar's answer further, it should be noted that boron, despite existing in more than ten allotropic modifications, is in general quite chemically inert (especially in crystalline form).

For example, boron doesn't react with hydrogen directly and all boranes are synthesized by other means.
Although boron may be oxidized by fluorine at room temperature, other halogens (even chlorine) require elevated temperatures above $\pu{400 °C}$:

$$\ce{2 B(s) + 3 E2(g) -&gt; 2 BE3}\qquad(\pu{30 °C}: \ce{E} = \ce{F}; \quad\text{above}~\pu{400 °C}: \ce{E} = \ce{Cl}, \ce{Br}, \ce{I})$$

There is no preference in reactivity towards acids or bases either.
Boron indeed doesn't appreciably react either with non-oxidizing acids or with alkali solutions under ambient conditions.

However, concentrated oxidizing acids such as nitric and sulfuric acids as well as aqua regia react all right — especially at elevated temperatures — yielding boric acid:

$$\ce{B(s) + 3 HNO3(aq) -&gt;[Δ] B(OH)3(aq) + 3 NO2(g)}$$

Amorphous boron reacts with concentrated alkali solutions:

$$\ce{2 B (am) + 2 NaOH (conc) + 6 H2O(l) -&gt; 2 Na[B(OH)4](aq) + 3 H2(g)}$$

When fused in air with alkali, $\ce{Na2O2}$ or $\ce{KNO3}$ + $\ce{Na2CO3}$ mix, borates are formed:

$$\ce{4 B(s) + 4 NaOH(s) + 3 O2(g) -&gt;[\pu{350-400 °C}] 4 NaBO2(s) + 2 H2O(g)}$$

All chemical reactions have been adapted from [1, p. 74].

References


R. A. Lidin, V. A. Molochko, and L. L. Andreeva, Reactivity of Inorganic Substances, 3rd ed.; Khimia: Moscow, 2000. (in Russian)