It did not stop castle building at first . But by the 15th century , shots became powerful enough to break through stone walls . Although gunpowder was introduced to Europe in the 14th century , it did not significantly affect castle building until the 15th century , when artillery became powerful enough to break through stone walls .