Does the choice of error function impact the model parametrs?
Yes, it will impact because when you change the loss function, the numerical value of the loss function will change. So, this will change gradient values of the parameters during the back propagation. Therefore, change in loss function will impact the parameters.