Can we use the recursive least squares as a learning algorithm to an ADALINE?
RLS is a second order optimizer, so, unlike LMS which takes into account an approximation of the derivative of the gradient, RLS also considers the second order derivative. You can study more about second order methods in sub-section &quot;8.6 Approximate Second-Order Methods&quot; of the following book available online:
https://www.deeplearningbook.org/contents/optimization.html
Deep Learning
An MIT Press book
Ian Goodfellow and Yoshua Bengio and Aaron Courville