Lecture 11.1: convergence with the A-W LS, theory
Completion requirements
The gradient method with A-W LS, efficiency estimates: basically the same as for the quadratic case, for good reasons ... but you need strong convexity. MATLAB implementation of the gradient method for nonlinear functions. Computing the derivatives and why this is not a problem: besides symbolic computation you can use Automatic Differentiation tools.