New answers tagged


First of all, if we have a descent direction, we can always find a step size $\tau$ that is arbitrary small, such that "the sufficient descent criterion" is satisfied (see the Wikipedia article 'Backtracking line search'). This essentially rules out the infinite loop issue. For example, consider Armijo condition as "the sufficient descent ...

Top 50 recent answers are included