I understand the basic operation of the algorithms however i'm unclear as to when to use one over the other and what advantages/disadvantages they offer over each other.

Also as an aside, if anyone knows any good resources that go over the topic of optimization in detail (especially gradient free optimization) that I could read or watch, i'd really appreciate it if you could point me in the right direction.

Thanks in advance guys and apologies if its a basic question, I'm quite new to the topic.

  • $\begingroup$ I would say that problems for which you can reliably use the derivative tend to be easier. So always use that if you can and only go with derivative-free methods if you must. $\endgroup$ – Juho Aug 8 '19 at 17:36

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.