It seems to me that genetic algorithms would be an ideal way to train neural networks so that they come to have the right weights, since they are especially good at escaping local minima, and converging on a global optimum. However, from my rudimentary knowledge of neural nets so far, I haven't come across this method in any tutorial video. Are there inherent challenges that make GA's unsuitable for this purpose? Or is there a better way to accomplish the same thing?
There have been hundreds of papers published over the years on training neural networks with GAs. Here's a starting point Neuroevolution.
The basic problem though is that stochastic gradient descent works really well in vastly less computation time.