Suppose that something is wrong with its configuration (ie topology), for example there are too few neurons in a certain layer, or not enough layers.

I have an intuition that some neurons' "delta" ($\Delta$) values will be fluctuating wildly without settling down to fixed values. Is this a justifiable belief?

  • 1
    $\begingroup$ Why don't you try it out and see what happens? $\endgroup$ – Yuval Filmus Oct 17 '15 at 19:13
  • $\begingroup$ Yes, I'm about to, just wondering if there're some existing literature exploring with this aspect... :) $\endgroup$ – Yan King Yin Oct 18 '15 at 1:44

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.