3
$\begingroup$

Is it possible for an AI neural net to be able to modify its own parameters/hyperparameters and/or add new parameters/hyperparameters? If so, how has it been implemented? For example, to simulate a human mind, could the net utilize 3 basic emotional parameters before realizing it needs many more and subsequently creating them?

$\endgroup$
2
$\begingroup$

One can do whatever he likes.

If your algorithm allows richer structure modification than simply adjusting weights, then you can obtain a "net which alters itself", though this doesn't have any special/magical meaning.

Suppose for example that your net's inputs correspond to some properties of an image, and you have a " hidden node" whose input is the average pixel value. During training, you can see whether adding this node lowers your training error, and if so, add it. One can claim that the net magically realized that it needs to use the average pixel value, but this is merely a direct result of your learning algorithm definition.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.