In Fiesler (1994) Neural Network Classification and Formalization, he talks a lot about a more general version of neural networks, one that is not ordered into layers, but rather the network is called slabbed and the "layers" are instead called clusters. Unlike for feed-forward networks, slabbed networks may be cyclical and terminate when a stable state has been reached, rather than when propagation has reached output neurons.
Much of this paper is outdated (terminology in particular). Is this an outdated concept or are these types of networks being used and/or researched?
Also from this paper, he mentions "clamping functions", but I am not sure what he means. Here is an excerpt where he talks about clamping functions:
"clamping functions, which determine if and when certain neurons will be insusceptible to incoming information, that is, they retain their present activation value independent of external stimuli"
I have seen a few more recent uses of "clamping" in literature, but they tend to be referring to something different. What exactly is he talking about here and is there a modern name for this?
Similarly, he refers to ontogenic functions and ontogenic networks, which I believe we call dynamic networks, but what is the ontogenic function? I understand it dictates how the network changes, but mathematically what are the inputs and outputs? What triggers the change to start and/or stop?
I am very interested in this formal definition of neural network as a mathematical object (this tuple with topology, interconnection structure, transition functions and intial state), does anyone know of a source that gives a similarly rigorous definition of a neural network, but with more modern terminology and ideology (I imagine some developments in theory may have allowed for networks to be more general)?