What is the relationship between formal automata and the different types of neural networks? What kind of neural network would you need to be able to parse context-sensitive languages, for instance?
-
$\begingroup$ Parsing any formal language would require a neural network able to accept an input of unbounded size, such as an RNN. $\endgroup$– Yuval FilmusApr 20 at 20:13