Could an artificial neural network algorithm be expressed in terms of map-reduce operations? I am also interested more generally in methods of parallelization as applied to ANNs and their application to cloud computing.

I would think one approach would involve running a full ANN on each node and somehow integrating the results in order to treat the grid like a single entity (in terms of input/output and machine learning characteristics.) I would be curious even in this case what such an integrating strategy might look like.


Yes it can, and has been. In the paper Map-Reduce for Machine Learning on Multicore they discuss using the Map-Reduce paradigm for several common ML algorithms including ANNs.

  • $\begingroup$ Thanks! +1 and accepted -- this paper is a great resource. $\endgroup$ Jun 28 '12 at 0:44
  • $\begingroup$ The link now 404s :( $\endgroup$ Aug 27 '15 at 0:27
  • $\begingroup$ @JosephWeissman link should work now. $\endgroup$
    – alto
    Aug 31 '15 at 17:52

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.