Network structure inspired by simplified models of biological neurons (brain cells). Neural networks are trained to "learn" by supervised and unsupervised techniques, and can be used to solve optimization problems, approximation problems, classify patterns, and combinations thereof.

learn more… | top users | synonyms (1)

0
votes
0answers
11 views

Which algorithms are suitable for detecting biological pattern formations?

I'm looking for approaches to automatic detection of biological pattern formations in digital images, similar to those displayed on this wikipedia page: Patterned vegetation The framework i'm working ...
1
vote
1answer
17 views

Differences between linear/nonlinear vs. deterministic/nondeterministic neural nets

When speaking of neural networks, I don't get the difference between nonlinear and non-deterministic. Basically, both say that the output of something is not directly correlated to the input? Hope ...
0
votes
0answers
13 views

Recommended reading to understand self programming computers and neural networks [on hold]

Here is a recent story about self programming software: http://observer.com/2014/10/googles-new-computer-with-human-like-learning-abilities-will-program-itself/ I have been reading a little about ...
-1
votes
2answers
49 views
+50

Different weight sets for same problem?

Considering the case that we have a fixed set of training examples and a fixed ANN (i.e same number of input,output and intermediate layers). Is it possible that there exists more than one set of ...
1
vote
0answers
11 views

Computer vision training procedures: SVM/AdaBoost vs Neural Networks

With SVM, adaboost or similar alogrithms, image training sets must be cropped with specific constraints (keep image cropping ratio the same, have object tightly cropped, same resolution) In general, ...
1
vote
1answer
19 views

Creating a single layer perceptron for the OR problem

I am working on the following problem Find the linear least squares unit weights for the `OR' problem, ie. $v_1^T = (0,0), v_2^T = (1,0), v_3^T = (0,1), v_4^T = (1,1)$ and $u_1 = 0, u_2 = u_3 = u_4 = ...
0
votes
1answer
33 views

Updating connections weights in neural networks

I am learning about neural networks and have a couple of things I don't understand. Firstly, in competitive learning I understand that only the neuron with the strongest output is reinforced. That is ...
2
votes
0answers
27 views

How to select topology for neural network?

I was given a target function to design a neural network and train: $y = (x_1 \wedge x_2) \vee (x_3 \wedge x_4)$ The number of inputs and outputs seems obvious (4 and 1). And the training data can ...
1
vote
0answers
22 views

weights in a simple neural network

I have seen that in the material made by Andrew Ng about neural networks, he uses the following weights: so when I replace the final values of h_theta(x) in the formula: I got values near 0 and ...
1
vote
0answers
27 views

Hessian-Free instead of LSTM for Recurrent Net Machine Translation

Last year, Ilya Sutskever and collaborators came out with a paper about a recurrent LSTM net that learns sequence to sequence mappings for machine translation. It's somewhat surprising that the ...
3
votes
1answer
162 views

Genetic Algorithm, Neural Network, Deep Learning, Machine Learning Similarities and Applications? [closed]

I am a computer engineering student and trying to get the idea behind all these Artificial Intelligence Concepts and applications. I know little theoretically about machine learning and some high ...
2
votes
2answers
123 views

ANN - Backpropagation with multiple output neurons

Can I utilize the backpropagation algorithm in a layered, feed-forward ANN in instances where there are multiple output neurons? If so, how? Links to (somewhat) comprehensible resources would be ...
1
vote
0answers
8 views

How do NEF networks differ from ANNs in applications?

As I've described here, the Neural Engineering Framework (NEF) has some functional similarities to Artificial Neural Networks (ANNs). Naturally, there is also an overlap in applications between ...
0
votes
0answers
15 views

Is current hardware adequate for neural networks ? Are there more adequate hardware?

If you have a large neural network and you use more than 10 cores, it will be limited by the fact each core will need to read/write data that it can't access fast enough. I've read about some samsung ...
1
vote
0answers
26 views

backpropagation algorithm seems to be forcing output values to middle than extremes

I have been playing around with artificial neural networks lately, specifically with the prospect of trying to replace the contrastive divergence algorithm with some type of evolutionary metaheuristic ...
3
votes
1answer
666 views

How does the momentum term for backpropagation algorithm work?

When updating the weights of a neural network using the backpropagation algorithm with a momentum term, should the learning rate be applied to the momentum term as well? Most of the information I ...
0
votes
1answer
24 views

ANN architectures that perform faster/efficient prediction over time?

ANN when compared to biological neural systems have this common concept of reducing error in prediction over time (training) and becoming more good at predicting correctly. But there is one behavior ...
5
votes
1answer
103 views

How exactly do you calculate the hidden layer gradients in the backpropagation algorithm?

I have been going through the description of the backpropagation algorithm found here. and I am having a bit of trouble getting my head around some of the linear algebra. Say I have a final output ...
0
votes
0answers
9 views

Can HTM CLA be applied to the problem of autonomous navigation of bots or drones?

See: http://numenta.org/resources/HTM_CorticalLearningAlgorithms.pdf Hierarchical Temporal Memory (HTM) is a detailed computational theory of the neocortex. At the core of HTM are time-based learning ...
1
vote
1answer
31 views

are the activations of hidden nodes in an ANN binary or real valued?

this may seem to be a pretty basic question, but it is something i have been puzzling over for some time. when calculating the activations of nodes in a hidden layer in an ANN using sigmoid neurons ...
0
votes
0answers
19 views

What math is required for machine learning, neural networks etc.? [duplicate]

I'm planning to start learning more in depth about neural networks and machine learning. Can someone tell me which math will I need the most, and also recommend me good books or internet lessons in ...
1
vote
1answer
37 views

Neural Network Weights per input nodes

Sorry, I'm really new to neural networks and this question is probably pretty obvious. If you have any resource that can help clarify these concepts to me it would be much appreciated. The way I ...
1
vote
0answers
95 views

Improving MSE as fitness function for a genetic algorithm

I am implementing an autoencoder neural network in matlab, the weights of which are being optimised by a genetic algorithm. At the moment I am working on the first layer, trying to get an improved ...
1
vote
0answers
67 views

Disadvantages to using simple step functions for activation in neural networks?

From what I have read, the main advantage to using tanh(x) or sigmoid(x) as an activation function for neural networks is that it is very easily differentiable. I am trying to implement a neural ...
0
votes
1answer
115 views

How to reconstruct the image from a neural network output?

I am trying to use the genetic algorithm to optimise a multi-layered neural network for image classification (i am using a subset of the MNIST handwritten digit data set as my initial dataset, but ...
2
votes
2answers
72 views

Is it possible to implement a Neural Network using a graph data structure?

I'm trying to implement a feedforward neural network using a graph. The thing is: I haven't found any example in which is used a graph data structure. So far the examples I've found used arrays. Can ...
2
votes
5answers
258 views

Machine Learning and Neural Networks for High School Students

I hope this question is appropriate for this forum. In this summer I am giving a 3-day workshop on machine learning and neural networks for advanced and very enthusiastic high school students which ...
1
vote
3answers
88 views

Are neural networks dynamical systems?

Dynamical systems are those whose evolution can be described by a rule, evolves with time and is deterministic. In this context can I say that Neural networks have a rule of evolution which is the ...
2
votes
1answer
52 views

Progressive discrete multifunction optimization

I have a set of functions $F$. The functions effectively take a set $S$ that is always a subset of a global set of all possible values $G$, where $|G|>1000$. (alternatively, they could take a ...
2
votes
1answer
58 views

Closed form solution for a single layer linear perceptron

Let f be a one-layer neural network which is linear (ie. no activation function). Let it have $p$ inputs and $q$ outputs. These are fully connected by weights $W$. We have $n$ inputs $x \in ...
0
votes
0answers
53 views

Where to start studying about HTM?

I am looking for references (pedagogic and beginner friendly!) to these two topics, hierarchical temporal memory algorithms applied to deep planning problems (multi-layer) neural networks trained ...
3
votes
1answer
33 views

Training given pairs of similar values, not labels

I have pairs of "similar" values $(x_i, y_i)$ drawn from a space $x_i, y_i \in S$, and want to train a neural network $N$ such that $N(x_i)$ would be "close" to $N(y_i)$ for all $i$, yet, to make it ...
1
vote
1answer
28 views

Matching training with Neural Network

I have a matching algorithm that is based on making an comparison score. This score is divided into parts. Example: 5 - Points for attributes (lets say they have 3 common attributes, would the score ...
-2
votes
1answer
62 views

Neural Network Design Challenge

i'm studying for PHD Entrance Exam on Stanford. one of previous material exam designed very challenging. i want to design a NN for classifying following 2-class problem. 1) output should be -1 or ...
2
votes
0answers
71 views

How can you use HMMs and ANNs for on-line handwriting recognition?

On-line handwriting recognition is the task of converting a series of $(x(t),y(t))$ coordinates to symbols and words. In contrast to off-line handwriting recognition, where you only have a bitmap of ...
0
votes
0answers
60 views

Backpropagation Through Time Recursive Algorithm

Would it be plausible to write a recursive version of backpropagation through time for recurrent neural network training? I've only found the iterative version: ...
4
votes
0answers
29 views

How to choose proper activation functions for hidden and output layers of a perceptron neural network?

As far as I know choosing an activation function for the input layer is relatively straightforward: I use Sigmoid if the input data domain is (0,1) and TANH if it is (-1,1). But what activation ...
2
votes
1answer
39 views

How do I “tell” a simple perceptron/adaline neural netrork its output can't be negative?

I have made and trained a simple neural network which now seems to produce outputs reasonable in all the aspects but one: it gives negative values from time to time even though the outputs are always ...
1
vote
2answers
87 views

How to determine if a state is a fixed point in a Hopfield network?

I have been reading a lot and I am still unsure of how to determine this. Let's say I have an initial binary state vector (1, 1, 1). How would I go about determining whether (1, 1, 1) is a fixed point ...
-3
votes
2answers
224 views

Perceptron learning rule for classification

That's the problem $$y=(x,w,\rho) = \begin{cases} 1 & \sum_{i=1}^3 w_ix_i >\rho\\ 0 & \text{otherwise} \end{cases},$$ where $x=\{x_1,x_2,x_3\}$ are inputs, $w=\{w_1,w_2,w_3\}$ are ...
1
vote
2answers
83 views

Perceptron learning rule doesn't work [closed]

i'm a little bit lost ... can you help me ? So I have this table of date (each row give a point with its group) So i took a random weight let's say : [1, -2] H = 1 if n =< 0 0 otherwise ...
1
vote
0answers
14 views

What types of images should I use for negative examples in a classification problem? [duplicate]

I am doing a project to recognize a kind of leaf using ANNs with Emgu CV in C#. My project is to get frames from camera then present them to the ANN and have the ANN tell me if that frame contain a ...
1
vote
1answer
94 views

What are good counter-examples when training an apple classifier? [closed]

I am doing a project in order to recognize an apple. (I am using Emgucv with Visual Studio 2010 C#, if that's relevant). My project is a classification (is or is not an apple). I have 2000 images of ...
4
votes
2answers
55 views

How can an artificial neural net change the sign of a weight?

My neural net is having trouble switching the sign of a weight. The issue is that the deltas applied to the weight are proportional to that weight, so when it gets closer to zero, the deltas become ...
2
votes
2answers
72 views

What kind of model is used by 20 Questions?

Which kind of machine learning concept / model is used in 20 Questions? Is this kind of thing best solved by a neural network? Where I can read something about it?
2
votes
1answer
59 views

Neural network: noisy temporal sequence converter (transducer?producer?) on demand?

I start to suspect this problem is very hard now that I cannot find a single relevant literature on the subject, but it's too late to change the class project topics now, so I hope any pointers to a ...
3
votes
1answer
277 views

Does there exist a data compression algorithm that uses a large dataset distributed with the encoder/decoder?

If my goal were to compress say 10,000 images and I could include a dictionary or some sort of common database that the compressed data for each image would reference, could I use a large dictionary ...
1
vote
1answer
45 views

What's the purpose of the “o(1-o)” in the back propagation algorithm

I'm not sure what the purpose of the o(1-o) in the back propagation algorithm achieves? I'm guessing it's related to using the sigmoid function on the output but I'd like to have a proper ...
1
vote
1answer
143 views

How are Bayesian Nets, Hidden Markov Chains, Conditional Random Fields and Neural Nets related?

I am having an AI exam in two weeks, and I am still figuring out certain concepts and ideas, related to Bayesian Nets, Hidden Markov Chains, Conditional Random Fields and Neural Nets (yes it is all ...
8
votes
3answers
34 views

When should I move beyond k nearest neighbour

For many machine learning projects that we do, we start with the k Nearest Neighbour classifier. This is an ideal starting classifier as we usually have sufficient time to calculate all distances and ...