Questions tagged [machine-learning]
Questions about computer algorithms that automatically discover patterns in data and make good decisions based on them.
1,080
questions
5
votes
3answers
209 views
How can lazy learning systems simultaneously solve multiple problems?
On the english Wikipedia it says about lazy learning systems:
Because the target function is approximated locally for each query to the system, lazy learning systems can simultaneously solve ...
3
votes
2answers
346 views
What could you learn from studying player movement and behaviour on online FPS games?
Just thinking of Counter Strike as a canonical example, if you have a coordinate representation of the map and for every player you have a complete history of everything you might need for every ...
3
votes
1answer
151 views
Which Is a Better Way of Obtaining Scales, Gaussian Blur or Down Sampling?
In computer vision, scales are important when we carry out a scene analysis. Choosing different scales affect the result of the analysis. For example, if a face is relatively small in the scene, then ...
6
votes
1answer
372 views
Why does the experience propagation rule for checkers work in Tom Mitchell's book?
In Tom Mitchell's book "Machine Learning", Chap.1, a checkers game is used to illustrate how machine learning can be applied solve problems.
An experience propagation rule is described for iterative ...
3
votes
2answers
163 views
Analyzing Twitter Relationships
I'm not even sure if this is the right StackExchange to post this, but it seems like sentiment analysis would go here.
What would be the best approach to determine if two people on Twitter are ...
13
votes
1answer
16k views
Smoothing in Naive Bayes model
A Naive Bayes predictor makes its predictions using this formula:
$$P(Y=y|X=x) = \alpha P(Y=y)\prod_i P(X_i=x_i|Y=y)$$
where $\alpha$ is a normalizing factor. This requires estimating the parameters ...
29
votes
4answers
70k views
What exactly is the difference between supervised and unsupervised learning?
I am trying to understand clustering methods.
What I I think I understood:
In supervised learning, the categories/labels data is assigned to are known before computation. So, the labels, classes or ...
3
votes
2answers
154 views
Finding Feature Representation Such That Two Samples Are Similar in Feature Space
Consider one specific useful function of our human brain: abstraction of object. Take the example of two pictures: if we are told the pictures are similar, we actually make conclusion about the ...
4
votes
1answer
356 views
Is there a search engine over Artificial Intelligence and Machine Learning -related sites?
Sometimes it is necessary to dig into Artificial Intelligence or specifically Machine Learning problems to make a research. Common googling (in my own experience) usually doesn't help much due to a ...
3
votes
1answer
173 views
Improve Markov Chain results
Apologies for another Markov Chain question but this one is best given its own question to avoid confusion. I am using a Markov Chain to get the 10 best search results from the union of 3 different ...
16
votes
2answers
10k views
Must Neural Networks always converge?
Introduction
Step One
I wrote a standard backpropegating neural network, and to test it, I decided to have it map XOR.
It is a 2-2-1 network (with tanh activation function)
...
10
votes
1answer
647 views
Machine Learning algorithms based on “structural risk minimization”?
Which machine learning algorithms (besides SVM's) use the principle of structural risk minimization?
8
votes
1answer
527 views
Vapnik-Chervonenkis Dimension: why cannot four points on a line be shattered by rectangles?
So I'm reading "Introduction to Machine Learning" 2nd edition, by Bishop, et. all. On page 27 they discuss the Vapnik-Chervonenkis Dimension which is,
"The maximum number of points that can be ...
2
votes
1answer
4k views
Nilsson's sequence score for 8-puzzle problem in A* algorithm
I am learning the A* search algorithm on an 8-puzzle problem.
I don't have questions about A*, but I have some for the heuristic score - Nilsson's sequence score.
Justin Heyes-Jones web pages - A* ...
10
votes
2answers
359 views
How do I classify my emulator input optimization problem, and with which algorithm should I approach it?
Due to the nature of the question, I have to include lots of background information (because my question is: how do I narrow this down?) That said, it can be summarized (to the best of my knowledge) ...
19
votes
3answers
8k views
Line separates two sets of points
If there is a way to identify if two sets of points can be separated by a line?
We have two sets of points $A$ and $B$ if there is a line that separates $A$ and $B$ such that all points of $A$ and ...
18
votes
1answer
949 views
Efficiently computing or approximating the VC-dimension of a neural network
My goal is to solve the following problem, which I have described by its input and output:
Input:
A directed acyclic graph $G$ with $m$ nodes, $n$ sources, and $1$ sink ($m > n \geq 1$).
Output:
...
6
votes
1answer
163 views
How to represent the interests of a Facebook user
I'm trying to figure out a way I could represent a Facebook user as a vector. I decided to go with stacking the different attributes/parameters of the user into one big vector (i.e. age is a vector of ...
15
votes
4answers
4k views
How to devise an algorithm that suggests feasible cooking recipes?
I once had a veteran in my course that created an algorithm that would suggest cooking recipes. At first, all sort of crazy recipes would come out. Then, she would train the cooking algorithm with ...
14
votes
2answers
8k views
Machine learning algorithm to play Connect Four
I'm currently reading about machine learning and wondered how to apply it to playing Connect Four.
My current attempt is a simple multiclass classificator using a sigmoid function model and the one-...
11
votes
2answers
208 views
Non-Parametric Methods Like K-Nearest-Neighbours in High Dimensional Feature Space
The main idea of k-Nearest-Neighbour takes into account the $k$ nearest points and decides the classification of the data by majority vote. If so, then it should not have problems in higher ...
2
votes
1answer
201 views
Pattern classification: what goes into the sample?
I am trying to compare the performance of a classification result with Bayes classifier, K-NN, Piece wise component analysis (PCA). I have doubts regarding the following (please excuse my lack of ...
7
votes
2answers
213 views
Issue in comparing classifiers for pattern recognition
I have designed a classifier M which recognizes gestures and classifies it under any category always. A gesture is classified based on the hamming distance between the sample time series y and the ...
22
votes
2answers
2k views
What combination of data structures efficiently stores discrete Bayesian networks?
I understand the theory behind Bayesian networks, and am wondering what it takes to build one in practice. Let's say for this example, that I have a Bayesian (directed) network of 100 discrete random ...
46
votes
5answers
14k views
Why has research on genetic algorithms slowed?
While discussing some intro level topics today, including the use of genetic algorithms; I was told that research has really slowed in this field. The reason given was that most people are focusing on ...
23
votes
1answer
650 views
Clustering of Songs (The Joe Walsh Problem)
The Eagles are a rock supergroup from the 70s and 80s, responsible for such classics as Hotel California. They have two quite distinctive sounds, one where guitarist Joe Walsh is present (for example, ...
29
votes
2answers
700 views
Why do neural networks seem to perform better with restrictions placed on their topology?
Fully connected (at least layer to layer with more than 2 hidden layers) backprop networks are universal learners. Unfortunately, they are often slow to learn and tend to over-fit or have awkward ...
29
votes
4answers
5k views
How to determine likely connections in a social network?
I am curious in determining an approach to tackling a "suggested friends" algorithm.
Facebook has a feature in which it will recommended individuals to you which it thinks you may be acquainted with. ...
34
votes
2answers
2k views
Are there improvements on Dana Angluin's algorithm for learning regular sets
In her 1987 seminal paper Dana Angluin presents a polynomial time algorithm for learning a DFA from membership queries and theory queries (counterexamples to a proposed DFA).
She shows that if you are ...
16
votes
1answer
133 views
Methods to evaluate a system of written rules
I was trying to come up with a system that would evaluate bylaws for an organization as to determine their underlying logic.
I think a first-order predicate system would work for representing the ...
