Questions about computer algorithms that automatically discover patterns in data and make good decisions based on them.

learn more… | top users | synonyms

-2
votes
0answers
16 views

kNN with kdtrees

I am trying to learn the basics of the kNN search using kdtrees since I want to develop an algorithm to improve kNN under given circunstances. However, I could not find too much information on the ...
-2
votes
0answers
15 views

How to predict ice (sleet, glaze ice) [closed]

Tell me how you can well predict the ice (sleet, glaze ice)? I have a database for a long period of time with different parameters to weather conditions. The first thing that comes to mind - Least ...
0
votes
0answers
11 views

Unsupervised feature learning from raw text as a previous step for clasification? [closed]

I have a corpus of 2500 opinions, is it posible to use scikit´s restricted boltzmann machine implementation to extract a feature vector as a previous step to a classification task?. What aproach do i ...
1
vote
0answers
21 views

Reinforcement learning - state space and action space

I am working on a reinforcement learning strategy for parameter control of a local search heuristic. The complete state for this RL problem can be defined as $S = \{s, p\}$, where $s$ and $p$ ...
2
votes
2answers
40 views

Combining multiple HMM models

Is there any way to combine multiple Hidden Markov Models trained from different sets of data? For example, I want to detect the phases of a sequential activity. I collect two sets of data by using ...
0
votes
1answer
38 views

Find pixel mapping matrix with minimum iterations

The Situation I am an electronics engineer and on a volunteer team that have built a prototype eye that has 200*200 sensors that are mapped to the optic nerve, the connection to the optic nerve is ...
3
votes
2answers
46 views

How do I measure the reliability of a confidence value in a predictive algorithm?

Supposing I have some algorithm that is able to provide me with a confidence value for some event occurring. Let's say on day 1 it tells me that there is a 80% chance it will rain, on day 2 it tells ...
0
votes
0answers
23 views

How to discern devices based on their traces?

I would greatly appreciate your advice on following machine learning problem: I need to train a classifier to learn a device's behavior. The device itself can be observed under different ...
0
votes
0answers
18 views

What math is required for machine learning, neural networks etc.? [duplicate]

I'm planning to start learning more in depth about neural networks and machine learning. Can someone tell me which math will I need the most, and also recommend me good books or internet lessons in ...
6
votes
2answers
88 views

Are there ways to automatically (no human testing) measure a $9 \times 9$ Sudoku puzzle's average hardness for a human to solve?

So most resources providing Sudoku puzzles assign a difficulty category to each puzzle, even some I've seen with 15 or more difficulty categories. But what is a good way to assign these difficulty ...
1
vote
0answers
43 views

Improving MSE as fitness function for a genetic algorithm

I am implementing an autoencoder neural network in matlab, the weights of which are being optimised by a genetic algorithm. At the moment I am working on the first layer, trying to get an improved ...
1
vote
0answers
25 views

Disadvantages to using simple step functions for activation in neural networks?

From what I have read, the main advantage to using tanh(x) or sigmoid(x) as an activation function for neural networks is that it is very easily differentiable. I am trying to implement a neural ...
0
votes
1answer
40 views

How to reconstruct the image from a neural network output?

I am trying to use the genetic algorithm to optimise a multi-layered neural network for image classification (i am using a subset of the MNIST handwritten digit data set as my initial dataset, but ...
1
vote
0answers
24 views

Detect bad acceleration deceleration of car [closed]

I am working on aggressive driving behavior android application. This will be implemented via supervised learning, wrong actions will be recognized and added while driving the car. To check ...
0
votes
0answers
38 views

Sample Complexity for Real-Valued PAC-Learnable Functions

Can anyone shed some light on how the VC Dimension affects the sample complexity bounds of infinite hypothesis classes with real-valued outputs in PAC learning, or how to calculate the sample ...
2
votes
1answer
47 views

How can we combine badly trained decision trees to a good one?

I was reading about decision trees and this is what I understood: We build decision trees by choosing an attribute and building subtrees (which are also decision trees) as children of the node ...
2
votes
5answers
166 views

Machine Learning and Neural Networks for High School Students

I hope this question is appropriate for this forum. In this summer I am giving a 3-day workshop on machine learning and neural networks for advanced and very enthusiastic high school students which ...
0
votes
0answers
49 views

Activity prediction in a kitchen

Here is the scenario: There are three chefs(A- main chef, B and C- assistant) working together to prepare a diner set. The sequence of the event is as following. Start: The three chefs enter the ...
0
votes
0answers
13 views

What are Pairwise intensity comparison in binary image descriptors?

Recently many binary descriptors have come u like BRIEF, ORB etc. A common ste in such descriptors is to chose a sampling pattern and perform pairwise intensity comparisons for constructing the binary ...
2
votes
3answers
128 views

Does programming language detection need more input than natural language detection?

I wonder which one of the two needs a larger input to achieve a decent accuracy: programming language detection or natural language detection? More details: Definition of Language detection: ...
2
votes
1answer
33 views

Closed form solution for a single layer linear perceptron

Let f be a one-layer neural network which is linear (ie. no activation function). Let it have $p$ inputs and $q$ outputs. These are fully connected by weights $W$. We have $n$ inputs $x \in ...
1
vote
0answers
17 views

Baseline approaches for likes prediction

I have a small user-item matrix (25k x 1.8k) describing how users liked or disliked some of the items. Users don't have any attributes but items have several features. I would like to be able to ...
2
votes
1answer
41 views

Generative Machine Learning algorithms on tree structure

I'm looking into PCFG sentence grammar dependency structure parsing using StanfordNLP PCFG parser. It generates tree structures represented as a string like this: ...
0
votes
0answers
46 views

Where to start studying about HTM?

I am looking for references (pedagogic and beginner friendly!) to these two topics, hierarchical temporal memory algorithms applied to deep planning problems (multi-layer) neural networks trained ...
1
vote
0answers
44 views

Two classes of documents. Find weighted relations between them

I have an NLP problem and a potential solution, but I’m a bit green here, so I’m looking for some validation or alternative suggestions. Background I have two types of documents: one is a set of ...
2
votes
1answer
35 views

Why does ε-greedy $Q$-learning not oscillate?

I have a intuitive question on the convergence of $Q$- learning. In $Q$ learning for each step a $Q$- value is learned for the state-action pair where the action is selected according to the ...
3
votes
1answer
51 views

Extracting features for texture classification

I m a beginner in the field of pattern recognition and computer vision. I m working on a project right now to classify t-shirt patterns into three categories i.e. solids, stripes and checks. I have ...
1
vote
0answers
24 views

What is the difference between “objective function”, “error function”, “criterion function” and “cost function” in the context of neural networks?

The title says it all: I have seen three functions so far, that seem to be the same / similar: error function criterion function cost function objective function I am currently working on ...
1
vote
1answer
43 views

How to implement the regret matching algorithm?

My question is the following: How to calculate the regret in practice? I am trying to implement the regret matching algorithm but I do not understand how to do it. First, I have $n$ players with ...
3
votes
1answer
31 views

Training given pairs of similar values, not labels

I have pairs of "similar" values $(x_i, y_i)$ drawn from a space $x_i, y_i \in S$, and want to train a neural network $N$ such that $N(x_i)$ would be "close" to $N(y_i)$ for all $i$, yet, to make it ...
-1
votes
1answer
15 views

Training Error & Convergence to True Error

I Take some online class for Machine Learning. one of teacher say this sentence. if we have m data points, the training error converges to the true error as m → ∞. i thought, this sentence not ...
0
votes
1answer
29 views

VC Dimension Calculation for Intervals

As i See in ML Course a VC dimension calculation is very theoretical. What is the VC-dimension of intervals in R? The target function is specifieed by an interval, and labels any example positive ...
1
vote
3answers
147 views

Over-fitting Always Occurs?

i get stuck in one sentence in machine learning. i read tom Mitchel book on ML, and some other materials. if we have small training set, always over-fit can occurs? or is likely to occurs? i read ...
-1
votes
1answer
40 views

Policy function π in Reinforcement learning unclear

I have one question about policy function in Reinforcement learning. in fact this function indicates which action should be done in each state? Or this function indicate for get the ...
-2
votes
1answer
44 views

Neural Network Design Challenge

i'm studying for PHD Entrance Exam on Stanford. one of previous material exam designed very challenging. i want to design a NN for classifying following 2-class problem. 1) output should be -1 or ...
1
vote
0answers
17 views

basic doubt on policy iteration

consider the policy iteration algorithm for a finite state MDP. Suppose the initial policy is a stochastic policy. Now, can the optimal policy be deterministic after improvements ? Or, can we say that ...
1
vote
0answers
17 views

If one hypothesis class is a proper subset of another, what is the relation of their VC dimensions?

Assume two hypotheses classes $H_A\subset H_B$ defined over the same instance space $\delta$. Assume also $VC(H_A)=d$, does this mean $VC(H_B)\geq d$ ? where $VC$ is the VC dimension. We can use the ...
0
votes
1answer
40 views

Why is the VC dimension different on intervals and half intervals?

As I read this lecture for being familiar with VC dimension we find on p. 8: VC(half intervals in $\mathbb{R}$ ) = 1 .... no subset of size 2 can be shattered VC(intervals in $\mathbb{R}$ ...
2
votes
2answers
56 views

Why is automatically labeling data in unsupervised learning hard?

I currently studying machine learning and pattern recognition area. Today, my professor said implementing an unsupervised system that automatically labels data is difficult. Why is that? I think if I ...
0
votes
1answer
99 views

Bayesian Nets & Markov Blanket

As i passed PHD entrance exam, some days ago, i want to find solutions for challenging problem. In Bayes network on X={X1,...Xn} each random variable has P parents and Q child's. for Xi we want to ...
0
votes
1answer
18 views

Understanding non-linear dimensionality reduction algorithm (locally linear embedding)

I have a question about Locally Linear Embedding. I am trying to study this algorithm and implement it for better understanding. I have read An Introduction to Locally Linear Embedding. However, I ...
1
vote
2answers
47 views

Need an algorithm to find the input factors that are most affecting the output

I apologize if this question is already answered and appreciate any pointers to existing answers. I'm not familiar with statistical or data mining terms so my search was limited to basic words used in ...
1
vote
1answer
54 views

Can heuristic methods and machine learning approaches be considered alternate methods to solve NP-Complete problems?

I was watching the videos from Skiena's Computational Biology Lectures, which is also available at youtube. In those videos, the professor made a statement that, most of the problems posed to computer ...
0
votes
0answers
30 views

Can anyone help with a simple neural net I am trying to code?

I have a neural net with two input units (and a bias) connected to four hidden units, with each input unit (including the bias) connected to all the hidden units. Then there is one output unit. All ...
0
votes
1answer
31 views

How to use different size features in SVM?

I want to train a support vector machine with some features. The problem is, one of the features is 1-dimensional (only an angle) and the other is an LBP Histogram, an 58-dimensional vector. ...
0
votes
0answers
11 views

A confusion on adaptive algorithm

Consider flight trajectory control problem i.e. find out the control parameter for which the average error of the actual output and desired output is minimized. Can we call any algorithm for solving ...
0
votes
1answer
36 views

Algorithm for cost function maximization

I have a system that takes in 'm' inputs and provides a cost value as an output. The system is a "black box" to me. The inputs can be varied and the corresponding output can be observed, however, I ...
2
votes
0answers
20 views

Non-i.i.d Empirical Risk Minimization [closed]

It's a post which already posted on math.stackexchange.com. I'm not a statistician so please forgive me if I pose a silly question, but it's a real problem for me in my research. Suppose we have ...
3
votes
2answers
58 views

How do learn the most important nodes in a tree?

I have a list of 20000 words and how often they appeared in a set of 500 newspaper articles. I am trying to build a stemmer which chops off suffuxes from each words, so ...
2
votes
1answer
55 views

Q-learning in a Dynamic environment

I am new to reinforcement learning. Lately, I have learned Q-learning using the following tutorial. Is Q-learning still possible if the environment is dynamic. Using the environment of the tutorial ...