Questions about computer algorithms that automatically discover patterns in data and make good decisions based on them.

learn more… | top users | synonyms

0
votes
0answers
11 views

What are the most useful subjects in Information Science and Engineering to study Machine Learning? [on hold]

I am doing engineering in INFORMATION SCIENCE and i am very much eager to learn more about machine and its internal working. Thank you
2
votes
1answer
22 views

How is the environment designed for testing a reinforcement learning algorithm?

I'm working on a project, and have a candidate algorithm which I'd like to test. Before I go any further, I need to get the hang of how to code the "structure" of the environment in which my system is ...
0
votes
0answers
16 views

machine learning of infinite discrete point distribution

Is there any standard procedure (building feature vectors) that could be used to build machine learning models based on discrete and infinite point distributions on a hyperplane (practically 2D 3D), ...
-1
votes
1answer
46 views

Turing tests and humans

How are the questions framed in Turing tests? I mean what factors would one consider before framing questionnaire for the Turing Test.How the questions should be framed to make the test unbiased for a ...
1
vote
0answers
21 views

KDD Machine Learning using K-NN Algorithm Classification Problem

I'm trying to solve a classification problem from the KDD cup archive of 2004. Details can be found here: KDD 2004 Archive I'm only dong the particle physics part. The description of dataset is as ...
4
votes
0answers
35 views

Google DeepDream Elaborated

I've seen a few questions on this site about Deep Dream, however none of them seem to actually speak as to what DeepDream is doing, specifically. As far as I've gathered, they seem to have changed the ...
0
votes
1answer
19 views

What does it mean to have a continuous action space w.r.t. to reinforcement learning?

Last time I posted this question I got criticised for not being specific enough, hence this is my second attempt at trying to understand what it means to have a continuous action space. Please refer ...
3
votes
1answer
47 views

Standardizing Data for Neural Networks

Let's say we have a data set with following features [age, sex, country, city, annual income] [35, male, USA, New York, 73000]. I came across the article which ...
1
vote
1answer
35 views

Is this some kind of hashing?

Say I have $n$ vectors $\{ z_i \in \mathbb{R}^D\}_{i=1}^n$ (where $n$ is very large and hence I can't do any calculation which scales as $n$) and I want to create $n$ vectors $\{x_i \in \mathbb{R}^d ...
0
votes
0answers
16 views

Most impactful factor in the given set of values

My question is somewhat similar to this question Need an algorithm to find the input factors that are most affecting the output but the answers does not solve my problem. My question is: I am ...
1
vote
0answers
11 views

Is SRM necessary to prove that a countable union of agnostic PAC learnable classes is nonuniformly learnable?

The following I believe is a direct proof of this fact. If a learner is tasked to be $\epsilon$-competitive with a hypothesis $h \in \mathcal H_n$, where $\mathcal H_n$ is agnostic PAC learnable, it ...
0
votes
1answer
66 views

characteristic vectors for systems

The question is motivated from a physics problem: Let's first discuss the 1D infinitely long discrete system on a lattice, a system can look like: system 1: ...(ABAC)(ABAC)(ABAC)... this leads to ...
1
vote
0answers
28 views

Good language for introduction to self-modifying algorithms? [closed]

So I am trying to find a language with which i can write code to build/search through deductive reasoning 'nets', as well as self-modify it's search algorithms based on information learned from these ...
0
votes
0answers
26 views

Structural risk minimization erratum in Understanding Machine Learning Theorem 7.4?

Firstly define for a hypothesis class $\mathcal H_n$ with uniform convergence with sample complexity $m_{\mathcal H_n}^{UC}(\epsilon,\delta)$ the following function: $\epsilon_n(m,\delta) := ...
0
votes
0answers
31 views

Is there a non-linear version of ICA?

"Independent Component Analysis" is this : someone is sampling a random vector $s \in \mathbb{R}^d$ such that all its components $s_i$ are mutually independent and $\mathbb{E}[s_i^4] < 3$ and the ...
0
votes
0answers
16 views

Recommendations of machine learning and deep learning textbooks [closed]

I am a theoretical linguist with some very modest programming ability (bash scripts, basics of Python and C). Recently, I've been playing around with some ideas about crosslinguistic variation that I ...
1
vote
1answer
45 views

Expectation Maximization Algorithm for simple naive Bayesian network

I am trying to understand the following network A has two children - B & C (aka common cause) All the variables are binary and can be either 0 or 1. In data values are missing only for some ...
3
votes
2answers
34 views

Which algorithm for counting the occurrences of a certain pattern (spots) in an image?

The Problem : Finding the number of occurrences of a certain pattern (or shape) in an image. In my example, the problem is about finding the number of spots (in variety of sizes) in an image. See ...
2
votes
2answers
48 views

How to handle missing continuous attribute values in ID3 (Iterative Dichotomiser 3)?

I'm implementing the ID3 algorithm (Iterative Dichotomiser 3). I have an attribute which happens to be continuous like 12.21, 3.01, etc. AND have missing values which are marked as "NA". How I'm ...
2
votes
0answers
32 views

How to design a fitness function for binary logic network?

Assume we have a directed graph of connected nodes, where each node represents logical operator. Input for this logic operator are values on all edges leading to the node and result is outputted to ...
1
vote
1answer
28 views

Question about simple perceptron code

I'm reading through Sebastian Raschka's Python Machine Learning, and I see something confusing that is not explained in the text. In the code on this page: ...
3
votes
0answers
50 views

Typical NP-complete/hard problems in machine learning

I know little about machine Learning, but I work on optimization (solving NP-hard problems with SAT solvers or MIP). Examples of this would be solving TSP, Steiner tree problems, path finding with ...
0
votes
0answers
7 views

Modelling Congestion Control Problem as POMDP

I want to simulate a reinforcement learning based Congestion control algorithm. I saw http://lia.univ-avignon.fr/fileadmin/documents/Users/Intranet/chercheurs/habachi/TSP-2012.pdf I cant understand ...
2
votes
0answers
17 views

error measure (of ML agos) that takes confidence into account

when calculating the error measure such as mean absolute error, we use the real values and the predicted values. Many machine learning algorithms can give a confidence measure of each value being ...
1
vote
0answers
21 views

About the complexity of learning probabilistic graphical models

I guess that one way of measuring the complexity of learning a joint probability distribution is as its "sample complexity" (which is also sometimes known as its "distributional learning complexity"?) ...
-1
votes
0answers
43 views

Where to find official implementation of bouncing ball dataset?

The Ilya Sutskever's Bouncing Ball Dataset is frequently referenced in various Machine Learning publications (for example, 1 and 2) and I want to use it to test my own Machine Learning approach. ...
-1
votes
0answers
10 views

Trouble with OpenCV Implementation for EM Algorithm using Spherical GMM [migrated]

I've been trying to use OpenCV2.4.10 with VS2013 to create a small GMM (based on a 100 2D randomly generated samples with 2 clusters) using the trainE function in the EM class. The main reason I ...
3
votes
1answer
71 views

Algorithm to find pronounciation rules

Suppose that you have a large dictionary with spellings and pronounciations of foreign words, and you want to find a set of pronunciation rules. They should have the simplest form: a sequence of ...
0
votes
0answers
18 views

Examples for speech recognition systems and spoken dialogue systems

I am collecting material for a MOOC about speech technology. My aim is that students also have examples to try rather than just watching the lecture and some complimentary youtube videos. So the idea ...
1
vote
0answers
75 views

Gradient descent overshoot - why does it diverge?

I'm thinking about gradient descent, but I don't get it. I understand that it can overshoot the minimum when the learning rate is too large. But I can't understand why it would diverge. Let's say we ...
10
votes
1answer
524 views

Implementation of Naive Bayes

I am implementing a Naive Bayes algorithm for text categorization with Laplacian smoothing. The problem I am having is that the probability approaches zero because I am multiplying many small ...
2
votes
1answer
36 views

Role of computational power in recent AI developments

Today Google's AI won its first game of Go against Lee Sedol, one of the best Go players on the planet. Image interpretation and self-driving cars are other recent success stories in machine learning. ...
1
vote
1answer
25 views

How can a distributed system cooperate to determine rules of its environment?

I'm sorry if this question is silly or elementary. I'm not a computer scientist so I don't know the vocabulary to use to ask this question. Thus I've produced an analogy to explain the challenges I'm ...
1
vote
1answer
35 views

Advice for statistics/ML problem

I've been studying a particular problem recently, and it seems like there might be techniques from statistics or ML that could be applied. Any advice or comments would be appreciated. We're given ...
0
votes
1answer
65 views

How different is the working of SNN (Spiking Neural Network) as compared to a real Neuron System in biological systems?

Assuming its one step closer to realism as compared to ANN, DNNs and other Neural Network models, what are the primary differences between a real neuron system and SNN?
1
vote
0answers
28 views

Knowledge Vault - Please explain the local closed world assumption

Background I'm currently reading a paper on the google knowledge vault here : http://www.cs.cmu.edu/~nlao/publication/2014.kdd.pdf. I'm having trouble with the Local Closed World Assumption (LCWA). ...
3
votes
1answer
94 views

What category of AI would a 2048 bot be considered?

I have just delved into the realm of AI and from what I can tell its a very vast field of study. I am a game programmer, so AI in games is particularly interesting to me. My question is, what type of ...
1
vote
0answers
27 views

Known distributions that generate sparse vectors?

I have data that comes in the form of a vector. Each vector is sparse. Is there a commonly used distribution that will generate sparse vectors? I am working on a project where I am passing a bunch ...
1
vote
0answers
34 views

What are the limitations of LSTMs?

For a school project, I'm planning to compare Spiking Neural Networks (SNNs) and Long Short Term Memory (LSTMs) networks in learning a time-series. I would like to show some case where SNNs surpass ...
1
vote
0answers
23 views

How to train SVM in matlab / python for MultiLabel data? [closed]

I am training a problem such that my output (y) could be more than one class. For example, the SVM could say, this input vector is class 1, but it could also say, this input vector is classes 1 AND 5. ...
3
votes
1answer
51 views

Hyper parameter and complexity in $K$ nearest neighbors

I'm wondering if choosing K in the Nearest Neighbors Classifier can be stated as model selection, since the computational complexity is getting higher, the higher K is. My understanding is: since the ...
2
votes
1answer
40 views

Conflict Driven Clause Learning combined with brute force

I am learning about the Conflict Driven Clause Learning method to solve SAT problems. In this method it is possible to learn clauses and add these in the set of the initial clauses. I understand a ...
2
votes
1answer
29 views

Normalized measure from dynamic time warping

I am trying to find the similarity between two time series, but not in terms of distance, in something more sensible such as percentage of similarity. In other words I need something that shows the ...
4
votes
0answers
31 views

What is the difference between Cased-based Reasoning and Rule-based reasoning?

As stated here, Rule-based Reasoning systems are considered to be "old style" AI that uses rules prepared by humans - as opposed to Neural Networks where machine recognizes pattern i.e. acquires new ...
2
votes
1answer
54 views

Is it a good idea to determine coordinates of object on images with regression algorithms?

I am doing doing one of getting started competitions on kaggle, the one which requires you to find coordinates of different objects on images. I know that the usual method for this is to use sliding ...
1
vote
2answers
72 views

How to optimize a function by maximizing 1 variable and minimizing another?

Problem I want to implement an optimization algorithm for my file transfer program. The program buffers data in a local file before uploading to central server periodically and it compresses the ...
6
votes
0answers
74 views

Formulating shortest path as submodular minimization

I'm curious about the general question of whether any combinatorial optimization problem with polynomial time solution can necessarily be reformulated as minimizing a submodular function. The answer ...
0
votes
1answer
57 views

What are Predictive Clustering Trees in machine learning?

Anybody could let me know what exactly the PDT is and where does it come from? it comes from predictive modeling or decision tress? I read some articles and websites like: this and this but both of ...
3
votes
2answers
48 views

What restrictions apply to query and target vector encoding on fast-forward neural networks?

I'm currently studying fast-forward multi-layer neural networks with back propagation, in the book I see that all query and target vectors are binary-encoded, this makes me believe that this is the ...
5
votes
0answers
70 views

Computer vision: Why do random filters perform similar to edge detectors?

I read here that "a randomly initialized filter acts very much like an edge detector!". I want to know if there are any papers describing and explaining this phenomenon.