Questions tagged [machine-learning]

Questions about computer algorithms that automatically discover patterns in data and make good decisions based on them.

Filter by
Sorted by
Tagged with
10
votes
2answers
1k views

Smallest DFA that accepts given strings and rejects other given strings

Given two sets $A,B$ of strings over alphabet $\Sigma$, can we compute the smallest deterministic finite-state automaton (DFA) $M$ such that $A \subseteq L(M)$ and $L(M) \subseteq \Sigma^*\setminus B$?...
86
votes
7answers
17k views

Why is deep learning hyped despite bad VC dimension?

The Vapnik–Chervonenkis (VC)-dimension formula for neural networks ranges from $O(E)$ to $O(E^2)$, with $O(E^2V^2)$ in the worst case, where $E$ is the number of edges and $V$ is the number of nodes. ...
4
votes
4answers
4k views

Algorithms for Connect 4?

Im designing a program to play Connect 6, a variation of connect 4. I have narrowed down my options to the following: 1) Minimax with Alpha-Beta Proning 2) A Neural Net 3) Machine Learning My ...
27
votes
1answer
28k views

Which machine learning algorithms can be used for time series forecasts?

Currently I am playing around with time series forecasts (specifically for Forex). I have seen some scientific papers about echo state networks which are applied to Forex forecast. Are there other ...
44
votes
5answers
13k views

Why has research on genetic algorithms slowed?

While discussing some intro level topics today, including the use of genetic algorithms; I was told that research has really slowed in this field. The reason given was that most people are focusing on ...
28
votes
4answers
5k views

How to determine likely connections in a social network?

I am curious in determining an approach to tackling a "suggested friends" algorithm. Facebook has a feature in which it will recommended individuals to you which it thinks you may be acquainted with. ...
3
votes
4answers
1k views

Efficiently labelling training data in machine learning

Obviously it always depends on the specific case. However, my question is how to label data efficiently without writing a source code from scratch which solves the final problem itself? For example, ...
3
votes
2answers
909 views

Predicting energy consumption of households

I have the dataset which you can find here, containing many different characteristics of different houses, including their types of heating, or the number of adults and children living in the house. ...
3
votes
1answer
79 views

Analysis and classification based on data points

I'm not sure if this is the correct stack exchange or correct tags, but my question is as follows: I am working on a sort-of ratings system for players in a particular game. After allowing the ...
1
vote
1answer
272 views

What are good counter-examples when training an apple classifier? [closed]

I am doing a project in order to recognize an apple. (I am using Emgucv with Visual Studio 2010 C#, if that's relevant). My project is a classification (is or is not an apple). I have 2000 images of ...
32
votes
2answers
2k views

Are there improvements on Dana Angluin's algorithm for learning regular sets

In her 1987 seminal paper Dana Angluin presents a polynomial time algorithm for learning a DFA from membership queries and theory queries (counterexamples to a proposed DFA). She shows that if you ...
27
votes
4answers
69k views

What exactly is the difference between supervised and unsupervised learning?

I am trying to understand clustering methods. What I I think I understood: In supervised learning, the categories/labels data is assigned to are known before computation. So, the labels, classes or ...
26
votes
12answers
8k views

Why is overfitting bad?

I've studied this lots, and they say overfitting the actions in machine learning is bad, yet our neurons do become very strong and find the best actions/senses that we go by or avoid, plus can be de-...
8
votes
1answer
10k views

Machine Learning: Identify Patterns in Time-Series Data

I work in renewable energy. My company gathers a lot of data from equipment. This typically includes process data (such as transformer temperature, line voltages, currents, etc.) and discrete alarms (...
5
votes
2answers
6k views

Are neural networks a type of reinforcement learning or are they different?

Can neural networks be considered a form of reinforcement learning or is there some essential difference between the two? By the same token could we consider neural networks a sub-class of genetic ...
4
votes
1answer
3k views

Showing that Bayes classifier is optimal

Consider domain $X$, label set $ Y=\{0,1\}$ and the zero-one loss. Given any probability distribution D over $ X\times \{0,1\} $, we've defined the Bayes classifier $ f_D $ to be- $$ f_{D}(x)= \...
2
votes
1answer
67 views

What is the Best and easiest way to create a Classifer for Sentiment Analysis [closed]

Sentiment analysis using Machine Learning is a hot topic. In the present situation when a person doesn't have a problem in having the training data set then which way should we create the classifier ...
1
vote
5answers
600 views

Google's Deep Dreamer

I was just wondering on a more technical side, if anyone could explain what Google does to create these amazing images from it's deep dream system. Could anyone explain to me in a step by step way, ...
6
votes
2answers
419 views

What is usually the next step after showing the VC dimension?

I am new to statistical learning. I have a structure $X$ where I showed its hypothesis class $H$ has VC dimension $d$. All I know now is that I can bound the number of examples by $m\geq \frac{1}{\...
5
votes
1answer
3k views

Are expert systems outdated, what are better alternatives to them, if any?

I need to link facts to actions through rules. If a person bought soup 10 times and he is coming at midday every day, then the system should link the fact that the person bought soup so many times, ...
3
votes
1answer
348 views

How much does regularization prevent overfitting?

I've been curious why machine learning algorithms with high VC dimension, such as XGBoost and deep learning, do well in practice. The answer appears to be regularization significantly restricting the ...
3
votes
2answers
248 views

Language Classification + AWS ML: what am I doing wrong?

I'm evaluating Amazon's machine learning platform, and thought that I would give it a "simple" classification problem first. As a disclaimer, I am quite new to machine learning (hence my interest in ...
2
votes
0answers
66 views

Using the random forest algorithm to predict vectors [duplicate]

I know this might sound like a newbie question, but bear with me. I have read a paper where researchers use a random forest to predict species distribution, but in their study, they only predict a ...
2
votes
2answers
1k views

Why is automatically labeling data in unsupervised learning hard?

I currently studying machine learning and pattern recognition area. Today, my professor said implementing an unsupervised system that automatically labels data is difficult. Why is that? I think if I ...
11
votes
1answer
213 views

Google DeepDream Elaborated

I've seen a few questions on this site about Deep Dream, however none of them seem to actually speak as to what DeepDream is doing, specifically. As far as I've gathered, they seem to have changed the ...
7
votes
1answer
6k views

What is the difference between 'features' and 'descriptors' in computer vision / machine learning?

I've read multiple time sentences similar to Finally, for standard image classification bag-of-words features based on SIFT descriptors have been found critical for high performances. We first ...
6
votes
1answer
5k views

Does there exist a data compression algorithm that uses a large dataset distributed with the encoder/decoder?

If my goal were to compress say 10,000 images and I could include a dictionary or some sort of common database that the compressed data for each image would reference, could I use a large dictionary ...
5
votes
1answer
258 views

Google Deep Dream has these understandings?

From both my own exploration of Google Deep Dream using Dreamify for IOS, and from Google Image results on the topic. I've come to 3 conclusions about the networks understanding of images that seem ...
4
votes
2answers
2k views

Why is the O(nW) algorithm for the Knapsack problem not a polynomial one?

On the wikipedia page for the knapsack problem it says that the runtime is $\mathcal{O} (nW)$ and goes on to say that this doesn't violate its classification as NP because the input size is related to ...
4
votes
1answer
359 views

Anomaly/outlier detection using fuzzy clustering

I understand that fuzzy clustering using FCM produces a membership matrix for the set of data points we feed to it. What characteristics will an anomalous cluster produced during this method have? (...
4
votes
3answers
276 views

How are Neural Networks made so general?

After reading this blog about Deep Neural Networks learning about selfies I'm struck by how generic the network in question is. In short: I'm thinking of trying to write something vaguely similar for ...
3
votes
1answer
217 views

Specific case of a ranking model

So the problem I'm solving is this: I have a list of conversations of 3 messages each (for eg. "hi", " how are you", "remind me to fix this bug" is one conversation, and my problem will have many of ...
3
votes
1answer
184 views

Using the appropriate machine learning algorithm [duplicate]

I am not sure if this is the right forum to ask this. I have some data of the houses, like their size(in square meters), if they use aircondition, how many residents live in, I have their electricity ...
3
votes
0answers
1k views

Which machine learning algorithm is appropriate for predicting a vector?

I have a very large set of animal migration data, consisting of many series of vectors - each series is basically a path of a single animal. The dataset I'm using consists of 244 of these series. I ...
3
votes
2answers
139 views

Machine Learning: What program will derive the underlying algorithm in this series?

This is a machine learning question. Given this series of categorical data, what program will derive the underlying algorithm and predict what comes next in the series? Here is the series: B, BA, BB,...
2
votes
2answers
414 views

How to handle missing continuous attribute values in ID3 (Iterative Dichotomiser 3)?

I'm implementing the ID3 algorithm (Iterative Dichotomiser 3). I have an attribute which happens to be continuous like 12.21, 3.01, etc. AND have missing values which are marked as "NA". How I'm ...
2
votes
2answers
351 views

Support Vector Machines as Neural Nets?

This is more of a conceptual question. I have learned about Neural Nets, and I have some clue as to how Support Vector Machines work. I read somewhere however that given the appropriate kernel (is ...
1
vote
1answer
742 views

How to identify labels in unsupervised learning?

Let's say I am working on handwritten digit recognition (0 to 9). I know for instance that if I use clustering then I need to look for 10 clusters. But once I have the 10 clusters,how do I identify ...
5
votes
1answer
148 views

SVM optimization objective: why are we maximizing $\frac{1}{\|w\|}$?

I'm learning about Support Vector Machines(SVM). I understood that their objective is to maximize the margin between the decision line and the closest point to it. For simplicity, let's assume we have ...
4
votes
2answers
838 views

Is it a problem that “successful” machine learning algorithms have large VC dimension?

In my limited exposure, it appears that "successful" machine learning algorithms tend to have very large VC dimension. For example, XGBoost is famous for being used to win the Higgs Boson Kaggle ...
3
votes
3answers
3k views

What would be a decent threshold for classification problem?

I'm using machine-learning algorithms to solve binary classification problem (i.e. classification can be 'good' or 'bad'). I'm using SVM based algorithms, ...
3
votes
1answer
69 views

Training given pairs of similar values, not labels

I have pairs of "similar" values $(x_i, y_i)$ drawn from a space $x_i, y_i \in S$, and want to train a neural network $N$ such that $N(x_i)$ would be "close" to $N(y_i)$ for all $i$, yet, to make it ...
3
votes
1answer
96 views

Finding the dichotomy that maximizes information gain for a classifier?

Suppose that $\Omega$ is a finite probability space,with measure $P$ (we can take $P$ uniform). Let $C \in \{\pm 1 \}$ be a random variable on $\Omega$, the classifier. Let $$H(C) = H(C, \Omega, P) = ...
2
votes
1answer
355 views

How does a recurrent connection in a neural network work?

I am reading a very interesting paper on genetic algorithms which define neural networks. I am familiar with how a feedforward neural network operates, but then I came across this: Where node #4 ...
2
votes
1answer
904 views

NeuroEvolution: NEAT algorithm innovation numbers

I have been reading up on the NeuronEvolution of Augmented Topologies and there's this little thing that's been bothering me. While reading Kenneth Stanley's Paper on NEAT I came on this figure here: ...
2
votes
1answer
88 views

Learning a small disjunction

I have a boolean function $f: \{0,1\}^n \to \{0,1\}$ that I know takes the form $$f(x_1,\dots,x_n) = x_{i_1} \lor x_{i_2} \lor \dots \lor x_{i_k},$$ but I don't know the values of $i_1,\dots,i_k$. ...
2
votes
2answers
142 views

Hidden Markov Model in Tagging Problem

I try to understand the details regarding using Hidden Markov Model in Tagging Problem. The best concise description that I found is the Course notes by Michal Collins. The goal is to find a ...
1
vote
2answers
304 views

Pairwise comparisons with confidence

There is a lot of information available on the subject of Pairwise Comparisons but I haven't found any guidance on how to optimize pair measurements that have confidence values attached to them. ...
1
vote
1answer
35 views

Problem with Understanding “correlated attributes into a set of values of uncorrelated attributes” in PCA

I am studying PCA. I have a problem in understanding the following concept: What is meant by transforming "correlated attributes into a set of values of uncorrelated attributes" in Principal ...
0
votes
1answer
352 views

Using AI / Machine learning to find the most time and space efficient solutions to an algorithm [duplicate]

As programmers, we are always trying to find the most efficient space and time complexity solutions to algorithms. Is it forseeable in the future that we have languages or techniques such as AI/...