Using the techniques of artificial intelligence and machine learning to extract patterns from large data sets and transforming those data into a useful, organized form for future processing.

learn more… | top users | synonyms

-1
votes
1answer
15 views

Main difference between data mining and statistics? [on hold]

Still don´t get the differece between data mining, machine learning, KDD with statistics. I´m making my thesis for my bachelor degree on computer science as theoretical framework i need to define ...
0
votes
0answers
9 views

Data Mining vs Evolutionary Computation as subject for engineering course? [closed]

I am a student pursuing Bachelor of Technology in Computer Science and Engineering entering my final year. I have a choice to pursue on of these two courses. Which one should I opt for? I have been ...
0
votes
0answers
14 views

Choosing the best set of keywords [closed]

I have a dataset of tweets collected using twitter streaming API on a particular topic (say 'football') using around 40 keywords. Now if I'm going to track the same topic (football) in future how do I ...
2
votes
0answers
22 views

Document clustering for summarization

I am curious as to what steps one would reasonably need to take to perform an extraction-based text summarizer. I've taken a look at some papers I've found on Google such as this one, which explains ...
2
votes
2answers
42 views

What kind of model is used by 20 Questions?

Which kind of machine learning concept / model is used in 20 Questions? Is this kind of thing best solved by a neural network? Where I can read something about it?
3
votes
2answers
53 views

Physical Meaning Behind Matrix Factorization

As we all know, Matrix Factorization is an effective method to do rating prediction jobs in recommender systems. Thanks to the work of Yahuda Koren. My question is why MF can do this job? What's the ...
0
votes
0answers
17 views

web content “mining” using supervised learning tequniques

We're accessing an API of a web system for obtaining product information. We require some additional information, which is not available through the API. This information is publically available for ...
3
votes
1answer
26 views

Decision Tree with Unbalanced Data

I have a data set with two classes: one class has at most 2000 members while the size of the second class is unlimited, though it is typically in the hundreds of thousands. I have read that it is ...
1
vote
1answer
21 views

Model for diurnal nature of data [closed]

I have a timeseries dataset of a quantity measured over the period of a week. I want to verify if the data is varying in a diurnal fashion with the help of some mathematical measure. Does any such ...
3
votes
1answer
68 views

Most common subset of size $k$

I'm trying to write an algorithm that detects the most common subset of at least size $k$, from a collection of sets. If there are ties for the most common subset, I want the one of them whose size ...
1
vote
1answer
47 views

Is there an efficient way to cluster a graph according to Jaccard similarity?

Is there an efficient way to cluster nodes in a graph using Jaccard similarity such that each cluster has at least k nodes? Jaccard similarity between nodes i and j: Let S be the set of neighbours ...
1
vote
1answer
104 views

How does BIRCH (Balanced Iterative Reduction Using hierarchical) CF Tree insertion algorithm work?

I am studying Cluster Analysis and I came across BIRCH (Balanced Iterative Reduction Using hierarchical) http://en.wikipedia.org/wiki/BIRCH_(data_clustering) CF Tree insertion algorithm. I am confused ...
3
votes
1answer
46 views

Analysis and classification based on data points

I'm not sure if this is the correct stack exchange or correct tags, but my question is as follows: I am working on a sort-of ratings system for players in a particular game. After allowing the ...
0
votes
0answers
20 views

Data mining interpretation [closed]

I am thinking over a data mining problem but unable to interpret it properly .. " how change in fiscal policies affect economic health of a country " Indicators of economic health - GDP and ...
0
votes
3answers
71 views

linklist and memory issues [closed]

I have a doubly link-list like this typedef struct Record { int i; Record* next; Record* prev; }Record; I have over 5 trillions of records that I need ...
3
votes
1answer
139 views

String inputs in Machine Learning

Several popular machine learning algorithms such as Logistic regression or Neural networks require its inputs to be numeric. What I'm interested in is how you make these algorithms work on ...
2
votes
1answer
54 views

Classification of 2d arrays of outlines

I am not experienced in machine learning but I have been looking at the Python toolklit scikit-learn. I have thousands of mammograms and I have written an algorithm ...
2
votes
1answer
81 views

Document definition in information retrieval

Is there common formal definition of Document in information retrieval field? In many researches authors don't define the term Document(maybe because it is evident for them). Wikipedia says "text ...
1
vote
2answers
140 views

Getting started with Data Mining [closed]

This is the first time that I'm looking in depth into the topic, although I've always been curious. Could someone let me know about online resources (courses, tutorials, etc) and books that cover the ...
4
votes
1answer
91 views

Anomaly/outlier detection using fuzzy clustering

I understand that fuzzy clustering using FCM produces a membership matrix for the set of data points we feed to it. What characteristics will an anomalous cluster produced during this method have? ...
1
vote
2answers
73 views

Event Prediction through Machine Learning

I have a large data set consisting of ca. 40 categorical data items and a few interval data items (real numbers, less than 5 such items). Most categories should have a lot of values that repeat ...
1
vote
0answers
41 views

How to cluster nodes based on the number of dependencies

I have a problem where, there are a set of nodes and dependencies between them. I want to cluster them based on the maximum number of dependencies. Dependencies can be thought of as number of edges ...
3
votes
2answers
156 views

Can we understand SVM without knowledge of Machine Learning [closed]

I was told by my adviser (future one) to look into libsvm library or any other and try to get familiar with it.. to work on a programming project (on Machine Learning) (will start in a month). my ...
1
vote
0answers
30 views

Is it possible to discern the quality of web data from networks derived from it?

One topic I've recently looked at is co-occurence networks formed from Twitter tweets. This is how I felt after looking at the tweets of random people: This leads me to the question: Question: ...
1
vote
2answers
49 views

Looking for Rating Functions

I'm looking for something i would call rating functions. I'm searching for some literature about this concept. I'm not really sure about the terminology, but what I mean should be pretty obvious. A ...
1
vote
1answer
74 views

Maximum variance and useful information of dataset

I am reading through PCA and it says that the maximum variance principal component has most of the information. Can we apply that to any data set? If a data set has n attributes and most of the ...
1
vote
1answer
142 views

Difference between Data point, attribute, feature?

Can anyone tell me the difference between the following in data mining? I am taking a class this semester and the professor is using the terms so frequently, I don't know what these mean anymore. ...
1
vote
1answer
50 views

Pool of photos for term extraction

I need a pool of photos (if possible with description) for my project. I mainly have to perform term extraction for semantic searching. Is there something available out there that is made available ...
1
vote
1answer
71 views

In context of data mining, what does it mean for an association rule measure to be maximal?

In context of data mining, what does it mean for an association rule measure to be maximal? I cannot understand the term maximal in this context. I know of maximal independent sets in algorithms ...
1
vote
2answers
1k views

Relation and difference between information retrieval and information extraction?

From Wikipedia Information retrieval is the activity of obtaining information resources relevant to an information need from a collection of information resources. Searches can be based on ...
2
votes
0answers
96 views

What limits the implementation of proximity operators for text indexing and searching?

I was asking on academia.se, if anyone knows scientific search engines offering a proximity operator like Google Web Search does, while Google Scholar Search does not. That's sad, because this ...
2
votes
1answer
260 views

Difference between decision tree and rule based reasoner

I am new to this topic, and in some scientific papers I've been reading about prediction in sports I encountered the term rule based reasoner. Is it this term the same as a semantic reasoner( where ...
2
votes
3answers
266 views

Machine Learning - Support Vector Machines

I'm looking for good resources regarding Support Vector Machines, or suggestions where to start learning SVM. Already used references: Stanford ML course by Andrew Ng is great place to star A ...
8
votes
1answer
101 views

Looking for a ranking algorithm that favors newer entries

I'm working on a ranking system that will rank entries based on votes that have been cast over a period of time. I'm looking for an algorithm that will calculate a score which is kinda like an ...
3
votes
1answer
186 views

Maintaining search indices with binary trees

There are some documents to be indexed, that means I need to read the docs and extract the words and index them by storing at which document they appear and at which position. For each word initially ...
28
votes
5answers
2k views

Why has research on genetic algorithms slowed?

While discussing some intro level topics today, including the use of genetic algorithms; I was told that research has really slowed in this field. The reason given was that most people are focusing on ...
10
votes
2answers
176 views

Identifying events related to dates in a paragraph

Is there an algorithmic approach to identify that dates given in a paragraph correlate to particular events (phrases) in the paragraph? Example, consider the following paragraph: In June 1970, ...
4
votes
0answers
73 views

Applying the graph mining algorithm Leap Search in an unlabeled setting

I am reading Mining Significant Graph Patterns by Leap Search (Yan et al., 2008), and I am unclear on how their technique translates to the unlabeled setting, since $p$ and $q$ (the frequency ...