Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [data-sets]

Questions asking for real-life or benchmarking data sets.

Filter by
Sorted by
Tagged with
29 votes
2 answers
6k views

Where to get graphs to test my search algorithms against?

I am implementing a set of path finding algorithms such as Dijkstra's, Depth First, etc. At first I used a couple of self made graphs, but now I'd like to take the challenge a bit further and thus I'...
devoured elysium's user avatar
22 votes
4 answers
6k views

CPU frequency per year

I know that since ~2004, Moore's law stopped working for CPU clock speed. I'm looking for a graph showing this, but am unable to find it: most charts out there show the transistor count or the ...
peoro's user avatar
  • 323
7 votes
2 answers
452 views

Interesting small SAT problems?

I'm noodling around with making a hardware SAT solver on an FPGA, and I'm wondering if there are any interesting SAT problems smaller than, say, 50 variables both to stay within the limits of the FPGA ...
Andrew's user avatar
  • 347
4 votes
1 answer
93 views

Are there repositories of automatically generated (spam) webpages?

I'm interested to see if I can use machine learning/network analysis methods to automatically detect automatically generated (spam) webpages. I'm particularly interested in webpages that look ...
Douglas S. Stones's user avatar
4 votes
1 answer
2k views

How is sound input and output data converted to use with machine learning networks?

Suppose one has a couple of .wav files with English spoken words, multiple ones for each word, and for each such set there exists a transcription of their right output, the pronunciation as ascii text....
n611x007's user avatar
  • 141
3 votes
1 answer
148 views

Environment requirement in training image dataset for classifier

I have a question about preparing the dataset of positive samples for a cascaded classifier that will be used for object detection. As positive samples, I have been given 3 sets of images: a set of ...
user961627's user avatar
3 votes
2 answers
2k views

How to filter a very, very large file

I have a very large unsorted file, 1000GB, of ID pairs ID:ABC123 ID:ABC124 ID:ABC123 ID:ABC124 ID:ABC123 ID:ABA122 ID:ABC124 ID:ABC123 ID:ABC124 ID:ABC126 I would like to filter the file for 1) ...
user3574820's user avatar
3 votes
1 answer
141 views

Seeking "gold standard" to evaluate accuracy of network clustering algorithm

I'm currently looking at network clustering algorithms (we're currently looking at both directed and undirected, unweighted networks). The algorithms we've tried produce visually nice clusters. ...
Douglas S. Stones's user avatar
3 votes
0 answers
109 views

Describe data structure using equations

Good afternoon. At work I'm currently developing a system which takes user input (well structured) and then stores it in memory to do some processing. The input is basically a dataset formed by ...
addictedtohaskell's user avatar
2 votes
1 answer
48 views

Semantic information collections on the web. (Semantic Wikipedia)

There are lots of technologies supporting semantic information markup even as wiki software. I am wondering if there is any kind of broad information collection project like Wikipedia which features ...
Chris's user avatar
  • 123
2 votes
1 answer
148 views

Examples of difficult Hamiltonian Cycle Problems

I am working on implementing algorithms to solve Hamiltonian Cycle Problem. I need difficult problem graphs to test my implementations but my google-fu is weak and am unable to find any. Please advise ...
gautam's user avatar
  • 25
2 votes
1 answer
121 views

Where can I find the data of the computer experiments in the book "Neural Networks and Learning Machines"?

The book "Neural Networks and Learning Machines" by Simon Haykin has many computer experiments to which many exercises are related. But there seems to be no data for these experiments available online....
Strin's user avatar
  • 1,505
2 votes
1 answer
514 views

Where I can I find Pre Trained CNN Datasets for Facial Emotion Recognition?

I am working on a project that involves recognising emotion from images. There are two parts in the project: One where I will generate features from images using API's and then classify the emotion ...
Divyat's user avatar
  • 45
2 votes
0 answers
1k views

Looking for dynamic network data sets [closed]

There are a number of collections of network (or graph) data sets freely available on the web, e.g. http://snap.stanford.edu/data/index.html http://www.cc.gatech.edu/dimacs10/downloads.shtml I am ...
cls's user avatar
  • 21
2 votes
0 answers
67 views

Algorithm for query comparison

Lets say I have a global dataset and I run queries over those data set. For example my dataset would be #id, #Name, #Employee, #Birthdate, #number_of_children 1, Nick, Nasa, 1982, 1 2, Jack, Exon, ...
yilmazhuseyin's user avatar
1 vote
1 answer
290 views

What are good counter-examples when training an apple classifier? [closed]

I am doing a project in order to recognize an apple. (I am using Emgucv with Visual Studio 2010 C#, if that's relevant). My project is a classification (is or is not an apple). I have 2000 images of ...
Emily Salazar's user avatar
1 vote
5 answers
6k views

What is the best way to index lookups on a 2D array of integers that is boundless in x and y?

Lets say you have a data model that consists of a 2D grid of integer points. This grid is sparsely populated and boundless in x and y (up to the max of a 32-bit integer). What is the best way to ...
user18007's user avatar
  • 119
1 vote
1 answer
622 views

Weighted-Graph Datasets

I am searching for datasets to evaluate an algorithm designed for tasks such as node-classification (edge-prediction, etc.) on weighted and potentially directed graphs. The Stanford Network Analysis ...
Qualearn's user avatar
1 vote
2 answers
986 views

create large data sets for machine learning

I am trying to research a new topic using machine learning. The problem is, I have a very small dataset, consisting of 5 months of data. I have been told that my dataset is too small. I want to know ...
student0495's user avatar
1 vote
1 answer
2k views

How to feed videos to a neural network

I have been coding and testing Neural Networks for a while but as of now I have only used IMAGE datasets. (i.e. I have M training images and N testing images). Some datasets are video datasets. The ...
user avatar
1 vote
1 answer
98 views

Indexing a huge dataset (that does not fit into central memory)

The problem. Let us consider a huge file with billions of lines, each containing a string. There are $n$ different strings and $m$ lines in the file, with $m$ much greater than $n$, although both are ...
Matthieu Latapy's user avatar
1 vote
2 answers
93 views

What factors of the integer dataset being sorted can I change, in order to compare two sorting algorithms?

I am comparing two comparison and binary data structure based sorting algorithms, the Tree Sort, and the Heap Sort. I am measuring the time taken for both algorithms to sort an increasing size of an ...
Sanjay Chintapally's user avatar
1 vote
1 answer
2k views

What is the most efficient algorithm for creating a list of unique values from a list of pairs of value?

Background I have a list of 50 million $A-A_i$ pairs, where $i>1$, and $A$ and $A_i$ are some text. I need to extract the $A$ values from the list, so I get a new list of unique $A$ values.: $$ \...
Herman Autore's user avatar
1 vote
1 answer
42 views

Abstract Data Types and their Implementation [closed]

I wanted to know if there is good resource to learn about the ADTs like set ADT, list, array, boolean etc and their implementation.
Avanish Singh's user avatar
1 vote
1 answer
212 views

Method for finding correlation between data sets

Let's say that I have $N$ data sets where I have data points at some fixed frequency, such as "daily". What would be a good method for finding correlation between any of the data sets, or choosing a ...
Alan Wolfe's user avatar
  • 1,358
1 vote
2 answers
217 views

Relative Importance in Graph Theory [closed]

I am working on an algorithm that ranks a set of nodes in a graph with respect to how relative this node is to other predefined nodes (I call them query nodes). The way how the algorithm works is ...
user1894963's user avatar
1 vote
1 answer
829 views

Maximum variance and useful information of dataset

I am reading through PCA and it says that the maximum variance principal component has most of the information. Can we apply that to any data set? If a data set has n attributes and most of the ...
Sid's user avatar
  • 355
1 vote
1 answer
56 views

Pool of photos for term extraction

I need a pool of photos (if possible with description) for my project. I mainly have to perform term extraction for semantic searching. Is there something available out there that is made available ...
Noor's user avatar
  • 111
1 vote
1 answer
67 views

Q: Defining Markov-Chain Probability Matrix States | Specific Academic Paper

I am working on a uni project, for which i will model synthetic electricity consumption time series using Markov-Chains. I am reading through current academic literature on that topic and came across ...
Stefan 44's user avatar
1 vote
0 answers
38 views

Deep RL for healthcare: existing benchmarking datasets or environments

I am currently a Ph.D. student in the computer science department, I was given the subject of Deep RL for Healthcare. However, after lots of research on the internet, I could not find any free dataset ...
mac179's user avatar
  • 161
1 vote
0 answers
17 views

Raters and subsampling

In order to select questions for an online contest, we get contributors to submit potential questions that they write themselves. Then, out of, say 100 submitted questions, we have to rate them and ...
Jean-Philippe Pellet's user avatar
1 vote
0 answers
597 views

Algorithms for tabulating/counting/frequency counting?

It is common in data science to receive two equal length vectors (array of dimension 1), say Categories and Weights. We aim to find all unique values of Categories and sum up the corresponding ...
xiaodai's user avatar
  • 131
1 vote
0 answers
66 views

Algorithm that shifts points in the x-y plane to maximize distance but keep one axis constant

Suppose I am running an experiment with some subjects, and I obtain some numerical data from them. The subjects are divided into 2 experimental groups. Rather than display the means of each group in a ...
David's user avatar
  • 111
1 vote
0 answers
35 views

which paper to take that would best fit to becoming a data scientist? [closed]

My name is Webber from Auckland, New Zealand. I am currently in my second year studying the bachelor of computer and information science. I have chosen to do a double major in computational ...
webber's user avatar
  • 11
1 vote
0 answers
122 views

Can file entropy be predictable?

I am working on some lossless compression topic and looking on any resources or prior studies on lossless file entropy predictability. Assuming we know type of the file (we can tell its belongs to ...
22332112's user avatar
  • 111
1 vote
0 answers
45 views

Algorithm for query comparison

Lets say I have a global dataset and I run queries over those data set. For example my dataset would be #id, #Name, #Employee, #Birthdate, #number_of_children 1, Nick, Nasa, 1982, 1 2, Jack, Exon, ...
yilmazhuseyin's user avatar
0 votes
1 answer
47 views

Access to publicly available project with all the artefacts (files) created during the development [closed]

Does anyone know where I could get an access to a project that contains all the artefacts (documents) that were created during the development? So I would like to get all the word, pdf, power designer,...
Marko Jankovic's user avatar
0 votes
1 answer
325 views

Finding smallest triangle to fit all points

I'm supposed to find an algorithm that, given a bunch of points on the Euclidean plane, I have to return the tightest (smallest) origin centered upright equilateral triangle that fits all the given ...
MathCurious's user avatar
0 votes
1 answer
710 views

Entropy and Information Gain for multi attributes

Is there any way that for specific dataset I can measure entropy and information gain for two or more attributes together? Let's say we have the following dataset: $\begin{array}{cccccc|c} x1 & ...
J. Doe's user avatar
  • 51
0 votes
1 answer
2k views

About the MNIST data-set

Is this known as a fact or from some analysis that the MNIST data-set is almost as if its sampled from some low (~10?) dimensional manifold? Is there a locally linear embedding to a low-dimensional ...
Student's user avatar
  • 173
0 votes
1 answer
25 views

Advice for better performance neural network

As a beginner in neural networks, I'm currently working on a project for predicting winning fighters in MMA matches. I understand that this is a complex task due to the nature of the sport. Currently, ...
BlizZ's user avatar
  • 1
0 votes
1 answer
45 views

Face recognition system with a sparse dataset

I have a dataset of 100 ID's, each ID with only a single unique face image. How can I develop an effective face recognition system to recognise only these faces? I was thinking Deep Learning but the ...
Fady's user avatar
  • 33
0 votes
1 answer
53 views

point clouds in machine learning

What is the purpose of point clouds in machine learning? Consider the following suggestion: Say I have a table (per year) of records (such as days) each of which is made of n real numbers such as ...
user352102's user avatar
0 votes
1 answer
108 views

Classes of outer totalistic cellular automata

I'm wondering if anyone knows of any place where the Wolfram classifications of many outer totalistic cellular automata have been catalogued. The classes of a few examples are given in A New Kind of ...
mostsquares's user avatar
0 votes
1 answer
89 views

What is the metadata in microblogging platform?

I'm reading papers regarding microblog credibility perception of non-text cues. Tweeting is believing? Understanding microblog credibility perceptions by Morris et al., 2012 Microblog Credibility ...
Mystery's user avatar
0 votes
1 answer
53 views

How to parse data in a text file? [closed]

I had a question about altering a text file. I have data in the following format. 1 a,b,c 2 d,e 3 a, l, m,n Note that some of them have spaces after the coma ...
user avatar
0 votes
1 answer
25 views

benchmark data set for Metareasoning problem

I am developing algorithm for solving following problem: Given a set of items with unknown feature(s) (but know distribution of feature(s)). Algorithm must choose what items to measure(every measure ...
farseer's user avatar
  • 259
0 votes
0 answers
81 views

Is there a sorting program or formula to sort and place individuals in classes based on preferences

I am looking for a formula or program to help place people in classes based on their preferences. The elements of the problem are: There are 30 class choices a student can pick from. There are 400 ...
Nick B. 's user avatar
0 votes
0 answers
29 views

Test data for tasks that communicate over network

I am working on a load balancer that schedules tasks that communicate over network. I want to test its performance, but I'm struggling to find test data for it. Currently I try to extract relevant ...
asdfasdf's user avatar
0 votes
0 answers
26 views

Database that contains timespans of cyber attacks in the web

for a project I need to evaluate a model, that tries to predict wether a certain cyber-attack (i.e. connection to a low level honeypot) is just a random access, a new attack-wave or an already known ...
Felix's user avatar
  • 1