Questions tagged [benchmarking]
Questions about methods for empirically investigating cost measures of algorithms and data structures.
9
questions with no upvoted or accepted answers
4
votes
0
answers
45
views
Benchmark of SAT solvers on random k-SAT instances at satisfiability threshold
I am looking for a solid reference (peer-reviewed publication) on the design and/or benchmarking of SAT solvers for random k-SAT ($4 \leq k \leq 8$) operating at satisfiability threshold.
The majority ...
- 41
3
votes
0
answers
169
views
How are benchmarks created?
Computing equilibria in games and the complexity thereof is imho still quite a young field in which a lot of work still is to be done (especially the former).
GAMUT (2004) is a very nice "suite of ...
- 1,304
2
votes
0
answers
177
views
Is the data-centric "push" model for SQL evaluation nonsense?
The traditional way to implement a SQL database is to parse the query, create a parse tree, and then evaluate it using the "volcano" model. In this model you call .next() on the root node of the tree ...
- 129
1
vote
0
answers
74
views
Explanation of algorithms used by NAS benchmark kernels
I'm not sure if this is the appropriate forum for asking the following question. Please guide me to the right forum.
I am trying to understand the algorithms used by kernels(such as Integer Sort) in ...
- 121
0
votes
1
answer
49
views
RPI cluster performance related to network performance
I'm writing my thesis and i have built a RPI cluster, containing 10 nodes which consists of RPI model 3b. I've them connected to two gigabit switches. I don't know the CAT of the cables. They are not ...
- 1
0
votes
0
answers
24
views
How to evaluate metrics or benchmarks?
How would you evaluate a new metric or benchmark?
My concrete example: I want to benchmark code review. As others did [1, 2] , one can apply metrics from social network analysis (such as centrality, ...
- 101
0
votes
0
answers
38
views
What are good algorithms for virtual machine benchmarking?
I am comparing execution efficiency of the same code compiled to JVM and Node, locally and on AWS Lambda. Not looking for precision, but just a rough notion of performance in difference virtual ...
- 101
0
votes
0
answers
53
views
Does it make sense to work on DIMACS framework to test TSP algorithms?
Are there any reasons to work with the DIMACS framework, such as to test algorithms, coding, and heuristics of TSP (Traveling Salesman Problem)? It is nearly 15 years since establishment of the ...
- 101
0
votes
0
answers
57
views
How to generate inputs to evaluate the performance of an implementation?
How can we assert that the performance of an implementation matches the expected performance defined in terms of Big-$\mathcal{O}$ and friends by generating best/worst case inputs? I'm thinking of a ...
- 3,678