Questions about methods that empirically measure the quality of computer science models and techniques when applied to real-world scenarios.
Questions tagged [empirical-research]
20 questions
25
votes
2 answers
Is there evidence that using dynamic languages has an impact on productivity?
I am wondering if there are any experiments that show the existence or the non-existence of a correlation between usage of a dynamic language (such as Python, Ruby, or even languages that run on the Java platform such as Groovy, Clojure) over a…
Ken Li
- 3,106
- 3
- 24
- 38
22
votes
4 answers
CPU frequency per year
I know that since ~2004, Moore's law stopped working for CPU clock speed.
I'm looking for a graph showing this, but am unable to find it: most charts out there show the transistor count or the capacity per year.
Where can I find some data showing…
peoro
- 323
- 4
- 8
9
votes
4 answers
How are statistics being applied in computer science to evaluate accuracy in research claims?
I have noticed in my short academic life that many published papers in our area sometimes do not have much rigor regarding statistics. This is not just an assumption; I have heard professors say the same.
For example, in CS disciplines I see papers…
Oeufcoque Penteano
- 405
- 1
- 4
- 11
7
votes
1 answer
Tag-free garbage collection for object oriented languages
I'm looking around for a good garbage collection technique for my language and found this paper, where Benjamin Goldberg describes a garbage collection technique for strongly typed languages, which removes the need for type information during…
MathiasVP
- 71
- 1
7
votes
1 answer
Ideal number of participants for evaluation of development approach / software architecture
For my thesis, I have created a development approach (consisting of schemes, an application template and prototype code) that should make it easier to develop and adapt applications for a specific platform.
I have conducted interviews with…
saschoar
- 171
- 3
4
votes
1 answer
Which maintainability metric has the strongest empirical evidence?
There are lots of code metrics that claim to measure maintainability, e.g. CK and Li & Henry metric suits. However, it seems elusive to me to find a meta-study that compares different metrics to decide their current empirical status.
In contrast,…
Olle Härstedt
- 375
- 1
- 10
4
votes
2 answers
Empirical studies about benefits of Q&A sites for programming
I'm looking for empirical papers which investigate if a user can benefit from Q&A sites like Stack Overflow. I welcome any papers related to this topic, e.g:
an experiment, investigating if a specific task can be executed faster,
an analysis,…
nico1510
- 151
- 2
3
votes
1 answer
Gate/transistor number and program length measures of computational complexity?
Are there scaling concepts regarding the number of components needed and minimum program length needed to solve a problem of some complexity?
For example, problems are characterized by O(.) measures of time and space complexity. Space complexity…
highBandWidth
- 211
- 1
- 4
3
votes
1 answer
Is it viable to use an HMM to evaluate how well a catalogue is used?
I was interested on evaluating a catalogue that students would be using to observe how is it being used probabilistically.
The catalogue works by choosing cells in a temporal sequence, so for example:
Student A has:…
Oeufcoque Penteano
- 405
- 1
- 4
- 11
3
votes
1 answer
Comparing variations of A*
I am running some experiments with a maze, and trying different variations of A*. Based on my experiments, I have been able to form some opinion (that at least in those cases, graph checking is better than IDA).
I am looking for online articles…
Martin H. L.
- 139
- 1
- 6
2
votes
0 answers
Are there many empirical results about which metaheuristics are well-suited for which problem domains?
One of the nice things about genetic algorithms is that they can easily be used for a diverse array of problem domains, whereas PSO for example seems best-suited for candidates of real-valued vectors (although I am aware of the use of the latter in…
readyready15728
- 121
- 1
2
votes
1 answer
performance between the data structures
I have developed two existing data structures and I want to see their performances over a certain algorithm. In this case I use Dijkstra's algorithm with binary and Fibonacci heaps. Just to ask, if I have 100 to 1000 number of vertices in the tested…
MsMissingPoint
- 21
- 1
2
votes
1 answer
How can I measure the usability of a catalogue?
This question might seems vague but heres the context:
When we are focusing on HCI we would most likely be interested on knowing first how the user usually deals with a certain object. We then try to see how our system could take away one of the…
Oeufcoque Penteano
- 405
- 1
- 4
- 11
1
vote
1 answer
Data normalization when control has multiple values in CS/CE
(This question was originally posted at https://academia.stackexchange.com/questions/68675 but was considered too specific for Academia.)
In computer science/engineering research papers relating to performance improvement wherein execution time is…
JAB
- 113
- 5
1
vote
0 answers
Is this Time analysis strategy right?
I'm working in the time analysis for an algorithm with two optional optimizations variant applied and followed next approach:
Create inputs of different lengths for the algorithm
Using these inputs to execute the two algorithm variants and count…
Jesus Salas
- 519
- 1
- 4
- 17