Questions tagged [empirical-research]

Questions about methods that empirically measure the quality of computer science models and techniques when applied to real-world scenarios.

20 questions
25
votes
2 answers

Is there evidence that using dynamic languages has an impact on productivity?

I am wondering if there are any experiments that show the existence or the non-existence of a correlation between usage of a dynamic language (such as Python, Ruby, or even languages that run on the Java platform such as Groovy, Clojure) over a…
Ken Li
  • 3,106
  • 3
  • 24
  • 38
22
votes
4 answers

CPU frequency per year

I know that since ~2004, Moore's law stopped working for CPU clock speed. I'm looking for a graph showing this, but am unable to find it: most charts out there show the transistor count or the capacity per year. Where can I find some data showing…
peoro
  • 323
  • 4
  • 8
9
votes
4 answers

How are statistics being applied in computer science to evaluate accuracy in research claims?

I have noticed in my short academic life that many published papers in our area sometimes do not have much rigor regarding statistics. This is not just an assumption; I have heard professors say the same. For example, in CS disciplines I see papers…
7
votes
1 answer

Tag-free garbage collection for object oriented languages

I'm looking around for a good garbage collection technique for my language and found this paper, where Benjamin Goldberg describes a garbage collection technique for strongly typed languages, which removes the need for type information during…
7
votes
1 answer

Ideal number of participants for evaluation of development approach / software architecture

For my thesis, I have created a development approach (consisting of schemes, an application template and prototype code) that should make it easier to develop and adapt applications for a specific platform. I have conducted interviews with…
4
votes
1 answer

Which maintainability metric has the strongest empirical evidence?

There are lots of code metrics that claim to measure maintainability, e.g. CK and Li & Henry metric suits. However, it seems elusive to me to find a meta-study that compares different metrics to decide their current empirical status. In contrast,…
Olle Härstedt
  • 375
  • 1
  • 10
4
votes
2 answers

Empirical studies about benefits of Q&A sites for programming

I'm looking for empirical papers which investigate if a user can benefit from Q&A sites like Stack Overflow. I welcome any papers related to this topic, e.g: an experiment, investigating if a specific task can be executed faster, an analysis,…
3
votes
1 answer

Gate/transistor number and program length measures of computational complexity?

Are there scaling concepts regarding the number of components needed and minimum program length needed to solve a problem of some complexity? For example, problems are characterized by O(.) measures of time and space complexity. Space complexity…
3
votes
1 answer

Is it viable to use an HMM to evaluate how well a catalogue is used?

I was interested on evaluating a catalogue that students would be using to observe how is it being used probabilistically. The catalogue works by choosing cells in a temporal sequence, so for example: Student A has:…
3
votes
1 answer

Comparing variations of A*

I am running some experiments with a maze, and trying different variations of A*. Based on my experiments, I have been able to form some opinion (that at least in those cases, graph checking is better than IDA). I am looking for online articles…
2
votes
0 answers

Are there many empirical results about which metaheuristics are well-suited for which problem domains?

One of the nice things about genetic algorithms is that they can easily be used for a diverse array of problem domains, whereas PSO for example seems best-suited for candidates of real-valued vectors (although I am aware of the use of the latter in…
2
votes
1 answer

performance between the data structures

I have developed two existing data structures and I want to see their performances over a certain algorithm. In this case I use Dijkstra's algorithm with binary and Fibonacci heaps. Just to ask, if I have 100 to 1000 number of vertices in the tested…
2
votes
1 answer

How can I measure the usability of a catalogue?

This question might seems vague but heres the context: When we are focusing on HCI we would most likely be interested on knowing first how the user usually deals with a certain object. We then try to see how our system could take away one of the…
Oeufcoque Penteano
  • 405
  • 1
  • 4
  • 11
1
vote
1 answer

Data normalization when control has multiple values in CS/CE

(This question was originally posted at https://academia.stackexchange.com/questions/68675 but was considered too specific for Academia.) In computer science/engineering research papers relating to performance improvement wherein execution time is…
JAB
  • 113
  • 5
1
vote
0 answers

Is this Time analysis strategy right?

I'm working in the time analysis for an algorithm with two optional optimizations variant applied and followed next approach: Create inputs of different lengths for the algorithm Using these inputs to execute the two algorithm variants and count…
1
2