| Only one experimenter |
E-2014 |
Protocolo |
Guías de experimentación |
Two experimenters played the role of clients in the interviews by answering questions from the experimental subjects (analysts) |
There was only one experimenter |
Having only one experimenter as the other was not available |
| Training increased |
E-2014 |
Operacionalización |
Tratamiento |
Short training (warm-up) was 1 week |
Short training (warm-up) was 6 week |
Analyse the effect of increasing training |
| Increasing the duration of training |
E-2015 |
Operacionalización |
Tratamiento |
Short training (warm-up) was 6 week |
Short training (warm-up) was 2 week |
Analyse the effect of increasing training |
| Visibility of fault |
VV-UPM1 |
Operacionalización |
Métricas |
The visibility of fault was not analysed |
The visibility of fault or the number of people who detected the fault was analysed |
To draw new conclusions |
| Two versions of each programme |
VV-UPM1 |
Operacionalización |
Tratamiento |
The programme is a factor (independent variable) although its influence was not analysed |
Two versions of each program are implemented and is a new factor |
To draw new conclusions |
| Increase the number of faults |
VV-UPM1 |
Operacionalización |
Métricas |
There are three types of faults that appeared once. The other three types of faults appeared twice |
All types of faults doubled |
Increase the number of faults as there were two versions of each programme |
| Test cases |
VV-UPM1 |
Protocolo |
Material experimental |
The subjects generated their test cases to detect faults in the code |
First, the subjects applied the technique to generate the test cases and then executed the test cases provided to them in order to detect program failures |
Check whether the visibility of faults influences their detection |
| Discarding a programme |
VV-UPM1 |
Protocolo |
Diseño experimental |
Four programs were used |
Three programs were used, one was discarded |
Balance the design |
| Techniques applied by each subject |
VV-UPM1 |
Protocolo |
Diseño experimental |
Each subject applied a technique |
Each subject applied the three techniques |
To facilitate the comparison of techniques |
| Discarding technique |
VV-UPV |
Operacionalización |
Tratamiento |
The three verification and validation techniques were used: code reading, equivalence partitioning and branch testing |
The code reading technique was omitted |
Adapt to the time available |