Nopol Dataset

This contains the experimental data of project NOPOL. The source code of Nopol is at https://github.com/SpoonLabs/nopol/. The main publication is at http://hal.archives-ouvertes.fr/hal-01285008/.

Architecture:

• bug metadata in data/projects/*/project.json and data/projects/*/bugs/*.json. The metadata is used by helper scripts
• helper Python scripts in src to create the dataset, compile it, run it, create additional files
• information about the benchmark in data/projects/*/patch/*.

Reproduce the experiment

To run Nopol, you need Java and JavaC version 7 and the Z3 SMT solver. We use java version "1.7.0_79" and Z3 4.3.3 (see data/lib/z3). Note that changing to another Java or Z3 version may lead to different patches from the ones in our paper.

git clone https://github.com/SpoonLabs/nopol-experiments.git
cd nopol-experiments
# check that java is java 7
java -version # should be java 1.7"
javac -version # should be java 1.7"
python src/reproduce.py -bug cm1

This outputs a long line, ended by

1 patches found
cm1: org.apache.commons.math.stat.univariate.rank.Percentile:148: CONDITIONAL (length)<=(fpos)

The other possible bugs identifiers are cl1 cl2 cl3 cl4 cl5 cl6 cm1 cm10 cm2 cm3 cm4 cm5 cm6 cm7 cm8 cm9 pl1 pl2 pl3 pl4 pm1 pm2.

You can also run them all at once:

python src/reproduce.py -bug all

By default, z3 is taken at ./data/lib/z3 (version 4.3.3, 64 bits). If you'd like to use another one:

python src/reproduce.py [-solver <path_to_z3>] -bug [bug_id|all]

Reproducing the experiment on Travis:

1. Fork this project by clicking on fork on Github

2. Activate travis for your fork (log in to travis-ci.org >> accounts > sync account > on)

3. Get a local version of your fork, git clone https://github.com/<username>/nopol-experiments

4. Do an empty commit

cd nopol-experiments
git commit --allow-empty -m "Trigger"
git push

5. visit the travis page to see the results https://travis-ci.org/<username>/nopol-experiments (e.g. `https://travis-ci.org/monperrus/nopol-experiments)

Nopol version in our paper

The Nopol version in our paper is as follows. http://github.com/SpoonLabs/nopol/blob/master/nopol/nopol-0.0.3-SNAPSHOT-jar-with-dependencies.jar.

The latest Nopol version produces slightly different patches.

Test cases in use for Nopol

For technical reasons, we have not used whole test suites for several bugs. Here is a list of bugs, on which only specific test classes are used. For the bugs that are not listed here, we use the whole test suite in Nopol. The first column is the bug index; the second column is the representative test class in use (all test cases in this test class are used by Nopol).

Bug	Test name
CM10	org.apache.commons.math3.stat.correlation.CovarianceTest
CL1	org.apache.commons.lang.StringUtilsTest
CL2	org.apache.commons.lang.StringUtilsTest
CL3	org.apache.commons.lang.StringUtilsSubstringTest
CL4	org.apache.commons.lang.text.StrBuilderTest
CL6	org.apache.commons.lang3.StringUtilsIsTest
PL1	org.apache.commons.lang.time.StopWatchTest
PL2	org.apache.commons.lang.StringEscapeUtilsTest
PL3	org.apache.commons.lang.WordUtilsTest
PL4	org.apache.commons.lang3.text.translate.NumericEntityUnescaperTest