Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Where are the TSE 2012 results? #2

Open
clegoues opened this issue Aug 3, 2017 · 4 comments
Open

Where are the TSE 2012 results? #2

clegoues opened this issue Aug 3, 2017 · 4 comments
Assignees
Labels
results issues Missing data or links to results for papers.

Comments

@clegoues
Copy link
Contributor

clegoues commented Aug 3, 2017

Mysteriously not linked from the old GenProg site, either.

@clegoues clegoues self-assigned this Aug 3, 2017
@weimer
Copy link
Collaborator

weimer commented Aug 7, 2017

My guess, via this link from the old genprog webpage ...

TSE 2012 Benchmark Programs and workloads. The instructions assume GenProg v1.0.

...

is:

http://dijkstra.cs.virginia.edu/genprog/resources/genprog-benchmarks-tse-2012.tar.gz

http://dijkstra.cs.virginia.edu/genprog/resources/genprog-tse2012-workload.tar.gz

Similarly, via

GenProg TSE 2012 virtual machine image and instructions for a WU-FTP format string vulnerability repair demo

http://dijkstra.cs.virginia.edu/genprog/resources/genprog-tse2012-wuftpd.vdi

http://dijkstra.cs.virginia.edu/genprog/resources/genprog-tse2012-wuftpd.txt

@clegoues
Copy link
Contributor Author

clegoues commented Sep 6, 2017

Thx. Both for this and GECCO 2010, I was hoping to dig up the actual logs, rather than just the benchmarks. However, this is a start, and I will definitely link.

@weimer
Copy link
Collaborator

weimer commented Sep 7, 2017

I was hoping to dig up the actual logs,

I agree. For GenProg 2009-based experiments, we are now talking about science from eight years ago, and we may well just have to give up on some of it.

That said, some of those archives do include logs -- but recall that the logs used to be named differently way back in the day:

weimer@dijkstra:~/genprog/resources$ tar tf genprog-benchmarks-tse-2012.tar.gz | grep -i debug
genprog-benchmarks-tse-2012/deroff/deroff.c-reference.debug
genprog-benchmarks-tse-2012/atris/atris_comb.c-reference.debug
genprog-benchmarks-tse-2012/zune/zunebug.c-reference.debug
genprog-benchmarks-tse-2012/openldap/io.i-reference.debug
genprog-benchmarks-tse-2012/indent/indent_comb.c-reference.debug
genprog-benchmarks-tse-2012/uniq/uniq.i-reference.debug
genprog-benchmarks-tse-2012/svr-look/look.c-reference.debug
genprog-benchmarks-tse-2012/ccrypt/ccrypt_comb.c-reference.debug
genprog-benchmarks-tse-2012/gcd/gcd.c-reference.debug
genprog-benchmarks-tse-2012/flex/flex_comb.c-reference.debug
genprog-benchmarks-tse-2012/wu-ftpd/ftpd_comb.c-reference.debug
genprog-benchmarks-tse-2012/lighttpd/mod_fastcgi.i-reference.debug
genprog-benchmarks-tse-2012/nullhttpd/httpd_comb.c-reference.debug
genprog-benchmarks-tse-2012/ultrix-look/look.c-reference.debug
genprog-benchmarks-tse-2012/php/string.i-reference.debug
genprog-benchmarks-tse-2012/units/units.c-reference.debug

We'll see things like this at the bottom of one:

    fitness 15
            best so far (size delta 449)

v_gen 0
avgfit :
bcfit :

Best result written to deroff.c-0-0.01-0.06-best.c
First Solution in 15.8366 (6 fitness evals)
Best Solution in 15.8366 (6 fitness evals)
Generations to solution: 1
Avg ins: 0/19 = 0
Avg del: 0/.. = 0
Avg swap: 0/.. = 0
Avg xover: 0/.. = 0
Avg mut: 0/.. = 0
Percent failed to compile: 19/6 = 3.16667

@jlacomis jlacomis added the results issues Missing data or links to results for papers. label Feb 20, 2019
@blank-black
Copy link

My guess, via this link from the old genprog webpage ...

TSE 2012 Benchmark Programs and workloads. The instructions assume GenProg v1.0.

...

is:

http://dijkstra.cs.virginia.edu/genprog/resources/genprog-benchmarks-tse-2012.tar.gz

http://dijkstra.cs.virginia.edu/genprog/resources/genprog-tse2012-workload.tar.gz

Similarly, via

GenProg TSE 2012 virtual machine image and instructions for a WU-FTP format string vulnerability repair demo

http://dijkstra.cs.virginia.edu/genprog/resources/genprog-tse2012-wuftpd.vdi

http://dijkstra.cs.virginia.edu/genprog/resources/genprog-tse2012-wuftpd.txt

Hi, the links here are expired.
Do you have the new link?

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
results issues Missing data or links to results for papers.
Projects
None yet
Development

No branches or pull requests

4 participants