Code

Add TestGenEval benchmark#5534

Code

Open

kjain14 wants to merge 46 commits intoAll-Hands-AI:mainAll-Hands-AI/OpenHands:mainfrom kjain14:mainkjain14/OpenHands:mainCopy head branch name to clipboard

+10,452-3

Commits

Commits on Nov 29, 2024

• initial TestGenEval code

  

  Kush Dave Jain

  committed
  7a4729c

  Copy full SHA for 7a4729c

• Initial pass for TestGenEval

  

  Kush Dave Jain

  committed
  c6206f5

  Copy full SHA for c6206f5

• Licensing

  

  Kush Dave Jain

  committed
  280baa2

  Copy full SHA for 280baa2

• Readability metrics

  

  Kush Dave Jain

  committed
  75fba59

  Copy full SHA for 75fba59

Commits on Dec 4, 2024

• Fixing testing dependencies

  

  Kush Dave Jain

  committed
  f7f2531

  Copy full SHA for f7f2531

• Add option for starting point

  

  Kush Dave Jain

  committed
  30197e6

  Copy full SHA for 30197e6

Commits on Dec 5, 2024

• Cleaning to not OOM

  

  Kush Dave Jain

  committed
  791b7f9

  Copy full SHA for 791b7f9

Commits on Dec 6, 2024

• Merge pull request #1 from All-Hands-AI/main

  Show description for bd66d09
  kjain14

  authored
  bd66d09

  Copy full SHA for bd66d09

Commits on Dec 11, 2024

• TestGenEval MVP

  

  Kush Dave Jain

  committed
  585dba9

  Copy full SHA for 585dba9

• + mutation testing

  

  Kush Dave Jain

  committed
  3af6025

  Copy full SHA for 3af6025

• Merge pull request #2 from All-Hands-AI/main

  Show description for b19f735
  kjain14

  authored
  b19f735

  Copy full SHA for b19f735

• Update README

  

  Kush Dave Jain

  committed
  7c81deb

  Copy full SHA for 7c81deb

• Merge branch 'main' of https://github.com/kjain14/OpenHands

  

  Kush Dave Jain

  committed
  2cd64bc

  Copy full SHA for 2cd64bc

Commits on Dec 12, 2024

• reset

  

  Kush Dave Jain

  committed
  b685c67

  Copy full SHA for b685c67

• testgeneval deps

  

  Kush Dave Jain

  committed
  fb9bc87

  Copy full SHA for fb9bc87

Commits on Dec 16, 2024

• Final update, now working on all projects

  

  Kush Dave Jain

  committed
  77a153e

  Copy full SHA for 77a153e

Commits on Dec 25, 2024

• Update TestGenEval README with comprehensive information

  openhands-agent

  committed
  3401bd6

  Copy full SHA for 3401bd6

• Merge branch 'main' of github.com:All-Hands-AI/OpenHands into kjain14-main

  neubig

  committed
  b47da9e

  Copy full SHA for b47da9e

• Update lock file

  neubig

  committed
  90422e5

  Copy full SHA for 90422e5

Commits on Jan 8, 2025

• Any and all pass

  

  Kush Dave Jain

  committed
  31b6967

  Copy full SHA for 31b6967

• Reset to normal time

  

  Kush Dave Jain

  committed
  1ded123

  Copy full SHA for 1ded123

Commits on Jan 9, 2025

• Refine postprocessing

  

  Kush Dave Jain

  committed
  efb525a

  Copy full SHA for efb525a

Commits on Jan 10, 2025

• Refine prompt

  

  Kush Dave Jain

  committed
  219a134

  Copy full SHA for 219a134

• Update prompt

  

  Kush Dave Jain

  committed
  3f0f13d

  Copy full SHA for 3f0f13d

Commits on Jan 17, 2025

• Update filtering

  

  Kush Dave Jain

  committed
  d1e8409

  Copy full SHA for d1e8409

• Only top level filtering

  

  Kush Dave Jain

  committed
  8848e60

  Copy full SHA for 8848e60

Commits on Jan 20, 2025

• Merge branch 'main' of github.com:kjain14/OpenHands into kjain14-main

  neubig

  committed
  3355bae

  Copy full SHA for 3355bae

• More updates

  

  Kush Dave Jain

  committed
  9f9a65c

  Copy full SHA for 9f9a65c

Commits on Jan 28, 2025

• Fix prompting

  

  Kush Dave Jain

  committed
  f781bc8

  Copy full SHA for f781bc8

• Removing duplicate script

  

  Kush Dave Jain

  committed
  c7d575b

  Copy full SHA for c7d575b

Commits on Jan 30, 2025

• Ablation outputs

  

  Kush Dave Jain

  committed
  64abd4a

  Copy full SHA for 64abd4a

Commits on Feb 4, 2025

• Fixing code to handle ablations

  

  Kush Dave Jain

  committed
  e7a8daf

  Copy full SHA for e7a8daf

Commits on Feb 6, 2025

• Final prompt for final experiments

  

  Kush Dave Jain

  committed
  eef0ed3

  Copy full SHA for eef0ed3

• Merge pull request #3 from All-Hands-AI/main

  Show description for 8782e3a
  kjain14

  authored
  8782e3a

  Copy full SHA for 8782e3a

Commits on Feb 8, 2025

• Merge branch 'main' into main

  neubig

  authored
  d8ad8ba

  Copy full SHA for d8ad8ba

Commits on Feb 9, 2025

• Remove prompt truncation

  neubig

  committed
  326e75e

  Copy full SHA for 326e75e

• Remove unneeded input

  neubig

  committed
  4471002

  Copy full SHA for 4471002

Commits on Feb 10, 2025

• Rename eval-infer

  neubig

  committed
  fd53378

  Copy full SHA for fd53378

• Restore testgeneval poetry group

  openhands-agent

  committed
  513dd97

  Copy full SHA for 513dd97

• Update lock

  neubig

  committed
  1290a25

  Copy full SHA for 1290a25

• Update TestGenEval README to include dependency installation

  openhands-agent

  committed
  ace9e6e

  Copy full SHA for ace9e6e

Commits on Feb 11, 2025

• Adding so file for codebleu

  kjain14

  committed
  eb36426

  Copy full SHA for eb36426

Commits on Feb 16, 2025

• Merging

  

  Kush Dave Jain

  committed
  09335d6

  Copy full SHA for 09335d6

• Merging

  

  Kush Dave Jain

  committed
  367c8a9

  Copy full SHA for 367c8a9

• Merge branch 'All-Hands-AI-main'

  

  Kush Dave Jain

  committed
  92ddc1b

  Copy full SHA for 92ddc1b

Commits on Feb 17, 2025

• Merge pull request #6 from All-Hands-AI/main

  Show description for 4984bf6
  kjain14

  authored
  4984bf6

  Copy full SHA for 4984bf6