Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RFE] We should consider a test agent and validator that can attempt to resolve issues that occur when running the unit tests #578

Open
shawn-hurley opened this issue Jan 23, 2025 · 0 comments
Labels
agent enhancement New feature or request prompt-engineering Issues related to changes for prompts or tweaks for specific models rpc-server

Comments

@shawn-hurley
Copy link
Contributor

I see two issues to overcome:

  1. Running unit tests sounds good in theory, but many times, a fix in one class will cause unit tests to fail in another. This means that just unit testing the file that has been changed will not necessarily be sufficient. Running the full suite can take some time and would not really be feasible to run after each task.
  2. A lot of configurations are usually involved in running unit tests, and this presents a challenge in making the agent work generically.
@shawn-hurley shawn-hurley added agent enhancement New feature or request prompt-engineering Issues related to changes for prompts or tweaks for specific models rpc-server labels Jan 23, 2025
@JonahSussman JonahSussman changed the title [RFE ] We should consider a test agent and validator that can attempt to resolve issues that occur when running the unit tests [RFE] We should consider a test agent and validator that can attempt to resolve issues that occur when running the unit tests Jan 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
agent enhancement New feature or request prompt-engineering Issues related to changes for prompts or tweaks for specific models rpc-server
Projects
None yet
Development

No branches or pull requests

1 participant