Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: LLM context Loss during a long task session #5103

Closed
1 task done
xingyaoww opened this issue Nov 18, 2024 · 4 comments
Closed
1 task done

[Bug]: LLM context Loss during a long task session #5103

xingyaoww opened this issue Nov 18, 2024 · 4 comments
Labels
bug Something isn't working severity:medium Affecting multiple users

Comments

@xingyaoww
Copy link
Collaborator

xingyaoww commented Nov 18, 2024

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Describe the bug and reproduction steps

Link: https://www.all-hands.dev/share?share_id=7b5a3350a5bff98deb170168e50bd537d93971e0875e6f9a6e4938f3d2fdc8e6

image

Maybe related to the context truncation @enyst introduced earlier?

OpenHands Installation

Docker command in README

OpenHands Version

No response

Operating System

None

Logs, Errors, Screenshots, and Additional Context

No response

@xingyaoww xingyaoww added the bug Something isn't working label Nov 18, 2024
@enyst
Copy link
Collaborator

enyst commented Nov 18, 2024

Agent State Change → awaiting_user_input
Agent State Change → loading
Agent State Change → init
Agent State Change → loading
Agent State Change → init

Looks like it lost knowledge after reinitializing the session. Will look into it.

@mamoodi mamoodi added the severity:medium Affecting multiple users label Nov 18, 2024
@enyst
Copy link
Collaborator

enyst commented Nov 25, 2024

Just a heads up here, I cannot reproduce this, as long as I have the same session. 🤔

How long was it before the last re-loading and init? Could it be that it force the old session to expire?

@xingyaoww
Copy link
Collaborator Author

xingyaoww commented Nov 25, 2024

Could it be that it force the old session to expire?

🤔 that is possible.. I haven't seen these for a while (maybe it is already fixed in some PR?) - maybe we can close this for now since we cannot repro.

@enyst
Copy link
Collaborator

enyst commented Nov 29, 2024

There has been a recent removal of the code that was forcing expiration of session in 10 minutes or so, and multiple session fixes.

Let's close this issue, but I'll keep an eye on this kind of thing.

@enyst enyst closed this as completed Nov 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working severity:medium Affecting multiple users
Projects
None yet
Development

No branches or pull requests

3 participants