Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Auto-split batches for retranslation #127

Open
machinewrapped opened this issue Feb 27, 2024 · 0 comments
Open

Auto-split batches for retranslation #127

machinewrapped opened this issue Feb 27, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@machinewrapped
Copy link
Owner

I've found that GPT is much more likely to desync with larger batches, and splitting the batch in two and retranslating almost always fixes the problem. It would make sense from a usability and economic perspective to do this automatically when batch validation fails.

Splitting the lines in two at the longest gap should be a reasonable approach (perhaps weighted according to proximity to the midpoint - splitting off one or two lines probably won't help).

@machinewrapped machinewrapped added the enhancement New feature or request label Feb 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant