Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider computing German fluency without translating to English #78

Open
ischender opened this issue Jan 21, 2024 · 0 comments
Open

Consider computing German fluency without translating to English #78

ischender opened this issue Jan 21, 2024 · 0 comments

Comments

@ischender
Copy link
Contributor

As per comment thread here: #69 (comment) :

At the moment, we translate to English before computing fluency. German and English are similar enough that, in the tests I ran, it works better than using not-so-great models specifically for German (eg: something not very grammatical would get a 0.3... fluency score if translated, and a 0.9 using the model).

It could be useful to find/train models that calculate fluency for German without translating, since translation of course loses some of the grammatical fluency bits.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant