Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add specific geval metrics to Translation #1212

Open
ividal opened this issue Mar 14, 2025 · 0 comments
Open

Add specific geval metrics to Translation #1212

ividal opened this issue Mar 14, 2025 · 0 comments
Labels

Comments

@ividal
Copy link
Contributor

ividal commented Mar 14, 2025

Specific metrics from geval (coherence, fluency) may also apply to Translation. (The caveat is the target language may not be well supported by the judge model, but this is something we could leave up to the user to understand - or we could highlight via UI or documentation.)

With this issue we'd at least give the option of running geval in translation workflows, which is now not possible. It involves:

@ividal ividal added the backend label Mar 14, 2025
@ividal ividal changed the title Add relevant geval metrics to Translation Add specific geval metrics to Translation Mar 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: No status
Development

No branches or pull requests

1 participant