Skip to content

v0.4.3 : WMT25 #166

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
thammegowda merged 15 commits into from
Mar 31, 2025
Merged

v0.4.3 : WMT25 #166

thammegowda merged 15 commits into from
Mar 31, 2025

Conversation

@thammegowda
Copy link
Owner

@thammegowda thammegowda commented Mar 12, 2025 •
edited
Loading

New features

  • Support datasets from huggingface (e.g. wmt24++)
  • Preliminary support for meta fields, including doc_id, domain, seg_id
  • mtdata score supports QE scoring. Currently supports pymarian, however designed to integrate other scorers via CLI.
  • mtdata.map is an optimized subprocess based mapper that can be used to score many small files using a single subprocess, thus reducing number of times a QE model is loaded

House keeping

  • setup.py -> pyproject.toml; support optional dependencies
  • huggingface datasets as optional dependency
  • mtdata index sub command; deprecate mtdata --re-index <cmd>

thammegowda and others added 15 commits March 10, 2025 05:39
@thammegowda
huggingface datasets; index subcommand; WIP docid meta
055aa7e
@thammegowda
setup.py -> pyproject.toml; huggingface datasets as optional dependency
f3d34d1
@thammegowda
set version 0.4.3-dev and update changelog
e78e756
@thammegowda
Merge pull request #165 from thammegowda/tg/hf-datasets
faa0e80 
Huggingface datasets; optional dependency; setup.py -> pyproject.toml
@thammegowda
add wmt24 and wmt25 constrained recipes
885eaf0
@thammegowda
fix python versions in GH workflow; add 3.11 and 3.12
0e4a85f
@thammegowda
Merge branch 'main' into wmt25
6fb0712
@thammegowda
upgrade GH actions python versions (#167)
1605d0f
@thammegowda
metadata/ docid creation for "get" and "get-recipe" commands
3e8dc78
@thammegowda
Update OPUS index
f4a83c3
@thammegowda
"mtdata score" -- score QE metrics; pymarian integration (#168)
eccfefa 
* mtdata score: qe scoring via pymarian

* scorer: fix minor issues

* add mapper for mapping many small files with single subprocess

* mtdata score: optimize using streamlining all parts

* minor fixes
@thammegowda
Fix: NTREX paths inside tarball: _ -> -; improve error message
5cf8fbe
@thammegowda
Simnplify scorer interface. support any subproces command
c18c688
@thammegowda
Add MTDataUserError; simplify error messages
c37f511
@thammegowda
version 0.4.3
454654f
@thammegowda thammegowda merged commit 35c7a6f into main Mar 31, 2025
8 of 10 checks passed
@thammegowda thammegowda changed the title [WIP] v0.4.3 : WMT25 v0.4.3 : WMT25 Mar 31, 2025
@thammegowda thammegowda deleted the wmt25 branch April 27, 2025 20:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@thammegowda