Merge LM-Eval dev branch#337

Merged

ruivieira merged 26 commits intomainfrom

Oct 22, 2024

Commits on Jul 24, 2024

Add lm-eval-service controller (#258)

yhwang
and
ruivieira
authored

Commits on Jul 26, 2024

fix: Fix typo in operator's arguments (#261)
ruivieira
authored

Commits on Aug 5, 2024

Commits on Aug 23, 2024

Weekly sync up of dev/lm-eval branch (#278)

authored

Commits on Aug 27, 2024

Commits on Aug 29, 2024

Commits on Aug 30, 2024

Change job image use midstream lm-evaluation-harness (#285)
ruivieira
authored

Commits on Sep 12, 2024

Commits on Sep 17, 2024

fix: fix dependency error in the job image (#296)
yhwang
authored

Commits on Sep 20, 2024

feat: add device detection in lmes driver (#298)
yhwang
authored

Commits on Sep 24, 2024

feat: support unitxt recipes (#301)
yhwang
authored

Commits on Oct 9, 2024

feat: support custom dataset (#309)
yhwang
authored

Commits on Oct 13, 2024

feat: new pulling mechanism for job statuses (#314)
yhwang
authored

Commits on Oct 14, 2024

Commits on Oct 18, 2024

Fix mkdir command in Job dockerfile (#330)
RobGeada
authored

Commits on Oct 19, 2024

Commits on Oct 21, 2024

Commits on Oct 22, 2024

Merge branch 'main' into dev/lm-eval
ruivieira
committed