Welcome to OCELoT!

OCELoT stands for Open, Competitive Evaluation Leaderboard of Translations. This project started as part of the Fifth Machine Translation Marathon in the Americas. Project OCELoT aims to create an open platform for competitive evaluation of machine translation output, based on both automatic metrics and human evalation. It has been used for several shared tasks, including the WMT General MT Task since 2020 as well as IWSLT shared tasks. Code is available from GitHub and shared under an open license.

Download test sets Register your team Create submission Competition updates

Competitions

# Competition Test sets Submissions Start time Deadline
1 WMT26: Multitask LLMs with Limited Resources 0 0 June 29, 2026, 11:59 p.m. July 21, 2026, 6 a.m.
2 WMT26: General MT 1 26 June 22, 2026, 11:59 p.m. July 3, 2026, noon

All times in UTC timezone.