Welcome to OCELoT!

OCELoT stands for Open, Competitive Evaluation Leaderboard of Translations. This project started as part of the Fifth Machine Translation Marathon in the Americas. Project OCELoT aims to create an open platform for competitive evaluation of machine translation output, based on both automatic metrics and human evalation. It has been used for several shared tasks, including the WMT General MT Task since 2020 as well as IWSLT shared tasks. Code is available from GitHub and shared under an open license.

Download test sets Register your team Create submission Competition updates

Competitions

# Competition Test sets Submissions Start time Deadline
1 WMT25: Slavic LLMs for MT & QA 7 9 June 30, 2025, 11:59 p.m. July 23, 2025, 11:59 a.m.
2 WMT25: General MT 1 111 June 19, 2025, 11:59 p.m. July 4, 2025, 6 p.m.
3 WMT25: Multilingual Instruction 1 6 June 19, 2025, 11:59 p.m. July 4, 2025, 11:59 a.m.

All times in UTC timezone.