Task Overview
The tables below present results for both challenge tracks with either the constrained language model (Ranking A) or the unconstrained language model (Ranking B).
Track 1, Ranking A (constrained LM)
Rank | Team | Paper | Dev | Eval |
---|---|---|---|---|
USTC | [paper] | 31.11 | 30.96 | |
Institute of Acoustics, CAS | [paper] | 33.55 | 35.11 | |
STC-innovations Ltd, ITMO University | [paper] | 33.53 | 35.79 | |
Toshiba Cambridge Research Laboratory | [paper] | 35.89 | 37.54 | |
Qdreamer | [paper] | 37.59 | 39.00 | |
Cloudwalk-XMU | [paper] | 41.56 | 40.24 | |
Johns Hopkins University | [paper] | 41.75 | 42.07 | |
OPPO | [paper] | 41.99 | 42.41 | |
Brno University of Technology | [paper] | 42.75 | 44.34 | |
Academia Sinica | [paper] | 47.28 | 46.82 | |
IISC | [paper] | 51.05 | 50.69 | |
Baseline | [paper] | 51.8 | 51.3 |
[TOP]
Track 1, Ranking B (unconstrained LM)
Rank | Team | Paper | Dev | Eval |
---|---|---|---|---|
Qdreamer | [paper] | 35.96 | 37.46 | |
STC-innovations Ltd, ITMO University | [paper] | 30.96 | 33.91 | |
Toshiba Cambridge Research Laboratory | [paper] | 34.83 | 36.83 | |
OPPO | [paper] | 41.18 | 42.02 | |
Johns Hopkins University | [paper] | 40.27 | 40.47 | |
University of Science and Technology of China (USTC) | [paper] | 30.78 | 30.51 | |
Brno University of Technology | [paper] | 41.21 | 42.55 | |
Institute of Acoustics, CAS | [paper] | 32.92 | 34.53 | |
CloudWalk-XMU | [paper] | 40.25 | 39.62 | |
Baseline | [paper] | 51.8 | 51.3 |
[TOP]
Track 2, Ranking A (constrained LM)
Rank | Team | Paper | Dev | Eval |
---|---|---|---|---|
City University of New York | [paper] | 76.05 | 72.74 | |
Paderborn University | [paper] | 73.50 | 68.96 | |
STC-innovations Ltd, ITMO University | [paper] | 41.56 | 44.49 | |
Cloudwalk-XMU | [paper] | 77.52 | 72.52 | |
Johns Hopkins University | [paper] | 68.29 | 68.26 | |
University of Science and Technology of China (USTC) | [paper] | 68.22 | 68.48 | |
Brno University of Technology | [paper] | 55.60 | 69.17 | |
Academia Sinica | [paper] | 75.78 | 73.54 | |
Baseline | [paper] | 84.3 | 77.9 |
[TOP]
Track 2, Ranking B (unconstrained LM)
Rank | Team | Paper | Dev | Eval |
---|---|---|---|---|
STC-innovations Ltd, ITMO University | [paper] | 39.56 | 42.67 | |
Johns Hopkins University | [paper] | 67.76 | 67.51 | |
University of Science and Technology of China (USTC) | [paper] | 68.15 | 68.42 | |
Paderborn University | [paper] | 73.05 | 68.45 | |
Brno University of Technology | [paper] | 55.15 | 69.04 | |
Baseline | [paper] | 84.3 | 77.9 |