MT Quality Evaluation Toolbox

MT Quality Evaluation Toolbox is a Java program for evaluation of translation quality, and meta-evaluation of evaluation measures. You may download, install and use it, but you do so at your own risk.

The first (and current) prototype, version 0.001a, was developed in 2007 by Eva Forsbom in the context of the KOMA project (Corpus-based machine translation) and the GSLT course Java and HLT. It has limited functionality sofar, and the API is not yet fixed, but what is there could still be useful.

There is a design document describing the purpose of the program, the overall design decisions, the possible use cases etc. It also describes a sample run, giving screenshots of the program.

In the program package, there is a README file giving installation and usage instructions. Included are also some sample data, and a bundle of Java documentation (only useful for developers, and only when the API has settled).

System requirements: Sun's J2SE SDK 1.4.2 (or later?) and Linux. It probably works on other systems as well, but it has only been tested for Linux. It might work with other SDKs as well, but the Swing and XML handling might make it difficult.

Known bugs: When installing, you have to quit after setting the measure directory, and then restart the program again before you can do any evaluation.

Download