Recycling Translations Extraction of Lexical Data from Parallel Corpora and their Application in Natural Language Processing Jörg Tiedemann Download Fulltext: [PDF] [HTML] Errata: [PDF] [HTML] Spikningsblad: [PDF] [HTML] LaTeX style sheet: [mall.tar.gz] [info]

Abstract

The focus of this thesis is on re-using translations in natural language processing. It involves the collection of documents and their translations in an appropriate format, the automatic extraction of translation data, and the application of the extracted data to different tasks in natural language processing.

Five parallel corpora containing more than 35 million words in 60 languages have been collected within co-operative projects. All corpora are sentence aligned and parts of them have been analyzed automatically and annotated with linguistic markup.

Lexical data are extracted from the corpora by means of word alignment. Two automatic word alignment systems have been developed, the Uppsala Word Aligner (UWA) and the Clue Aligner. UWA implements an iterative "knowledge-poor" word alignment approach using association measures and alignment heuristics. The Clue Aligner provides an innovative framework for the combination of statistical and linguistic resources in aligning single words and multi-word units. Both aligners have been applied to several corpora. Detailed evaluations of the alignment results have been carried out for three of them using fine-grained evaluation techniques.

A corpus processing toolbox, Uplug, has been developed. It includes the implementation of UWA and is freely available for research purposes. A new version, Uplug II, includes the Clue Aligner. It can be used via an experimental web interface (UplugWeb).

Lexical data extracted by the word aligners have been applied to different tasks in computational lexicography and machine translation. The use of word alignment in monolingual lexicography has been investigated in two studies. In a third study, the feasibility of using the extracted data in interactive machine translation has been demonstrated. Finally, extracted lexical data have been used for enhancing the lexical components of two machine translation systems.

Spikning

Spikningsfika

---

Länkar

• Jörg's homepage
• Software and web interfaces:
  • UplugWeb
  • PWA
• Projects:
  • The PLUG project
  • The MATS project
  • The KOMA project
  • Translation and Interpreting. A Meeting between Language and Culture
    (Contrastive Lexicology and Recognition of Translation Equivalents)
  • The OPUS project
  • The Scania project

---

LaTeX style sheet

download: [mall.tar.gz]

How to use the style sheet:

• download the style sheet archive
• unpack the archive
  

  tar xzf mall.tar.gz

• edit the following files:
  • tex/BiblioInfo.tex
  • tex/AbstractPage.tex
  • tex/AbstractPage.tex
  • tex/Dedication.tex
  • tex/Acknowledgements.tex
  • tex/Summary.tex
• put your references into tex/References.bib
• run pdflatex, bibtex, etc.
  

      cd tex
      pdflatex ComprehensiveSummary
      bibtex ComprehensiveSummary
      pdflatex ComprehensiveSummary
      pdflatex ComprehensiveSummary
      

• hopefully you'll have a pdf-file like this by now
• uncomment/comment the following lines in tex/ComprehensiveSummary.tex

  \usepackage[cam,a4,center,pdftex]{crop}
  

  if you want crop marks or not

  \usepackage[colorlinks=true]{hyperref}

  if you want colored links in your pdf-file or not

  \usepackage{pdfdraftcopy}

  if you want to produce a draft copy with a watermark on each page

If you intend to write a comprehensive summary thesis do this:

• uncomment the line \input{ListOfPapers.tex} from the file tex/ComprehensiveSummary.tex
• add references (using \nocite{}) to your papers to the file tex/ListOfPapers.tex
• do the same as above for producing the pdf-file

There's also a style sheet for the "spikblad":

• edit tex/spikblad.tex
• run

  pdflatex tex/spikblad

---