A Complex Evaluation Architecture for HAREM

  • Nuno Seco
  • Diana Santos
  • Nuno Cardoso
  • Rui Vilela
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3960)


In this paper we briefly describe the evaluation architecture and the measures employed in HAREM, the first evaluation contest for named entity recognition in Portuguese. All programs are publically available for experimentation.


Name Entity Recognition Entity Recognition Partial Alignment Evaluation Architecture Text Genre 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hirschman, L.: The evolution of evaluation: lessons from the message understanding conference. Computer Speech and Language 12(4), 281–305 (1998)CrossRefGoogle Scholar
  2. 2.
    Santos, D., Seco, N., Cardoso, N., Vilela, R.: Harem: An advanced NER evaluation contest for portuguese. In: Proceedings of the 5th International Conference on Language Resources and Evaluation, LREC 2006, Genova, Italy (2006)Google Scholar
  3. 3.
    Grishman, R., Sundheim, B.: Message understanding conference-6: a brief history. In: Proceedings of the 16th conference on Computational linguistics, Morristown, NJ, USA, pp. 466–471. Association for Computational Linguistics (1996)Google Scholar
  4. 4.
    Santos, D., Cardoso, N.: A golden resource for named entity recognition for portuguese. In: Vieira, R., Quaresma, P., Nunes, M.d.G.V., Mamede, N.J., Oliveira, C., Dias, M.C. (eds.) PROPOR 2006. LNCS (LNAI), vol. 3960, pp. 69–79. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    Douthat, A.: The message understanding conference scoring software users manual. In: Proceedings of the 7th Message Understanding Conference, MUC-7 (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Nuno Seco
    • 1
  • Diana Santos
    • 2
  • Nuno Cardoso
    • 3
  • Rui Vilela
    • 4
  1. 1.Linguateca nodes of CoimbraPortugal
  2. 2.Linguateca nodes of CoimbraOsloNorway
  3. 3.Linguateca nodes of CoimbraLisbonPortugal
  4. 4.Linguateca nodes of CoimbraBragaPortugal

Personalised recommendations