Prototypes details

  • LID
  • LID is a language identifier for classifying a web page according to the language in which it is written [Silva et al, 2006 and 2007]. It identifies the languages for which it was trained and also identifies if a language us inknkown to it. It works with n-grams of characters that are selected according to their language discriminant value. It is rather robust as it can be trained for very difficult tasks related to language identification, namely for discriminating variants of the same language like Brazilian and European Portuguese.
  • 01 Mar 2007
  • Joaquim Ferreira da Silva, Gabriel Pereira Lopes