TextCat is an implementation of the text categorization algorithm presented in Cavnar, W. B. and J. M. Trenkle, ``N-Gram-Based Text Categorization'' In Proceedings of Third Annual Symposium on Document Analysis and Information Retrieval, Las Vegas, NV, UNLV Publications/Reprographics, pp. 161-175, 11-13 April 1994.

via Idle words

Another point in a debate that seems to ensue about meta-info vs. categorizing content by it's nature. This script uses N_Grams to identify about 69 natural languages

[ by Martin>] [permalink] [similar entries]

similar entries (vs):

• libTextCat - Lightweight text categorization (# 15%)
• Idle Words (# 11%)
• Idle Words at it again (# 9%)
• the NITLE blog census (# 8%)

similar entries (cg):

• Compression Analysis (# 4%)
• CRM-114 (# 3%)
• Maciej's Etech slides on LSI (# 2%)
• Even thoughts can turn genes 'on' and 'off' (# 1%)
• why keep the info in a date heirarchy? (# 1%)

Martin Spernau
© 1994-2003

Big things to come (TM) 30th Dez 2002