Unsupervised Spam Detection by Document Probability Estimation with Maximal Overlap Method
スポンサーリンク
概要
- 論文の詳細を見る
In this paper, we study content-based spam detection for spams that are generated by copying a seed document with some random perturbations. We propose an unsupervised detection algorithm based on an entropy-like measure called document complexity, which reflects how many similar documents exist in the input collection of documents. As the document complexity, however, is an ideal measure like Kolmogorov complexity, we substitute an estimated occurrence probability of each document for its complexity. We also present an efficient algorithm that estimates the probabilities of all documents in the collection in linear time to its total length. Experimental results showed that our algorithm especially works well for word salad spams, which are believed to be difficult to detect automatically.
論文 | ランダム
- 平成二十年度の東亜医学協会賞授賞式の報告
- 編集委員長拝命の弁
- 1a-PS-6 Cr_2Te_3の磁気共鳴
- K-Ar and ^Ar/^Ar phengite ages of Sanbagawa schist clasts from the Kuma Group, central Shikoku, southwest Japan
- Visual Basic 上における簡易型BASIC言語の開発