Research of Specific Information Recognition in MultiCarrier Data Streams.pdfVIP

1000-9825/2003/14(09)1538 ©2003 Journal of Software 软 件 学 报 Vol.14, No.9 多载体数据流中的特定信息识别研究∗ 郑德权, 胡 熠, 于 浩, 赵铁军, 王青松 (哈尔滨工业大学 计算机科学与技术学院,黑龙江 哈尔滨 150001) Research of Specific Information Recognition in Multi-Carrier Data Streams ZHENG De-Quan, HU Yi, YU Hao, ZHAO Tie-Jun, WANG Qing-Song (School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China) Corresponding author: Phn: 86-451-6416225 ext 604, Fax: 86-451-6412449, E-mail: zdq@ Received 2002-06-24; Accepted 2003-03-25 Zheng DQ, Hu Y, Yu H, Zhao TJ, Wang QS. Research of specific information recognition in multi-carrier data streams. Journal of Software, 2003,14(9):1538~1543. /1000-9825/14/1538.htm Abstract: A method is presented to identify some pieces of specific information in multi-carrier data streams by feature words and based on PinYin matching. An effective knowledge approximation method is used to ju dge the relation between feature words and context by statistics theory. The part of speech transfer-value as system knowledge can be obtained by inductive learning of training corpus. When data streams are evaluated, the evaluation value can be gained according to the system knowledge by matching all feature words and based on their PinYin, which examines the comparability with context regular of part of speech between all feature words in data streams and themselves in training corpus. Further more, if the evaluation value exceeds the threshold, the data streams will be shielded. Experimental results show that the effect of the experiment system based on this method is efficient for identifying ill information and monitoring controlling their spreading by multi-carrier data streams. Key words: information identification; knowledge approximation; part of speech transition; inductive lear