chapter01-part3-webmining_网络挖掘概述.ppt

网络挖掘综述 朱廷劭（Zhu, Tingshao） Web Mining Web mining - data mining techniques to automatically discover and extract information from Web documents/services (Etzioni, 1996). Web mining research – integrate research from several research communities (Kosala and Blockeel, July 2000) such as: Database (DB) Information retrieval (IR) The sub-areas of machine learning (ML) Natural language processing (NLP) Web Mining : Subtasks Resource Finding Task of retrieving intended web-documents Information Selection Pre-processing Automatic selection and pre-processing specific information from retrieved web resources Generalization Automatic Discovery of patterns in web sites Analysis Validation and / or interpretation of mined patterns Mining the World-Wide Web WWW is huge, widely distributed, global information source for Information services: news, advertisements, consumer information, financial management, education, government, e-commerce, etc. Hyper-link information Access and usage information Web Site contents and Organization Mining the World-Wide Web Growing and changing very rapidly Broad diversity of user communities Only a small portion of the information on the Web is truly relevant or useful to Web users How to find high-quality Web pages on a specified topic? WWW provides rich sources for data mining Challenges on WWW Interactions Finding Relevant Information Creating knowledge from Information available Personalization of the information Learning about customers / individual users Web Mining can play an important Role! Web Mining: more challenging Searches for Web access patterns Web structures Regularity and dynamics of Web contents Problems The “abundance” problem Limited coverage of the Web: hidden Web sources, majority of data in DBMS Limited query interface based on keyword-oriented search Limited customization to individual users