外文文献网络爬虫原文Keyword query based focused Web crawler.pdf

AAvailable onlinne at m ScieenceDirrect Available online at Procedia Compputer Science 00 ((2018) 000–000 ScienceDirect /locate/proceedia Procedia Computer Science 125 (2018) 584–590 6th Internaational Confference on SSmart Compputing and CCommunicaations, ICSCCC 2017, 7--8 Decemmber 2017, KKurukshetraa, India Keywword querry basedd focusedd Web crawler a aa a a MManish Kummar* , Ankkit Bindal , Robin Gaautam , Rajajesh Bhatiaa PEC Univerrsity of Technologgy, Chandigarh, IIndia 160012 Absttract Findiing informationn on Web is a ddifficult and chaallenging task bbecause of the eextremely largee volume of data. Search enginne can be ussed to facilitatee this task, but iit is still difficuult to cover all thhe webpages prresent on Web. This paper prooposes a query based crawwler where a sett of keywords rrelevant to the topic of interesst of the user iss used to shoott queries on seaarch interface. TThese searcch interfaces aree found on webbpage of the weebsite corresponnding to seed UURL. This helps crawler to geet most relevantt links fromm the domain wwithout actuallyy going in deppth of that dommain. No existiing focused craawling approacch uses query based approoach to find weebpages of interrest. In the propposed crawler, llist of keywordds is passed to thhe search queryy interfaces fouund on the wwebsites. The pproposed work