Downloads: 114 | Views: 320
Research Paper | Computer Science | India | Volume 2 Issue 9, September 2013 | Popularity: 6.2 / 10
Focused Crawling System based on Improved LSI
Radhika Gupta, AP Nidhi
Abstract: In this research work we have developed a semi-deterministic algorithm and a scoring system that takes advantage of the Latent Semantic indexing scoring system for crawling web pages that belong to particular domain or is specific to the topic. The proposed algorithm calculates a preference factor in addition to the LSI score to determine which web page needs to preferred for crawling by the multi threaded crawler application, by doing this we were able to produce a retrieval system that has high recall and precision values as it builds a queue which is specific to a particular domain/topic which would not have been possible in Breath first and only LSI based information retrieval systems.
Keywords: LSI, Breath first crawler, focused crawler
Edition: Volume 2 Issue 9, September 2013
Pages: 61 - 64
Make Sure to Disable the Pop-Up Blocker of Web Browser