Downloads: 112 | Views: 219
Research Paper | Computer Science & Engineering | India | Volume 4 Issue 4, April 2015 | Popularity: 6.1 / 10
Web Crawler: Essential Component of Search Engine
Akshada K. Dhakade, Deepak C. Dhanwani
Abstract: With the vast growth of the Internet, many web pages are available online. Search engines use a component called as web crawlers for collecting these web pages from the web for storage and indexing. Many web pages are autonomous and are updated independent of the users. As the web pages are updated autonomously, users do not come to know of how often the sources change. Web crawler is the central part of the search engine which browses through the hyperlinks and stores the visited links for the future use. This paper represents concepts of web crawlers, its architecture and its various types.
Keywords: Search Engine, Web Crawler, Crawler Policies, Techniques
Edition: Volume 4 Issue 4, April 2015
Pages: 1471 - 1474
Similar Articles
Downloads: 2 | Weekly Hits: ⮙1 | Monthly Hits: ⮙2
Analysis Study Research Paper, Computer Science & Engineering, India, Volume 11 Issue 12, December 2022
Pages: 1353 - 1362Dynamic Search Bar for Real-Time Product Generation and Personalization
Venkata Naga Sai Kiran Challa
Downloads: 3 | Weekly Hits: ⮙2 | Monthly Hits: ⮙2
Survey Paper, Computer Science & Engineering, India, Volume 10 Issue 6, June 2021
Pages: 716 - 720A Comprehensive Study of Elasticsearch
Nikita Kathare, O. Vinati Reddy, Dr. Vishalakshi Prabhu
Downloads: 47
Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 10, October 2016
Pages: 1554 - 1557Paid and Non-Paid Marketing Strategies for Search Engine Optimization
Elton D'souza, Gursheen Grewal, Divya Unnikrishnan, Neelam Phadnis
Downloads: 69 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 12, December 2020
Pages: 890 - 894A Survey on Types of Crawlers and Web Searching Algorithms
T. Yogameera, Dr. D. Shanthi
Downloads: 97
Review Papers, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 1191 - 1194Web Data Extraction by Using Trinity
Sayali Khodade, Nilav Mukharjee