A Methodology for Performance Evaluation of Web Robots


The KIPS Transactions:PartD, Vol. 11, No. 3, pp. 563-570, Jun. 2004
10.3745/KIPSTD.2004.11.3.563,   PDF Download:

Abstract

As the use of the Internet becomes more popular, a huge amount of information is published on the Web, and users can access the information effectively with Web search services. Since Web search services retrieve relevant documents from those collected by Web robots, we need to improve the crawling quality of Web robots. In this paper, we suggest evaluation criteria for Web robots such as efficiency, continuity, freshness, coverage, silence, uniqueness and safety, and present various functions to improve the performance of Web robots. We also investigate the functions implemented in the conventional Web robots of NAVER, Google, AltaVista etc. It is expected that this study could contribute the development of more effective Web robots.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from September 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[IEEE Style]
K. H. Kim and J. H. Lee, "A Methodology for Performance Evaluation of Web Robots," The KIPS Transactions:PartD, vol. 11, no. 3, pp. 563-570, 2004. DOI: 10.3745/KIPSTD.2004.11.3.563.

[ACM Style]
Kwang Hyun Kim and Joon Ho Lee. 2004. A Methodology for Performance Evaluation of Web Robots. The KIPS Transactions:PartD, 11, 3, (2004), 563-570. DOI: 10.3745/KIPSTD.2004.11.3.563.