Analysis and improvement of HITS algorithm for detecting Web communities

S. Nomura, S. Oyama, T. Hayamizu, T. Ishida

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

We discuss problems with the HITS (Hyperlink-Induced Topic Search) algorithm, which capitalizes on hyperlinks to extract topic-bound communities of Web pages. Despite its theoretically sound foundations, we observed that the HITS algorithm has failed in real applications. In order to understand this problem, we developed a visualization tool LinkViewer, which graphically presents the extraction process. This tool helped reveal that a large and densely linked set of unrelated Web pages in the base set impeded the extraction. These pages were obtained when the root set was expanded into the base set. As a remedy to this topic drift problem, prior studies applied a textual analysis method. We propose two methods which only utilize the structural information of the Web: 1) the projection method, which projects eigenvectors on the root subspace, so that most elements in the root set will be relevant to the original topic; and 2) the base-set downsizing method, which filters out the pages without links to multiple pages in the root set. These methods are shown to be robust for broader types of topic and low in computation cost.

Original languageEnglish
Title of host publicationProceedings - 2002 Symposium on Applications and the Internet, SAINT 2002
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages132-140
Number of pages9
ISBN (Electronic)0769514472, 9780769514475
DOIs
Publication statusPublished - 2002 Jan 1
Externally publishedYes
EventSymposium on Applications and the Internet, SAINT 2002 - Nara City, Japan
Duration: 2002 Jan 282002 Feb 1

Publication series

NameProceedings - 2002 Symposium on Applications and the Internet, SAINT 2002

Other

OtherSymposium on Applications and the Internet, SAINT 2002
CountryJapan
CityNara City
Period02/1/2802/2/1

Keywords

  • Algorithm design and analysis
  • Computational efficiency
  • Data mining
  • Impedance
  • Informatics
  • Information filtering
  • Information filters
  • Visualization
  • Web pages
  • Web sites

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Analysis and improvement of HITS algorithm for detecting Web communities'. Together they form a unique fingerprint.

  • Cite this

    Nomura, S., Oyama, S., Hayamizu, T., & Ishida, T. (2002). Analysis and improvement of HITS algorithm for detecting Web communities. In Proceedings - 2002 Symposium on Applications and the Internet, SAINT 2002 (pp. 132-140). [994467] (Proceedings - 2002 Symposium on Applications and the Internet, SAINT 2002). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SAINT.2002.994467