Web structure in 2005

Yu Hirate; Shin Kato; Hayato Yamana

doi:10.1007/978-3-540-78808-9_4

Web structure in 2005

Yu Hirate^*, Shin Kato, Hayato Yamana

^*Corresponding author for this work

School of Fundamental Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

9 Citations (Scopus)

Abstract

The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the "CORE," the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.

Original language	English
Title of host publication	Algorithms and Models for the Web-Graph - Fourth International Workshop, WAW 2006, Revised Papers
Pages	36-46
Number of pages	11
DOIs	https://doi.org/10.1007/978-3-540-78808-9_4
Publication status	Published - 2008
Event	4th International Workshop on Algorithms and Models for the Web-Graph, WAW 2006 - Banff, AB, Canada Duration: 2006 Nov 30 → 2006 Dec 1

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	4936 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	4th International Workshop on Algorithms and Models for the Web-Graph, WAW 2006
Country/Territory	Canada
City	Banff, AB
Period	06/11/30 → 06/12/1

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-540-78808-9_4

Cite this

Hirate, Y., Kato, S., & Yamana, H. (2008). Web structure in 2005. In Algorithms and Models for the Web-Graph - Fourth International Workshop, WAW 2006, Revised Papers (pp. 36-46). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4936 LNCS). https://doi.org/10.1007/978-3-540-78808-9_4

Web structure in 2005. / Hirate, Yu; Kato, Shin; Yamana, Hayato.

Algorithms and Models for the Web-Graph - Fourth International Workshop, WAW 2006, Revised Papers. 2008. p. 36-46 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4936 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Hirate, Y, Kato, S & Yamana, H 2008, Web structure in 2005. in Algorithms and Models for the Web-Graph - Fourth International Workshop, WAW 2006, Revised Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4936 LNCS, pp. 36-46, 4th International Workshop on Algorithms and Models for the Web-Graph, WAW 2006, Banff, AB, Canada, 06/11/30. https://doi.org/10.1007/978-3-540-78808-9_4

@inproceedings{deead6cdcc08482182727c162428ff81,

title = "Web structure in 2005",

abstract = "The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the {"}CORE,{"} the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.",

author = "Yu Hirate and Shin Kato and Hayato Yamana",

year = "2008",

doi = "10.1007/978-3-540-78808-9_4",

language = "English",

isbn = "3540788077",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "36--46",

booktitle = "Algorithms and Models for the Web-Graph - Fourth International Workshop, WAW 2006, Revised Papers",

note = "4th International Workshop on Algorithms and Models for the Web-Graph, WAW 2006 ; Conference date: 30-11-2006 Through 01-12-2006",

}

TY - GEN

T1 - Web structure in 2005

AU - Hirate, Yu

AU - Kato, Shin

AU - Yamana, Hayato

PY - 2008

Y1 - 2008

N2 - The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the "CORE," the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.

AB - The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the "CORE," the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.

UR - http://www.scopus.com/inward/record.url?scp=49049111137&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=49049111137&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-78808-9_4

DO - 10.1007/978-3-540-78808-9_4

M3 - Conference contribution

AN - SCOPUS:49049111137

SN - 3540788077

SN - 9783540788072

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 36

EP - 46

BT - Algorithms and Models for the Web-Graph - Fourth International Workshop, WAW 2006, Revised Papers

T2 - 4th International Workshop on Algorithms and Models for the Web-Graph, WAW 2006

Y2 - 30 November 2006 through 1 December 2006

ER -

Web structure in 2005

Abstract

Publication series

Conference

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this