Web structure in 2005

Yu Hirate, Shin Kato, Hayato Yamana

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    8 Citations (Scopus)

    Abstract

    The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the "CORE," the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.

    Original languageEnglish
    Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Pages36-46
    Number of pages11
    Volume4936 LNCS
    DOIs
    Publication statusPublished - 2008
    Event4th International Workshop on Algorithms and Models for the Web-Graph, WAW 2006 - Banff, AB
    Duration: 2006 Nov 302006 Dec 1

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume4936 LNCS
    ISSN (Print)03029743
    ISSN (Electronic)16113349

    Other

    Other4th International Workshop on Algorithms and Models for the Web-Graph, WAW 2006
    CityBanff, AB
    Period06/11/3006/12/1

    Fingerprint

    World Wide Web
    Internet
    Websites
    Servers
    Web Server
    Tie
    Estimate

    ASJC Scopus subject areas

    • Computer Science(all)
    • Biochemistry, Genetics and Molecular Biology(all)
    • Theoretical Computer Science

    Cite this

    Hirate, Y., Kato, S., & Yamana, H. (2008). Web structure in 2005. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4936 LNCS, pp. 36-46). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4936 LNCS). https://doi.org/10.1007/978-3-540-78808-9_4

    Web structure in 2005. / Hirate, Yu; Kato, Shin; Yamana, Hayato.

    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4936 LNCS 2008. p. 36-46 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4936 LNCS).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Hirate, Y, Kato, S & Yamana, H 2008, Web structure in 2005. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 4936 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4936 LNCS, pp. 36-46, 4th International Workshop on Algorithms and Models for the Web-Graph, WAW 2006, Banff, AB, 06/11/30. https://doi.org/10.1007/978-3-540-78808-9_4
    Hirate Y, Kato S, Yamana H. Web structure in 2005. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4936 LNCS. 2008. p. 36-46. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-540-78808-9_4
    Hirate, Yu ; Kato, Shin ; Yamana, Hayato. / Web structure in 2005. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4936 LNCS 2008. pp. 36-46 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
    @inproceedings{deead6cdcc08482182727c162428ff81,
    title = "Web structure in 2005",
    abstract = "The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the {"}CORE,{"} the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.",
    author = "Yu Hirate and Shin Kato and Hayato Yamana",
    year = "2008",
    doi = "10.1007/978-3-540-78808-9_4",
    language = "English",
    isbn = "3540788077",
    volume = "4936 LNCS",
    series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    pages = "36--46",
    booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

    }

    TY - GEN

    T1 - Web structure in 2005

    AU - Hirate, Yu

    AU - Kato, Shin

    AU - Yamana, Hayato

    PY - 2008

    Y1 - 2008

    N2 - The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the "CORE," the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.

    AB - The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the "CORE," the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.

    UR - http://www.scopus.com/inward/record.url?scp=49049111137&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=49049111137&partnerID=8YFLogxK

    U2 - 10.1007/978-3-540-78808-9_4

    DO - 10.1007/978-3-540-78808-9_4

    M3 - Conference contribution

    SN - 3540788077

    SN - 9783540788072

    VL - 4936 LNCS

    T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    SP - 36

    EP - 46

    BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    ER -