Statistical evaluation of measure and distance on document classification problems in text mining

Masayuki Goto; Takashi Ishida; Shigeichi Hirasawa

doi:10.1109/CIT.2007.4385162

Statistical evaluation of measure and distance on document classification problems in text mining

Masayuki Goto^*, Takashi Ishida, Shigeichi Hirasawa

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

4 Citations (Scopus)

Abstract

This paper discusses the document classification problems in text mining from the viewpoint of asymptotic statistical analysis. By formulation of statistical hypotheses test which is specified as a problem of text mining, some interesting properties can be visualized. In the problem of text mining, the several heuristics are applied to practical analysis because of its experimental effectiveness in many case studies. The theoretical explanation about the performance of text mining techniques is required and this approach will give us very clear idea. The distance measure in word vector space is used to classify the documents. In this paper, the performance of distance measure is also analized from the new viewpoint of asymptotic analysis.

Original language	English
Title of host publication	CIT 2007
Subtitle of host publication	7th IEEE International Conference on Computer and Information Technology
Pages	674-679
Number of pages	6
DOIs	https://doi.org/10.1109/CIT.2007.4385162
Publication status	Published - 2007
Externally published	Yes
Event	CIT 2007: 7th IEEE International Conference on Computer and Information Technology - Aizu-Wakamatsu, Fukushima, Japan Duration: 2007 Oct 16 → 2007 Oct 19

Publication series

Name	CIT 2007: 7th IEEE International Conference on Computer and Information Technology

Conference

Conference	CIT 2007: 7th IEEE International Conference on Computer and Information Technology
Country/Territory	Japan
City	Aizu-Wakamatsu, Fukushima
Period	07/10/16 → 07/10/19

ASJC Scopus subject areas

Computer Science Applications
Information Systems
Software
Mathematics(all)

Access to Document

10.1109/CIT.2007.4385162

Cite this

Goto, M., Ishida, T., & Hirasawa, S. (2007). Statistical evaluation of measure and distance on document classification problems in text mining. In CIT 2007: 7th IEEE International Conference on Computer and Information Technology (pp. 674-679). [4385162] (CIT 2007: 7th IEEE International Conference on Computer and Information Technology). https://doi.org/10.1109/CIT.2007.4385162

Statistical evaluation of measure and distance on document classification problems in text mining. / Goto, Masayuki; Ishida, Takashi; Hirasawa, Shigeichi.

CIT 2007: 7th IEEE International Conference on Computer and Information Technology. 2007. p. 674-679 4385162 (CIT 2007: 7th IEEE International Conference on Computer and Information Technology).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Goto, M, Ishida, T & Hirasawa, S 2007, Statistical evaluation of measure and distance on document classification problems in text mining. in CIT 2007: 7th IEEE International Conference on Computer and Information Technology., 4385162, CIT 2007: 7th IEEE International Conference on Computer and Information Technology, pp. 674-679, CIT 2007: 7th IEEE International Conference on Computer and Information Technology, Aizu-Wakamatsu, Fukushima, Japan, 07/10/16. https://doi.org/10.1109/CIT.2007.4385162

@inproceedings{07f599ff8e5542bbad04cb5cd252a796,

title = "Statistical evaluation of measure and distance on document classification problems in text mining",

abstract = "This paper discusses the document classification problems in text mining from the viewpoint of asymptotic statistical analysis. By formulation of statistical hypotheses test which is specified as a problem of text mining, some interesting properties can be visualized. In the problem of text mining, the several heuristics are applied to practical analysis because of its experimental effectiveness in many case studies. The theoretical explanation about the performance of text mining techniques is required and this approach will give us very clear idea. The distance measure in word vector space is used to classify the documents. In this paper, the performance of distance measure is also analized from the new viewpoint of asymptotic analysis.",

author = "Masayuki Goto and Takashi Ishida and Shigeichi Hirasawa",

year = "2007",

doi = "10.1109/CIT.2007.4385162",

language = "English",

isbn = "0769529836",

series = "CIT 2007: 7th IEEE International Conference on Computer and Information Technology",

pages = "674--679",

booktitle = "CIT 2007",

note = "CIT 2007: 7th IEEE International Conference on Computer and Information Technology ; Conference date: 16-10-2007 Through 19-10-2007",

}

TY - GEN

T1 - Statistical evaluation of measure and distance on document classification problems in text mining

AU - Goto, Masayuki

AU - Ishida, Takashi

AU - Hirasawa, Shigeichi

PY - 2007

Y1 - 2007

N2 - This paper discusses the document classification problems in text mining from the viewpoint of asymptotic statistical analysis. By formulation of statistical hypotheses test which is specified as a problem of text mining, some interesting properties can be visualized. In the problem of text mining, the several heuristics are applied to practical analysis because of its experimental effectiveness in many case studies. The theoretical explanation about the performance of text mining techniques is required and this approach will give us very clear idea. The distance measure in word vector space is used to classify the documents. In this paper, the performance of distance measure is also analized from the new viewpoint of asymptotic analysis.

AB - This paper discusses the document classification problems in text mining from the viewpoint of asymptotic statistical analysis. By formulation of statistical hypotheses test which is specified as a problem of text mining, some interesting properties can be visualized. In the problem of text mining, the several heuristics are applied to practical analysis because of its experimental effectiveness in many case studies. The theoretical explanation about the performance of text mining techniques is required and this approach will give us very clear idea. The distance measure in word vector space is used to classify the documents. In this paper, the performance of distance measure is also analized from the new viewpoint of asymptotic analysis.

UR - http://www.scopus.com/inward/record.url?scp=38049023026&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=38049023026&partnerID=8YFLogxK

U2 - 10.1109/CIT.2007.4385162

DO - 10.1109/CIT.2007.4385162

M3 - Conference contribution

AN - SCOPUS:38049023026

SN - 0769529836

SN - 9780769529837

T3 - CIT 2007: 7th IEEE International Conference on Computer and Information Technology

SP - 674

EP - 679

BT - CIT 2007

T2 - CIT 2007: 7th IEEE International Conference on Computer and Information Technology

Y2 - 16 October 2007 through 19 October 2007

ER -

Statistical evaluation of measure and distance on document classification problems in text mining

Abstract

Publication series

Conference

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this