A Machine Learning Approach to Knowledge Acquisitions from Text Databases

Yasubumi Sakakibara, Kazuo Misue, Takeshi Koshiba

Research output: Contribution to journalArticle

Abstract

The rapid growth of data in large databases, such as text databases and scientific databases, requires efficient computer methods for automating analyses of the data with the goal of acquiring knowledges or making discoveries. Because the analyses of data are generally so expensive, most parts in databases remains as raw, unanalyzed primary data. Technology from machine learning (ML) will offer efficient tools for the intelligent analyses of the data using generalization ability. Generalization is an important ability specific to inductive learning that will predict unseen data with high accuracy based on learned concepts from training examples. In this article, we apply ML to text-database analyses and knowledge acquisitions from text databases. We propose a completely new approach to the problem of text classification and extracting keywords by using ML techniques. We introduce a class of representations for classifying text data based on decision trees; (i.e., decision trees over attributes on strings) and present an algorithm for learning them inductively. Our algorithm has the following features: It does not need any natural language processing technique and it is robust for noisy data. We show that our learning algorithm can be used for automatic extraction of keywords for text retrieval and automatic text categorization. We also demonstrate some experimental results using our algorithm on the problem of classifying bibliographic data and extracting keywords in order to show the effectiveness of our approach.

Original languageEnglish
Pages (from-to)309-324
Number of pages16
JournalPlastics, Rubber and Composites Processing and Applications
Volume8
Issue number3
Publication statusPublished - 1996
Externally publishedYes

Fingerprint

Knowledge acquisition
Learning systems
Decision trees
Learning algorithms
Processing

ASJC Scopus subject areas

  • Engineering(all)

Cite this

A Machine Learning Approach to Knowledge Acquisitions from Text Databases. / Sakakibara, Yasubumi; Misue, Kazuo; Koshiba, Takeshi.

In: Plastics, Rubber and Composites Processing and Applications, Vol. 8, No. 3, 1996, p. 309-324.

Research output: Contribution to journalArticle

@article{ea12abff1d3c43f3b5cc302340feef1f,
title = "A Machine Learning Approach to Knowledge Acquisitions from Text Databases",
abstract = "The rapid growth of data in large databases, such as text databases and scientific databases, requires efficient computer methods for automating analyses of the data with the goal of acquiring knowledges or making discoveries. Because the analyses of data are generally so expensive, most parts in databases remains as raw, unanalyzed primary data. Technology from machine learning (ML) will offer efficient tools for the intelligent analyses of the data using generalization ability. Generalization is an important ability specific to inductive learning that will predict unseen data with high accuracy based on learned concepts from training examples. In this article, we apply ML to text-database analyses and knowledge acquisitions from text databases. We propose a completely new approach to the problem of text classification and extracting keywords by using ML techniques. We introduce a class of representations for classifying text data based on decision trees; (i.e., decision trees over attributes on strings) and present an algorithm for learning them inductively. Our algorithm has the following features: It does not need any natural language processing technique and it is robust for noisy data. We show that our learning algorithm can be used for automatic extraction of keywords for text retrieval and automatic text categorization. We also demonstrate some experimental results using our algorithm on the problem of classifying bibliographic data and extracting keywords in order to show the effectiveness of our approach.",
author = "Yasubumi Sakakibara and Kazuo Misue and Takeshi Koshiba",
year = "1996",
language = "English",
volume = "8",
pages = "309--324",
journal = "Plastics, Rubber and Composites",
issn = "1465-8011",
publisher = "Maney Publishing",
number = "3",

}

TY - JOUR

T1 - A Machine Learning Approach to Knowledge Acquisitions from Text Databases

AU - Sakakibara, Yasubumi

AU - Misue, Kazuo

AU - Koshiba, Takeshi

PY - 1996

Y1 - 1996

N2 - The rapid growth of data in large databases, such as text databases and scientific databases, requires efficient computer methods for automating analyses of the data with the goal of acquiring knowledges or making discoveries. Because the analyses of data are generally so expensive, most parts in databases remains as raw, unanalyzed primary data. Technology from machine learning (ML) will offer efficient tools for the intelligent analyses of the data using generalization ability. Generalization is an important ability specific to inductive learning that will predict unseen data with high accuracy based on learned concepts from training examples. In this article, we apply ML to text-database analyses and knowledge acquisitions from text databases. We propose a completely new approach to the problem of text classification and extracting keywords by using ML techniques. We introduce a class of representations for classifying text data based on decision trees; (i.e., decision trees over attributes on strings) and present an algorithm for learning them inductively. Our algorithm has the following features: It does not need any natural language processing technique and it is robust for noisy data. We show that our learning algorithm can be used for automatic extraction of keywords for text retrieval and automatic text categorization. We also demonstrate some experimental results using our algorithm on the problem of classifying bibliographic data and extracting keywords in order to show the effectiveness of our approach.

AB - The rapid growth of data in large databases, such as text databases and scientific databases, requires efficient computer methods for automating analyses of the data with the goal of acquiring knowledges or making discoveries. Because the analyses of data are generally so expensive, most parts in databases remains as raw, unanalyzed primary data. Technology from machine learning (ML) will offer efficient tools for the intelligent analyses of the data using generalization ability. Generalization is an important ability specific to inductive learning that will predict unseen data with high accuracy based on learned concepts from training examples. In this article, we apply ML to text-database analyses and knowledge acquisitions from text databases. We propose a completely new approach to the problem of text classification and extracting keywords by using ML techniques. We introduce a class of representations for classifying text data based on decision trees; (i.e., decision trees over attributes on strings) and present an algorithm for learning them inductively. Our algorithm has the following features: It does not need any natural language processing technique and it is robust for noisy data. We show that our learning algorithm can be used for automatic extraction of keywords for text retrieval and automatic text categorization. We also demonstrate some experimental results using our algorithm on the problem of classifying bibliographic data and extracting keywords in order to show the effectiveness of our approach.

UR - http://www.scopus.com/inward/record.url?scp=0642343320&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0642343320&partnerID=8YFLogxK

M3 - Article

VL - 8

SP - 309

EP - 324

JO - Plastics, Rubber and Composites

JF - Plastics, Rubber and Composites

SN - 1465-8011

IS - 3

ER -