A Bayes optimal predicting method of Bayesian network with visualization of causal relationship

Yusuke Takeyama, Takashi Ishida, Masayuki Goto

    Research output: Contribution to journalArticle

    Abstract

    A Bayesian network is one of the useful models for pattern recognition problems and it has the features of both stochastic prediction and causal models. A Bayesian network expresses the causal relationship between variables with directed graphs. Usually the structure of a Bayesian network is statistically estimated using a set of training data and the model selection has been applied in conventional methods when Bayesian network structures were estimated. However, it is not necessary to choose one model for the purpose of prediction. From the viewpoint of Bayesian statistics, it is well known that prediction using the mixture model on model class is Bayes optimal. In general, the mixture model that is given by a weighted sum of all models with the posterior probability on the model class is the Bayes optimal prediction. In this paper, we propose an new Bayes optimal prediction on a Bayesian network model class using the mixture model. A mixture model sometimes becomes a complex expression due to the weighted sum of all models on a model class, and it results in loss of the usefulness as a causal model. Since the easiness of interpretation is one of the merits of a Bayesian network, using a mixed model only for improvement in predictive accuracy may lead to losing the merit of a Bayesian network. Therefore, we propose a new method that is configured with the mixture model utilizing the characteristics of the Bayesian network by organizing model classes properly. Furthermore, we propose a method to quantitatively assess the strength of the causal relationship between the nodes on the mixed Bayesian network model. In addition, the effectiveness of the proposed method is clarified via a numerical experiment on an application to a prediction problem of buying and selling of shares stock market.

    Original languageEnglish
    Pages (from-to)399-408
    Number of pages10
    JournalJournal of Japan Industrial Management Association
    Volume64
    Issue number3
    Publication statusPublished - 2013

    Fingerprint

    Bayesian networks
    Bayes
    Bayesian Networks
    Visualization
    Mixture Model
    Optimal Prediction
    Causal Model
    Bayesian Model
    Weighted Sums
    Model
    Network Model
    Prediction
    Bayesian Statistics
    Relationships
    Posterior Probability
    Mixed Model
    Stock Market
    Network Structure
    Model Selection
    Directed Graph

    Keywords

    • Bayesian model averaging
    • Bayesian network
    • BIC
    • Mixture model
    • Mutual information

    ASJC Scopus subject areas

    • Industrial and Manufacturing Engineering
    • Applied Mathematics
    • Management Science and Operations Research
    • Strategy and Management

    Cite this

    A Bayes optimal predicting method of Bayesian network with visualization of causal relationship. / Takeyama, Yusuke; Ishida, Takashi; Goto, Masayuki.

    In: Journal of Japan Industrial Management Association, Vol. 64, No. 3, 2013, p. 399-408.

    Research output: Contribution to journalArticle

    @article{a29fd0331fb54a608bd1772b235effad,
    title = "A Bayes optimal predicting method of Bayesian network with visualization of causal relationship",
    abstract = "A Bayesian network is one of the useful models for pattern recognition problems and it has the features of both stochastic prediction and causal models. A Bayesian network expresses the causal relationship between variables with directed graphs. Usually the structure of a Bayesian network is statistically estimated using a set of training data and the model selection has been applied in conventional methods when Bayesian network structures were estimated. However, it is not necessary to choose one model for the purpose of prediction. From the viewpoint of Bayesian statistics, it is well known that prediction using the mixture model on model class is Bayes optimal. In general, the mixture model that is given by a weighted sum of all models with the posterior probability on the model class is the Bayes optimal prediction. In this paper, we propose an new Bayes optimal prediction on a Bayesian network model class using the mixture model. A mixture model sometimes becomes a complex expression due to the weighted sum of all models on a model class, and it results in loss of the usefulness as a causal model. Since the easiness of interpretation is one of the merits of a Bayesian network, using a mixed model only for improvement in predictive accuracy may lead to losing the merit of a Bayesian network. Therefore, we propose a new method that is configured with the mixture model utilizing the characteristics of the Bayesian network by organizing model classes properly. Furthermore, we propose a method to quantitatively assess the strength of the causal relationship between the nodes on the mixed Bayesian network model. In addition, the effectiveness of the proposed method is clarified via a numerical experiment on an application to a prediction problem of buying and selling of shares stock market.",
    keywords = "Bayesian model averaging, Bayesian network, BIC, Mixture model, Mutual information",
    author = "Yusuke Takeyama and Takashi Ishida and Masayuki Goto",
    year = "2013",
    language = "English",
    volume = "64",
    pages = "399--408",
    journal = "Journal of Japan Industrial Management Association",
    issn = "0386-4812",
    publisher = "Nihon Keikei Kogakkai",
    number = "3",

    }

    TY - JOUR

    T1 - A Bayes optimal predicting method of Bayesian network with visualization of causal relationship

    AU - Takeyama, Yusuke

    AU - Ishida, Takashi

    AU - Goto, Masayuki

    PY - 2013

    Y1 - 2013

    N2 - A Bayesian network is one of the useful models for pattern recognition problems and it has the features of both stochastic prediction and causal models. A Bayesian network expresses the causal relationship between variables with directed graphs. Usually the structure of a Bayesian network is statistically estimated using a set of training data and the model selection has been applied in conventional methods when Bayesian network structures were estimated. However, it is not necessary to choose one model for the purpose of prediction. From the viewpoint of Bayesian statistics, it is well known that prediction using the mixture model on model class is Bayes optimal. In general, the mixture model that is given by a weighted sum of all models with the posterior probability on the model class is the Bayes optimal prediction. In this paper, we propose an new Bayes optimal prediction on a Bayesian network model class using the mixture model. A mixture model sometimes becomes a complex expression due to the weighted sum of all models on a model class, and it results in loss of the usefulness as a causal model. Since the easiness of interpretation is one of the merits of a Bayesian network, using a mixed model only for improvement in predictive accuracy may lead to losing the merit of a Bayesian network. Therefore, we propose a new method that is configured with the mixture model utilizing the characteristics of the Bayesian network by organizing model classes properly. Furthermore, we propose a method to quantitatively assess the strength of the causal relationship between the nodes on the mixed Bayesian network model. In addition, the effectiveness of the proposed method is clarified via a numerical experiment on an application to a prediction problem of buying and selling of shares stock market.

    AB - A Bayesian network is one of the useful models for pattern recognition problems and it has the features of both stochastic prediction and causal models. A Bayesian network expresses the causal relationship between variables with directed graphs. Usually the structure of a Bayesian network is statistically estimated using a set of training data and the model selection has been applied in conventional methods when Bayesian network structures were estimated. However, it is not necessary to choose one model for the purpose of prediction. From the viewpoint of Bayesian statistics, it is well known that prediction using the mixture model on model class is Bayes optimal. In general, the mixture model that is given by a weighted sum of all models with the posterior probability on the model class is the Bayes optimal prediction. In this paper, we propose an new Bayes optimal prediction on a Bayesian network model class using the mixture model. A mixture model sometimes becomes a complex expression due to the weighted sum of all models on a model class, and it results in loss of the usefulness as a causal model. Since the easiness of interpretation is one of the merits of a Bayesian network, using a mixed model only for improvement in predictive accuracy may lead to losing the merit of a Bayesian network. Therefore, we propose a new method that is configured with the mixture model utilizing the characteristics of the Bayesian network by organizing model classes properly. Furthermore, we propose a method to quantitatively assess the strength of the causal relationship between the nodes on the mixed Bayesian network model. In addition, the effectiveness of the proposed method is clarified via a numerical experiment on an application to a prediction problem of buying and selling of shares stock market.

    KW - Bayesian model averaging

    KW - Bayesian network

    KW - BIC

    KW - Mixture model

    KW - Mutual information

    UR - http://www.scopus.com/inward/record.url?scp=84923286025&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84923286025&partnerID=8YFLogxK

    M3 - Article

    AN - SCOPUS:84923286025

    VL - 64

    SP - 399

    EP - 408

    JO - Journal of Japan Industrial Management Association

    JF - Journal of Japan Industrial Management Association

    SN - 0386-4812

    IS - 3

    ER -