Differentially private Bayesian learning on distributed data

Mikko Heikkilä, Eemil Lagerspetz, Samuel Kaski, Kana Shimizu, Sasu Tarkoma, Antti Honkela

    Research output: Contribution to journalConference article

    2 Citations (Scopus)

    Abstract

    Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The standard DP algorithms require a single trusted party to have access to the entire data, which is a clear weakness, or add prohibitive amounts of noise. We consider DP Bayesian learning in a distributed setting, where each party only holds a single sample or a few samples of the data. We propose a learning strategy based on a secure multi-party sum function for aggregating summaries from data holders and the Gaussian mechanism for DP. Our method builds on an asymptotically optimal and practically efficient DP Bayesian inference with rapidly diminishing extra cost.

    Original languageEnglish
    Pages (from-to)3227-3236
    Number of pages10
    JournalAdvances in Neural Information Processing Systems
    Volume2017-December
    Publication statusPublished - 2017 Jan 1
    Event31st Annual Conference on Neural Information Processing Systems, NIPS 2017 - Long Beach, United States
    Duration: 2017 Dec 42017 Dec 9

    Fingerprint

    Health care
    Learning systems
    Costs

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Information Systems
    • Signal Processing

    Cite this

    Heikkilä, M., Lagerspetz, E., Kaski, S., Shimizu, K., Tarkoma, S., & Honkela, A. (2017). Differentially private Bayesian learning on distributed data. Advances in Neural Information Processing Systems, 2017-December, 3227-3236.

    Differentially private Bayesian learning on distributed data. / Heikkilä, Mikko; Lagerspetz, Eemil; Kaski, Samuel; Shimizu, Kana; Tarkoma, Sasu; Honkela, Antti.

    In: Advances in Neural Information Processing Systems, Vol. 2017-December, 01.01.2017, p. 3227-3236.

    Research output: Contribution to journalConference article

    Heikkilä, M, Lagerspetz, E, Kaski, S, Shimizu, K, Tarkoma, S & Honkela, A 2017, 'Differentially private Bayesian learning on distributed data', Advances in Neural Information Processing Systems, vol. 2017-December, pp. 3227-3236.
    Heikkilä M, Lagerspetz E, Kaski S, Shimizu K, Tarkoma S, Honkela A. Differentially private Bayesian learning on distributed data. Advances in Neural Information Processing Systems. 2017 Jan 1;2017-December:3227-3236.
    Heikkilä, Mikko ; Lagerspetz, Eemil ; Kaski, Samuel ; Shimizu, Kana ; Tarkoma, Sasu ; Honkela, Antti. / Differentially private Bayesian learning on distributed data. In: Advances in Neural Information Processing Systems. 2017 ; Vol. 2017-December. pp. 3227-3236.
    @article{a289f55df22844feb88389302fa9db7a,
    title = "Differentially private Bayesian learning on distributed data",
    abstract = "Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The standard DP algorithms require a single trusted party to have access to the entire data, which is a clear weakness, or add prohibitive amounts of noise. We consider DP Bayesian learning in a distributed setting, where each party only holds a single sample or a few samples of the data. We propose a learning strategy based on a secure multi-party sum function for aggregating summaries from data holders and the Gaussian mechanism for DP. Our method builds on an asymptotically optimal and practically efficient DP Bayesian inference with rapidly diminishing extra cost.",
    author = "Mikko Heikkil{\"a} and Eemil Lagerspetz and Samuel Kaski and Kana Shimizu and Sasu Tarkoma and Antti Honkela",
    year = "2017",
    month = "1",
    day = "1",
    language = "English",
    volume = "2017-December",
    pages = "3227--3236",
    journal = "Advances in Neural Information Processing Systems",
    issn = "1049-5258",

    }

    TY - JOUR

    T1 - Differentially private Bayesian learning on distributed data

    AU - Heikkilä, Mikko

    AU - Lagerspetz, Eemil

    AU - Kaski, Samuel

    AU - Shimizu, Kana

    AU - Tarkoma, Sasu

    AU - Honkela, Antti

    PY - 2017/1/1

    Y1 - 2017/1/1

    N2 - Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The standard DP algorithms require a single trusted party to have access to the entire data, which is a clear weakness, or add prohibitive amounts of noise. We consider DP Bayesian learning in a distributed setting, where each party only holds a single sample or a few samples of the data. We propose a learning strategy based on a secure multi-party sum function for aggregating summaries from data holders and the Gaussian mechanism for DP. Our method builds on an asymptotically optimal and practically efficient DP Bayesian inference with rapidly diminishing extra cost.

    AB - Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The standard DP algorithms require a single trusted party to have access to the entire data, which is a clear weakness, or add prohibitive amounts of noise. We consider DP Bayesian learning in a distributed setting, where each party only holds a single sample or a few samples of the data. We propose a learning strategy based on a secure multi-party sum function for aggregating summaries from data holders and the Gaussian mechanism for DP. Our method builds on an asymptotically optimal and practically efficient DP Bayesian inference with rapidly diminishing extra cost.

    UR - http://www.scopus.com/inward/record.url?scp=85047010172&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85047010172&partnerID=8YFLogxK

    M3 - Conference article

    VL - 2017-December

    SP - 3227

    EP - 3236

    JO - Advances in Neural Information Processing Systems

    JF - Advances in Neural Information Processing Systems

    SN - 1049-5258

    ER -