[Resource Topic] 2021/835: Practical, Label Private Deep Learning Training based on Secure Multiparty Computation and Differential Privacy

Welcome to the resource topic for 2021/835

Title:
Practical, Label Private Deep Learning Training based on Secure Multiparty Computation and Differential Privacy

Authors: Sen Yuan, Milan Shen, Ilya Mironov, Anderson C. A. Nascimento

Abstract:

Secure Multiparty Computation (MPC) is an invaluable tool for training machine learning models when the training data cannot be directly accessed by the model trainer. Unfortunately, complex algorithms, such as deep learning models, have their computational complexities increased by orders of magnitude when performed using MPC protocols. In this contribution, we study how to efficiently train an important class of machine learning problems by using MPC where features are known by one of the computing parties and only the labels are private. We propose new protocols combining differential privacy (DP) and MPC in order to privately and efficiently train a deep learning model in such scenario. More specifically, we release differentially private information during the MPC computation to dramatically reduce the training time. All released information does not compromise the privacy of the labels at the individual level. Our protocols can have running times that are orders of magnitude better than a straightforward use of MPC at a moderate cost in model accuracy.

ePrint: https://eprint.iacr.org/2021/835

See all topics related to this paper.

Feel free to post resources that are related to this paper below.

Example resources include: implementations, explanation materials, talks, slides, links to previous discussions on other websites.

For more information, see the rules for Resource Topics .