Improved Computation-Communication Trade-Off for Coded Distributed Computing using Linear Dependence of Intermediate Values

研究成果: Conference contribution

抄録

In large scale distributed computing systems, communication overhead is one of the major bottlenecks. In the map- shuffle-reduce framework, which is one of the major distributed computing frameworks, the communication load among servers can be reduced by increasing the computation load of each server, that is, there is a trade-off between computation load and communication load. Recently, it has been shown that coded distributed computing (CDC) improves this trade-off relationship by letting servers encode their intermediate computation results. The original CDC scheme does not assume any special structures on the functions that servers compute. However, in actual problems, these functions often have some structures, and the trade-off relation may be further improved by using that structures. In this paper, we propose a new scheme that further improves the trade-off relationship by utilizing the linear dependency structure of the intermediate computation results. The intermediate values computed in the map phase can be considered as vectors on {F}-2}. In some applications, these intermediate values have a linear dependency and in such cases, it is sufficient for each server to send a basis of the linear subspace and linear combination coefficients. As a result, the proposed approach improves over the best-known computation-communication overhead trade-off in some applications.

本文言語English
ホスト出版物のタイトル2020 IEEE International Symposium on Information Theory, ISIT 2020 - Proceedings
出版社Institute of Electrical and Electronics Engineers Inc.
ページ179-184
ページ数6
ISBN(電子版)9781728164328
DOI
出版ステータスPublished - 2020 6
イベント2020 IEEE International Symposium on Information Theory, ISIT 2020 - Los Angeles, United States
継続期間: 2020 7 212020 7 26

出版物シリーズ

名前IEEE International Symposium on Information Theory - Proceedings
2020-June
ISSN(印刷版)2157-8095

Conference

Conference2020 IEEE International Symposium on Information Theory, ISIT 2020
国/地域United States
CityLos Angeles
Period20/7/2120/7/26

ASJC Scopus subject areas

  • 理論的コンピュータサイエンス
  • 情報システム
  • モデリングとシミュレーション
  • 応用数学

フィンガープリント

「Improved Computation-Communication Trade-Off for Coded Distributed Computing using Linear Dependence of Intermediate Values」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル