Publications

(2020). Efficient Sparse Collective Communication and its application to Accelerate Distributed Deep Learning.

PDF Project

(2020). Compressed Communication for Distributed Deep Learning: Survey and Quantitative Evaluation.

PDF Code Project

(2020). On the Discrepancy between the Theoretical Analysis and Practical Implementations of Compressed Communication for Distributed Deep Learning. Proceedings of AAAI’20.

PDF

(2019). Natural Compression for Distributed Deep Learning. CoRR.

PDF

(2019). Scaling Distributed Machine Learning with In-Network Aggregation.

PDF