Atal Narayan Sahu

Atal Narayan Sahu PhD student, Computer Science Computer, Electrical and Mathematical Sciences and Engineering Division King Abdullah University of Science and Technology (KAUST), KSA

About

I am a graduate student in the Computer Science department at KAUST where I work at SANDS Lab under the supervision of Prof. Marco Canini.
My research at KAUST focuses on distributed optimization.
Previously, I completed my undergraduate at IIT Kanpur with a major in Mathematics & Scientic Computing and minors in Algorithms and Machine Learning.

Research

Publications

1. On the Discrepancy between the Theoretical Analysis and Practical Implementations of Compressed Communication for Distributed Deep Learning
   Aritra Dutta, El Houcine Bergou, Ahmed M. Abdelmoniem, Chen-Yu Ho, Atal Narayan Sahu, Marco Canini, & Panos Kalnis
   Proceedings of Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20)
   [arxiv]

Preprints

1. On the Convergence Analysis of Asynchronous SGD for Solving Consistent Linear Systems
   Atal Narayan Sahu, Aritra Dutta, Aashutosh Tiwari, & Peter Richtárik
   [arXiv]

2. Natural Compression for Distributed Deep Learning
   Samuel Horváth, Chen-Yu Ho, Ludovít Horváth, Atal Narayan Sahu, Marco Canini, & Peter Richtárik
   [arXiv]

3. Efficient Sparse Collective Communication and its application to accelerate Distributed Deep Learning
   Jiawei Fei, Chen-Yu Ho, Atal Narayan Sahu, Marco Canini, & Amedeo Sapio
   [Technical Report]

Contact