Published in NeurIPS 2024, 2024
Recommended citation: Prajwal Singhania, Siddharth Singh, Shwai He, Soheil Feizi, Abhinav Bhatele, "Loki: Low-Rank Keys for Efficient Sparse Attention." Advances in Neural Information Processing Systems 37 (2024): 16692-16723. https://proceedings.neurips.cc/paper_files/paper/2024/hash/1e027da6bec9ceb2ec37951ceeccae93-Abstract-Conference.html
Published in SC24: International Conference for High Performance Computing, Networking, Storage and Analysis (Gordon Bell Finalist), 2024
Recommended citation: Siddharth Singh, Prajwal Singhania, Aditya Ranjan, John Kirchenbauer, Jonas Geiping, Yuxin Wen, Neel Jain, Abhimanyu Hans, Manli Shu, Aditya Tomar, Tom Goldstein, Abhinav Bhatele "Democratizing AI: Open-source scalable LLM training on GPU-based supercomputers." In SC24: International Conference for High Performance Computing, Networking, Storage and Analysis (pp. 1-14). IEEE. https://ieeexplore.ieee.org/abstract/document/10793182
Published in arXiv:2506.05300, 2024
Recommended citation: Nirav Koley, Prajwal Singhania, Abhinav Bhatele, "Power Law Guided Dynamic Sifting for Efficient Attention." arXiv, 2025. https://arxiv.org/abs/2506.05300
Published in arXiv 2305.13525, 2024
Recommended citation: Siddharth Singh, Prajwal Singhania, Aditya Ranjan, Zack Sating, Abhinav Bhatele, "A 4D Hybrid Algorithm to Scale Parallel Training to Thousands of GPUs." arXiv 2305.13525, 2024. https://arxiv.org/abs/2305.13525
Published in In the proceedings of Proceedings of The 24th International Conference on Artificial Intelligence and Statistics, 2021
Recommended citation: Tianjian Huang, Prajwal Singhania, Maziar Sanjabi, Pabitra Mitra, Meisam Razaviyayn, "Alternating Direction Method of Multipliers for Quantization." In the proceedings of Proceedings of The 24th International Conference on Artificial Intelligence and Statistics, 2021. http://proceedings.mlr.press/v130/huang21a.html
Published in Proceedings of International Conference of the Cross-Language Evaluation Forum for European Languages, 2019
Recommended citation: Shalmoli Ghosh, Prajwal Singhania, Siddharth Singh, Koustav Rudra, Saptarshi Ghosh, "Stance detection in web and social media: a comparative study." In the proceedings of International Conference of the Cross-Language Evaluation Forum for European Languages, 2019. https://arxiv.org/pdf/2007.05976.pdf
Published in Proceedings of the International AAAI Conference on Web and Social Media, 2019
Recommended citation: Binny Mathew, Punyajoy Saha, Hardik Tharad, Subham Rajgaria, Prajwal Singhania, Suman Maity, Pawan Goyal, Animesh Mukherjee, "Thou shalt not hate: Countering online hate speech." In the proceedings of Proceedings of the International AAAI Conference on Web and Social Media, 2019. https://ojs.aaai.org/index.php/ICWSM/article/view/3237