Atula Tejaswi

I am a Graduate Student studying Master's in Computer Science at The University of Texas at Austin, advised by Prof. Eunsol Choi and Prof. Sujay Sanghavi. I received my Bachelor's Degree in CS from Manipal Institute of Technology. I have interned at the Indian Institute of Science, Bangalore advised by Prof. Aditya Gopalan and also at ETH Zurich with Prof. Mrinmaya Sachan's lab.

Previously, I was a researcher with Conversational AI and Social Analytics Lab, University of Marburg led by Prof. Lucie Flek. In the summer of 2022, I was a Mitacs Globalink research intern at University of Quebec in Montreal, advised Prof. Marie-Jean Meurs.

CV   |   Google Scholar   |   Semantic Scholar   |   LinkedIn   |   Github

Research Interests

My general interests are in Deep Learning and Natural Language Processing. Currently, I am working on Retriever models.

On the application side, I have previously worked on a broad range of domains including Computational Social Science, Multimodal Learning, and Privacy-Preserving Deep Learning.

Papers

* indicates joint first authors

• Exploring Design Choices for Building Language-Specific LLMs
  Atula Tejaswi*, Nilesh Gupta*, Eunsol Choi
  EMNLP 2024 (Findings)
  Code
• SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors
  Vijay Lingam*, Atula Tejaswi*, Aditya Vavre*, Aneesh Shetty*, Gautham Krishna Gudur*, Joydeep Ghosh, Alex Dimakis, Eunsol Choi, Aleksandar Bojchevski, Sujay Sanghavi
  NeurIPS 2024
  Code
• The Impact of Differential Privacy on Group Disparity Mitigation
  Victor Petrén Bach Hansen*, Atula Tejaswi*, Ramit Sawhney, Lucie Flek, Anders Søgaard
  NAACL 2024 (Findings)
  Code
• RISE: Robust Early-exiting Internal Classifiers for Suicide Risk Evaluation
  Ritesh Soun, Atula Tejaswi, Ramit Sawhney, Nikolaos Aletras, Preslav Nakov
  LREC COLING 2024
  
• Saliency-Aware Interpolative Augmentation for Multimodal Financial Prediction
  Samyak Jain*, Parth Chhabra*, Atula Tejaswi*, Puneet Mathur, Ramit Sawhney, Shivam Agarwal, Preslav Nakov, Sudheer Chava, Dinesh Manocha
  LREC COLING 2024
  
• Early Weight Averaging meets High Learning Rates for LLM Pre-training
  Sunny Sanyal*, Atula Tejaswi*, Jean Kaddour, Abhishek Kumar, Sujay Sanghavi
  COLM 2024
  Code
• Learning Through Interpolative Augmentation of Dynamic Curvature Spaces
  Parth Chhabra*, Atula Tejaswi*, Shivam Agarwal, Ramit Sawhney, Megh Thakkar, Preslav Nakov, Sudheer Chava
  SIGIR 2023
  Code
• How Much User Context Do We Need? Privacy by Design in Mental Health NLP Applications
  Ramit Sawhney*, Atula Tejaswi*, Ivan Habernal, Lucie Flek
  ICWSM 2023
  
• Tweet Based Reach Aware Temporal Attention Network for NFT Valuation
  Ramit Sawhney, Megh Thakkar, Ritesh Soun, Atula Tejaswi, Vasu Sharma, Dipanwita Guhathakurta, Sudheer Chava
  EMNLP 2022 (Findings)
  Code
• MONOPOLY: Financial Prediction from MONetary POLicY Conference Videos Using Multimodal Cues
  Puneet Mathur, Atula Tejaswi, Malika Chhibber, Ramit Sawhney, Fu-Ming Guo, Franck Dernoncourt, Sanghamitra Dutta, Dinesh Manocha
  ACM Multimedia 2022
  Code
• Towards Suicide Ideation Detection Through Online Conversational Context
  Ramit Sawhney*, Shivam Agarwal*, Atula Tejaswi*, Nikolaos Aletras, Preslav Nakov, Lucie Flek
  SIGIR 2022
  Code
• Orthogonal Multi-Manifold Enriching of Directed Networks
  Ramit Sawhney*, Shivam Agarwal*, Atula Tejaswi*, Kapil Pathak*
  AISTATS 2022
  Code
• A Risk-Averse Mechanism for Suicidality Assessment on Social Media
  Ramit Sawhney*, Atula Tejaswi*, Manas Gaur
  ACL 2022
  
• Intermix: An Interference-Based Data Augmentation and Regularization Technique for Automatic Deep Sound Classification
  Ramit Sawhney, Atula Tejaswi
  ICASSP 2022
  Code