Soumya Sanyal

Email
Github
Twitter
LinkedIn
I am a Ph.D. Candidate at the INK Lab, University of Southern California, working with Prof. Xiang Ren. Previously, I was a research assistant at the MALL Lab, Indian Institue of Science hosted by Prof. Partha Talukdar. Before IISc, I was a Senior Analyst at the Equities Risk Management team of Goldman Sachs, India. I completed my Bachelor's from the Indian Institute of Technology, Kharagpur in 2016.

Research

I am broadly interested in Natural Language Processing and Deep Learning on Graphs. My recent research has focused on learning to reason using language models and explanation-based learning.

If you want to discuss more about my work, or collaborate, feel free to contact me at soumyasa [at] usc [dot] edu.

Publications

Google Scholar| Semantic Scholar| DBLP
Conference Publications

Faith and Fate: Limits of Transformers on Compositionality
Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jian, Bill Yuchen Lin, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D Hwang, Soumya Sanyal, Sean Welleck, Xiang Ren, Allyson Ettinger, Zaid Harchaoui, Yejin Choi
NeurIPS 2023 |Thirty-seventh Conference on Neural Information Processing Systems
Paper

APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning
Soumya Sanyal, Yichong Xu, Shuohang Wang, Ziyi Yang, Reid Pryzant, Wenhao Yu, Chenguang Zhu, Xiang Ren
ACL 2023 |The 61st Annual Meeting of the Association for Computational Linguistics
Paper

Generate rather than Retrieve: Large Language Models are Strong Context Generators
Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang
ICLR 2023 |The Eleventh International Conference on Learning Representations
Paper

RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning
Soumya Sanyal, Zeyi Liao, Xiang Ren
EMNLP 2022 |The 2022 Conference on Empirical Methods in Natural Language Processing
Paper| Code

FaiRR: Faithful and Robust Deductive Reasoning over Natural Language
Soumya Sanyal, Harman Singh, Xiang Ren ACL 2022 | 60th Annual Meeting of the Association for Computational Linguistics
Paper| Code

Discretized Integrated Gradients for Explaining Language Models
Soumya Sanyal, Xiang Ren EMNLP 2021 | The 2021 Conference on Empirical Methods in Natural Language Processing
Paper| Code

SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoning
Aaron Chan, Boyuan Long, Jiashu Xu, Soumya Sanyal, Tanishq Gupta, and Xiang Ren Neurips 2021 | Thirty-fifth Conference on Neural Information Processing Systems
Paper| Code

A Re-evaluation of Knowledge Graph Completion Methods
Zhiqing Sun*, Shikhar Vashishth*, Soumya Sanyal*, Partha Talukdar, and Yiming Yang ACL 2020 | The 58th Annual Meeting of the Association for Computational Linguistics
Paper| Code

Composition-based Multi-Relational Graph Convolutional Networks
Soumya Sanyal*, Shikhar Vashishth*, Vikram Nitin, and Partha Talukdar ICLR-2020 | Eighth International Conference on Learning Representations
Paper| Code

InteractE: Improving Convolution-based Knowledge Graph Embeddings by Increasing Feature Interactions
Soumya Sanyal*, Shikhar Vashishth*, Vikram Nitin, Nilesh Agrawal, and Partha Talukdar AAAI-2020 | Thirty-Fourth AAAI Conference on Artificial Intelligence
Paper| Code

ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations
Ekagra Ranjan, Soumya Sanyal, and Partha Talukdar AAAI-2020 | Thirty-Fourth AAAI Conference on Artificial Intelligence
Paper| Code

Workshop Publications

SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoning
Aaron Chan, Boyuan Long, Jiashu Xu, Soumya Sanyal, Tanishq Gupta, and Xiang Ren ICML Workshop | ICML 2021 Workshop on Theoretic Foundation, Criticism, and Application Trend of Explainable AI
Paper| Code

MT-CGCNN: Integrating Crystal Graph Convolutional Neural Network with Multitask Learning for Material Property Prediction
Soumya Sanyal, Janakiraman Balachandran, Naganand Yadati, Abhishek Kumar, Padmini Rajagopalan, Suchismita Sanyal, and Partha Talukdar NeurIPS Workshop | NeurIPS 2018 Workshop on Machine Learning for Molecules and Materials
Paper| Code

Preprints

ProteinGCN: Protein model quality assessment using Graph Convolutional Networks
Soumya Sanyal, Ivan Anishchenko, Anirudh Dagar, David Baker, and Partha Talukdar Paper| Code

Teaching Experience

  • Fall 2023: TA for Introduction to Machine Learning (CSCI 467)
  • Service

    Reviewer:   AAAI 2021, NAACL 2021, DMKD, EMNLP 2021, ICLR 2022, ACL 2022, NeurIPS 2022, EMNLP 2022, ACL 2023, NeurIPS 2023, NEJLT
    Sub-Reviewer:   EMNLP 2020, WWW 2020, ICML 2021, KDD 2021, TACL
    © Copyright 2020 Soumya Sanyal.