-
Unsupervised Cross-Task Generalization via Retrieval Augmentation
Bill Yuchen Lin, Kangmin Tan, Chris Miller, Beiwen Tian, Xiang Ren
NeurIPS 2022
Project Website
-
NS3: Neuro-Symbolic Semantic Code Search
Shushan Arakelyan, Anna Hakhverdyan, Miltiadis Allamanis, Christophe Hauser, Luis Antonio Garcia, Xiang Ren
NeurIPS 2022
(Also a Spotlight at ICLR 2022 Deep Learning for Code Workshop)
-
UniREx: A Unified Learning Framework for Language Model Rationale Extraction
Aaron Chan, Maziar Sanjabi, Lambert Mathias, Liang Tan, Shaoliang Nie, Xiaochang Peng, Xiang Ren, Hamed Firooz
ICML 2022
(Also at ICLR Workshop on Socially Responsible Machine Learning & ACL Workshop on BigScience)
Github (coming soon)
-
Eliciting Transferability in Multi-task Learning with Task-level Mixture-of-Experts
Qinyuan Ye, Juan Zha, Xiang Ren
Findings of EMNLP 2022
-
RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning
Soumya Sanyal, Zeyi Liao, Xiang Ren
EMNLP 2022
Github
-
ER-Test: Evaluating Explanation Regularization Methods for NLP Models
Brihi Joshi, Aaron Chan, Ziyi Liu, Shaoliang Nie, Maziar Sanjabi, Hamed Firooz, Xiang Ren
Findings of EMNLP 2022
Github
-
Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Quality
Pei Zhou, Hyundong J. Cho, Pegah Jandaghi, Dong-Ho Lee, Bill Yuchen Lin, Jay Pujara, Xiang Ren
EMNLP 2022
Project
-
Machine Translation Robustness to Natural Asemantic Variation
Jacob Bremerman, Xiang Ren, Jonathan May
EMNLP 2022
-
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora
Xisen Jin, Dejiao Zhang, Henghui Zhu, Wei Xiao, Shang-Wen Li, Xiaokai Wei, Andrew Arnold, Xiang Ren
NAACL 2022
(also at ACL 2022 Workshop BigScience)
Github (coming soon)
-
Sparse Distillation: Speeding Up Text Classification by Using Bigger Models
Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech
NAACL 2022
-
FedNLP: A Research Platform for Federated Learning in Natural Language Processing
Bill Yuchen Lin, Chaoyang He, Zihang Zeng, Hulin Wang, Yufen Huang, Mahdi Soltanolkotabi, Xiang Ren, Salman Avestimehr
Findings of NAACL 2022
Github
-
On the Robustness of Reading Comprehension Models to Entity Renaming
Jun Yan, Yang Xiao, Sagnik Mukherjee, Bill Yuchen Lin, Robin Jia, Xiang Ren
NAACL 2022
Github
-
NewsEdits: A Dataset of News Article Revision Histories and a Novel Document-Level Reasoning Challenge
Alexander Spangher, Xiang Ren, Jonathan May, Nanyun Peng
NAACL 2022
Outstanding Paper Award
Github
-
FaiRR: Faithful and Robust Deductive Reasoning over Natural Language
Soumya Sanyal, Harman Singh, Xiang Ren
ACL 2022
Github
-
A Good Prompt Is Worth Millions of Parameters?: Low-resource Prompt-based Learning for Vision-Language Models
Woojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen, Xiang Ren
ACL 2022
Github
-
On Continual Model Refinement in Out-of-Distribution Data Streams
Bill Yuchen Lin, Sida Wang, Xi Victoria Lin, Robin Jia, Lin Xiao, Xiang Ren, Scott Yih
ACL 2022
Project website
-
Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER
Dong-Ho Lee, Mahak Agarwal, Akshen Kadakia, Jay Pujara, Xiang Ren
ACL 2022
Github
-
Think Before You Speak: Using Self-talk to Generate Implicit Commonsense Knowledge for Response Generation
Pei Zhou, Karthik Gopalakrishnan, Behnam Hedayatnia, Seokhwan Kim, Jay Pujara, Xiang Ren, Yang Liu, Dilek Hakkani-Tur
ACL 2022
Github (coming soon)
-
Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-Modal Knowledge Transfer
Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren
ACL 2022
Github
-
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng
ACL 2022
-
Contextualized Scene Imagination for Generative Commonsense Reasoning
Peifeng Wang, Jonathan Zamora, Junfeng Liu, Filip Ilievski, Muhao Chen, Xiang Ren
ICLR 2022
Github
2021
-
Refining Language Models with Compositional Explanations
Huihan Yao, Ying Chen, Qinyuan Ye, Xisen Jin, Xiang Ren
Conference on Neural Information Processing Systems (NeurIPS) 2021
spotlight presentation
(previously at RAI @ICLR 2021)
Github
-
SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoning
Aaron Chan, Boyuan Long, Jiashu Xu, Soumya Sanyal, Tanishq Gupta, Xiang Ren
Conference on Neural Information Processing Systems (NeurIPS) 2021
(previously at XAI@ICML)
-
Gradient-based Editing of Memory Examples for Online Task-free Continual Learning
Xisen Jin, Junyi Du, Arka Sadhu, Xiang Ren
Conference on Neural Information Processing Systems (NeurIPS) 2021
Previously a contributed talk to LifelongML@ICML)
2020)
Github
-
CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP
Qinyuan Ye, Yuchen Lin, Xiang Ren
EMNLP 2021
Github
Tweet
-
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms
Pei Zhou, Rahul Khanna, Bill Yuchen Lin, Daniel Ho, Jay Pujara, Xiang Ren
EMNLP 2021
Project Leaderboard Data Explorer
Github
-
Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning
Xisen Jin, Bill Yuchen Lin, Mohammad Rostami, Xiang Ren
Findings of EMNLP 2021
Github
Tweet
-
Discretized Integrated Gradients for Explaining Language Models
Soumya Sanyal, Xiang Ren
EMNLP 2021
Github
-
On the Influence of Masking Policies in Intermediate Pre-training
Qinyuan Ye, Belinda Z. Li, Sinong Wang, Benjamin Bolte, Hao Ma, Wen-tau Yih, Xiang Ren, Madian Khabsa
EMNLP 2021
-
Lawyers are Dishonest? : Quantifying Representational Harms in Commonsense Knowledge Resources
Ninareh Mehrabi, Pei Zhou, Fred Morstatter, Jay Pujara, Xiang Ren, Aram Galstyan
EMNLP 2021
-
Probing Commonsense Explanation in Dialogue Response Generation
Pei Zhou, Pegah Jandaghi, Hyundong Cho, Bill Yuchen Lin, Jay Pujara, Xiang Ren
Findings of EMNLP 2021
Project
-
ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning
Rujun Han, Xiang Ren, Nanyun Peng
EMNLP 2021
Github
-
Extract, Denoise and Enforce: Evaluating and Improving Concept Preservation for Text-to-Text Generation
Yuning Mao, Wenchang Ma, Deren Lei, Jiawei Han, Xiang Ren
EMNLP 2021
Github
-
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation
Mozhdeh Gheini, Xiang Ren, Jonathan May
EMNLP 2021
Github
-
MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding
Woojeong Jin, Maziar Sanjabi, Shaoliang Nie, Liang Tan, Xiang Ren, Hamed Firooz
Findings of EMNLP 2021
-
RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Models
Bill Yuchen Lin, Wenyang Gao, Jun Yan, Ryan Moreno, Xiang Ren
EMNLP 2021 (short paper)
Project
Github
Data
Leaderboard
-
ForecastQA: A Question Answering Challenge for Event Forecasting
Woojeong Jin, Rahul Khanna, Suji Kim, Dong-Ho Lee, Fred Morstatter, Aram Galstyan, Xiang Ren
ACL 2021
Project Data Explorer Leaderboard
-
Learning to Generate Task-specific Adapters from Task Description
Qinyuan Ye, Xiang Ren
ACL 2021 (short paper)
-
Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Common Sense Reasoning
Bill Yuchen Lin, Seyeon Lee, Xiaoyang Qiao, Xiang Ren.
ACL 2021
-
AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decoding
Jun Yan, Nasser Zalmout, Yan Liang, Christan Grant, Xiang Ren, Xin Luna Dong.
ACL 2021
-
Learning Contextualized Knowledge Structures for Commonsense Reasoning
Jun Yan, Mrigank Raman, Aaron Chan, Tianyu Zhang, Ryan Rossi, Handong Zhao, Sungchul Kim, Nedim Lipka, Xiang Ren
Findings of ACL 2021 (An earlier version accepted to KR2ML@ NeurIPS 2020)
Website
-
RiddleSense: A Challenge Dataset for Answering Riddle-Style Commonsense Questions
Bill Yuchen Lin, Ziyi Wu, Yichi Yang, Dong-Ho Lee, Xiang Ren.
Findings of ACL 2021
Project
-
Do Language Models Perform Generalizable Commonsense Inference?
Peifeng Wang, Filip Ilievski, Muhao Chen, Xiang Ren.
Findings of ACL 2021
-
AutoTriggER: Named Entity Recognition with Auxiliary Trigger Extraction
Dong-Ho Lee*, Ravi Kiran Selvam*, Sheikh Muhammad Sarwar, Bill Yuchen Lin, Fred Morstatter,
Jay Pujara, Elizabeth Boschee, James Allan, Xiang Ren
ICLR Workshop on Weakly Supervised Learning (WeaSuL @ICLR) 2021
-
Pre-training Text-to-Text Transformers for Concept-centric Common Sense
Wangchunshu Zhou*, Dong-Ho Lee*, Ravi Kiran Selvam, Seyeon Lee, Bill Yuchen Lin, Xiang Ren
ICLR 2021 (Previous version in SSL@ NeurIPS 2020)
Project
Code
-
Learning to Deceive Knowledge Graph Augmented Models via Targeted Perturbation
Mrigank Raman, Siddhant Agarwal, Peifeng Wang, Aaron Chan, Hansen Wang, Sungchul Kim, Ryan
Rossi, Handong Zhao, Nedim Lipka, Xiang Ren
ICLR 2021
Best paper runner-up at KR2ML@ NeurIPS 2020
-
On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning
Xisen Jin, Francesco Barbieri, Brendan Kennedy, Aida Mostafazadeh Davani, Leonardo Neves, Xiang Ren
NAACL 2021
-
Differentiable
Open-Ended Commonsense Reasoning
Bill Yuchen Lin, Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Xiang Ren, William W. Cohen
NAACL 2021
-
X-METRA-ADA: Cross-lingual Meta-Transfer learning Adaptation to Natural Language Understanding
Meryem M'hamdi, Doo Soon Kim, Franck Dernoncourt, Trung Bui, Xiang Ren, Jonathan May
NAACL 2021
-
TaxoClass: Hierarchical Multi-Label Text Classification Using Only Class Names
Jiaming Shen, Wenda Qiu, Yu Meng, Jingbo Shang, Xiang Ren, Jiawei Han
NAACL 2021
-
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization
Wenxuan Zhou, Bill Yuchen Lin, Xiang Ren
The AAAI Conference on Artificial Intelligence (AAAI), 2021
Github
-
Time-Series Event
Prediction with Evolutionary State Graph
Wenjie Hu, Yang Yang, Ziqiang Cheng, Carl Yang, Xiang Ren
WSDM
2021