Mission: Impossible Language Models Julie Kallini, Isabel Papadimitriou, Richard Futrell, Kyle Mahowald, Christopher Potts
Semisupervised Neural Proto-Language Reconstruction Liang Lu, Peirong Xie, David R Mortensen
Why are Sensitive Functions Hard for Transformers? Michael Hahn, Mark Rofin
Natural Language Satisfiability: Exploring the Problem Distribution and Evaluating Transformer-based Language Models Tharindu Madusanka, Ian Pratt-Hartmann, Riza Batista-Navarro
Deciphering Oracle Bone Language with Diffusion Models Haisu Guan, Huanxin Yang, Xinyu Wang, Shengwei Han, Yongge Liu, Lianwen Jin, Xiang Bai, Yuliang Liu
Causal Estimation of Memorisation Profiles Pietro Lesci, Clara Meister, Thomas Hofmann, Andreas Vlachos, Tiago Pimentel
Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model Ahmet Üstün, Viraat Aryabumi, Zheng Xin Yong, Wei-Yin Ko, Daniel D’souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer, Sara Hooker
Best Social Impact Paper Awards
How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs Yi Zeng, Hongpeng Lin, Jingwen Zhang, Diyi Yang, Ruoxi Jia, Weiyan Shi
DIALECTBENCH: An NLP Benchmark for Dialects, Varieties, and Closely-Related Languages Fahim Faisal, Orevaoghene Ahia, Aarohi Srivastava, Kabir Ahuja, David Chiang, Yulia Tsvetkov, Antonios Anastasopoulos
Having Beer after Prayer? Measuring Cultural Bias in Large Language Models” Tarek Naous, Michael J Ryan, Alan Ritter, Wei Xu
Best Resource Paper Awards
Latxa: An Open Language Model and Evaluation Suite for Basque Julen Etxaniz, Oscar Sainz, Naiara Perez Miguel, Itziar Aldabe, German Rigau, Eneko Agirre, Aitor Ormazabal, Mikel Artetxe, Aitor Soroa
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Evan Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents Harsh Trivedi, Tushar Khot, Mareike Hartmann, Ruskin Manku, Vinty Dong, Edward Li, Shashank Gupta, Ashish Sabharwal, Niranjan Balasubramanian
Best Theme Paper Awards
OLMo: Accelerating the Science of Language Models Dirk Groeneveld, Iz Beltagy, Evan Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, William H. Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi
Outstanding Papers
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Qing Li, Yong Jiang, Zhihao Jia
L-Eval: Instituting Standardized Evaluation for Long Context Language Models Chenxin An;Shansan Gong;Ming Zhong;Xingjian Zhao;Mukai Li;Jun Zhang;Lingpeng Kong;Xipeng Qiu
Causal-Guided Active Learning for Debiasing Large Language Models Zhouhao Sun;Li Du;Xiao Ding;Yixuan Ma;Yang Zhao;Kaitao Qiu;Ting Liu;Bing Qin
CausalGym: Benchmarking causal interpretability methods on linguistic tasks Aryaman Arora;Dan Jurafsky;Christopher Potts
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? Marco Gaido;Sara Papi;Matteo Negri;Luisa Bentivogli
Must NLP be Extractive? Steven Bird
IRCoder: Intermediate Representations Make Language Models Robust Multilingual Code Generators Indraneil Paul;Goran Glavaš;Iryna Gurevych
MultiLegalPile: A 689GB Multilingual Legal Corpus Joel Niklaus, Veton Matoshi, Matthias Stürmer, Ilias Chalkidis, Daniel E. Ho
PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safety Zaibin Zhang, Yongting Zhang, Lijun Li, Jing Shao, Hongzhi Gao, Yu Qiao, Lijun Wang, Huchuan Lu, Feng Zhao
Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversation Dongjin Kang, Sunghwan Kim, Taeyoon Kwon, Seungjun Moon, Hyunsouk Cho, Youngjae Yu, Dongha Lee, Jinyoung Yeo
Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Rose Kirk, Hinrich Schuetze, Dirk Hovy
Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models Mosh Levy, Alon Jacoby, Yoav Goldberg
Do Llamas Work in English? On the Latent Language of Multilingual Transformers Chris Wendler, Veniamin Veselovsky, Giovanni Monea, Robert West
Getting Serious about Humor: Crafting Humor Datasets with Unfunny Large Language Models Zachary Horvitz, Jingru Chen, Rahul Aditya, Harshvardhan Srivastava, Robert West, Zhou Yu, Kathleen McKeown
Estimating the Level of Dialectness Predicts Inter-annotator Agreement in Multi-dialect Arabic Datasets Amr Keleg, Walid Magdy, Sharon Goldwater
G-DIG: Towards Gradient-based DIverse and hiGh-quality Instruction Data Selection for Machine Translation Xingyuan Pan, Luyang Huang, Liyan Kang, Zhicheng Liu, Yu Lu, Shanbo Cheng
Media Framing: A typology and Survey of Computational Approaches Across Disciplines Yulia Otmakhova, Shima Khanehzar, Lea Frermann
SPZ: A Semantic Perturbation-based Data Augmentation Method with Zonal-Mixing for Alzheimer’s Disease Detection FangFang Li;Cheng Huang;PuZhen Su;Jie Yin
Greed is All You Need: An Evaluation of Tokenizer Inference Methods Omri Uzan, Craig W Schmidt, Chris Tanner, Yuval Pinter
Language Complexity and Speech Recognition Accuracy: Orthographic Complexity Hurts, Phonological Complexity Doesn’t Chihiro Taguchi, David Chiang
Steering Llama 2 via Contrastive Activation Addition Nina Rimsky, Nick Gabrieli, Julian Schulz, Meg Tong, Evan J Hubinger, Alexander Matt Turner
EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activities Nian Li, Chen Gao, Mingyu Li, Yong Li, Qingmin Liao
M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models Wai-Chung Kwan, Xingshan Zeng, Yufei Wang, Yusen Sun, Liangyou Li, Yuxin Jiang, Lifeng Shang, Qun Liu, Kam-Fai Wong
On Efficient and Statistical Quality Estimation for Data Annotation Jan-Christoph Klie, Juan Haladjian, Marc Kirchner, Rahul Nair
Emulated Disalignment: Safety Alignment for Large Language Models May Backfire! Zhanhui Zhou, Jie Liu, Zhichen Dong, Jiaheng Liu, Chao Yang, Wanli Ouyang, Yu Qiao
IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages Mohammed Safi Ur Rahman Khan, Priyam Mehta, Ananth Sankar, Umashankar Kumaravelan, Sumanth Doddapaneni, Suriyaprasaad B, Varun Balan G, Sparsh Jain, Anoop Kunchukuttan, Pratyush Kumar, Raj Dabre, Mitesh M Khapra
MultiPICo: Multilingual Perspectivist Irony Corpus Silvia Casola, Simona Frenda, Soda Marem Lo, Erhan Sezerer, Antonio Uva, Valerio Basile, Cristina Bosco, Alessandro Pedrani, Chiara Rubagotti, Viviana Patti, Davide Bernardi
MMToM-QA: Multimodal Theory of Mind Question Answering Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo, Zhiting Hu, Tomer Ullman, Antonio Torralba, Joshua B. Tenenbaum, Tianmin Shu
MAP’s not dead yet: Uncovering true language model modes by conditioning away degeneracy Davis Yoshida, Kartik Goyal, Kevin Gimpel
NounAtlas: Filling the Gap in Nominal Semantic Role Labeling Roberto Navigli, Marco Lo Pinto, Pasquale Silvestri, Dennis Rotondi, Simone Ciciliano, Alessandro Scirè
The Earth is Flat because…: Investigating LLMs’ Belief towards Misinformation via Persuasive Conversation Rongwu Xu, Brian S. Lin, Shujian Yang, Tianqi Zhang, Weiyan Shi, Tianwei Zhang, Zhixuan Fang, Wei Xu, Han Qiu
Let’s Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation Se Jin Park, Chae Won Kim, Hyeongseop Rha, Minsu Kim, Joanna Hong, Jeonghun Yeo, Yong Man Ro
Word Embeddings Are Steers for Language Models Chi Han, Jialiang Xu, Manling Li, Yi Fung, Chenkai Sun, Nan Jiang, Tarek F. Abdelzaher, Heng Ji
SAC Awards
Deciphering Oracle Bone Language with Diffusion Models Computational Social Science and Cultural Analytics Haisu Guan, Huanxin Yang, Xinyu Wang, Shengwei Han, Yongge Liu, Lianwen Jin, Xiang Bai, Yuliang Liu
Discursive Socratic Questioning: Evaluating the Faithfulness of Language Models’ Understanding of Discourse Relations Discourse and Pragmatics Yisong Miao, Hongfu Liu, Wenqiang Lei, Nancy F. Chen, Min-Yen Kan
RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via Romanization Efficient/Low-Resource Methods for NLP Jaavid Aktar Husain J, Raj Dabre, Aswanth Kumar M, Jay Gala, Thanmay Jayakumar, Ratish Puduppully, Anoop Kunchukuttan
Steering Llama 2 via Contrastive Activation Addition Ethics, Bias, and Fairness Nina Rimsky, Nick Gabrieli, Julian Schulz, Meg Tong, Evan J Hubinger, Alexander Matt Turner
MAP’s not dead yet: Uncovering true language model modes by conditioning away degeneracy Generation Davis Yoshida, Kartik Goyal, Kevin Gimpel
Spiral of Silence: How is Large Language Model Killing Information Retrieval?—A Case Study on Open Domain Question Answering Information Retrieval and Text Mining Xiaoyang Chen, Ben He, Hongyu Lin, Xianpei Han, Tianshu Wang, Boxi Cao, Le Sun, Yingfei Sun
CausalGym: Benchmarking causal interpretability methods on linguistic tasks Interpretability and Analysis of Models for NLP Aryaman Arora, Dan Jurafsky, Christopher Potts
COKE: A Cognitive Knowledge Graph for Machine Theory of Mind Linguistic theories, Cognitive Modeling and Psycholinguistics Jincenzi Wu, Zhuang Chen, Jiawen Deng, Sahand Sabour, Helen M. Meng, Minlie Huang
Why are Sensitive Functions Hard for Transformers? Machine Learning for NLP Michael Hahn, Mark Rofin
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? Machine Translation Marco Gaido, Sara Papi, Matteo Negri, Luisa Bentivogli
AI ‘News’ Content Farms Are Easy to Make and Hard to Detect: A Case Study in Italian Multilinguality and Language Diversity Giovanni Puccetti, Anna Rogers, Chiara Alzetta, Felice Dell’Orletta, Andrea Esuli
CaMML: Context-Aware Multimodal Learner for Large Models Multimodality and Language Grounding to Vision, Robotics and Beyond Yixin Chen, Shuai Zhang, Boran Han, Tong He, Bo Li
Greed is All You Need: An Evaluation of Tokenizer Inference Methods Phonology, Morphology and Word Segmentation Omri Uzan, Craig W Schmidt, Chris Tanner, Yuval Pinter
VariErr NLI: Separating Annotation Error from Human Label Variation Resources and Evaluation Leon Weber-Genzel, Siyao Peng, Marie-Catherine de Marneffe, Barbara Plank
Distributional Inclusion Hypothesis and Quantifications: Probing for Hypernymy in Functional Distributional Semantics Semantics: Lexical Chun Hei Lo, Wai Lam, Hong Cheng, Guy Emerson
MIDGARD: Self-Consistency Using Minimum Description Length for Structured Commonsense Reasoning Semantics: Sentence-level Semantics, Textual Inference and Other areas Inderjeet Jayakumar Nair, Lu Wang
Language Complexity and Speech Recognition Accuracy: Orthographic Complexity Hurts, Phonological Complexity Doesn’t Speech recognition, text-to-speech and spoken language understanding Chihiro Taguchi, David Chiang
COSMIC: Mutual Information for Task-Agnostic Summarization Evaluation Summarization Maxime DARRIN, Philippe Formont, Jackie CK Cheung, Pablo Piantanida
Tree-Averaging Algorithms for Ensemble-Based Unsupervised Discontinuous Constituency Parsing Syntax: Tagging, Chunking and Parsing Behzad Shayegh, Yuqiao Wen, Lili Mou
