Predoctoral Researcher
Allen Institute for AI

Jacob Morrison

Hi! I'm a predoctoral researcher on the AllenNLP team at Ai2. I'm also an incoming NLP PhD student at UW, where I'll be working with Banghua Zhu, and I'll be supported by an NSF Computer Science Graduate Fellowship.

I've previously worked on code generation at Google [x] and platform health at Twitter, and in a previous life I was a software engineer at Tableau and Google. See my CV for more details.

Research

My research is generally focused on making language models broadly useful and reliable, and understanding their downstream societal impacts. In addition to my research I also spend a portion of my time helping policymakers understand and address the societal impacts of AI.

A few selected interests of mine and relevant publications:

data-centric methods for improving model capabilities

Selected Work

• Developing new post-training recipes and methods: Tülu 3, Merge to Learn
• New and interesting model evaluations: RewardBench, RewardBench 2, Bidimensional Leaderboards

open science and democratizing access to large models

Selected Work

• Openly releasing large(-ish) models and datasets: OLMo, OLMo 2, Dolma
• Exploring alternative model architectures: OLMoE, FlexOLMo

environmental and societal impacts of AI systems

Selected Work

• Measuring the environmental impact of training LLMs: [1] (ICLR 2025 Spotlight), [2], [3]
• Exploring AI legal risks and questions: [1], [2], [3]

Selected Awards & Fellowships

• May 2025: Mercor Graduate Fellowship Finalist
• August 2024: ACL Theme Paper Award
• August 2024: ACL Best Resource Paper Award
• April 2024: GeekWire Innovation of the Year
• August 2023: NSF Computer Science Graduate Fellowship

Publications

2025

• FlexOLMo: Open Language Models for Flexible Data Use
  Weijia Shi, Akshita Bhagia, Kevin Farhat, Niklas Muennighoff, Evan Pete Walsh, Jacob Morrison, Dustin Schwenk, Shayne Longpre, Jake Poznanski, Allyson Ettinger, Daogao Liu, Margaret Li, Mike Lewis, Wen-tau Yih, Dirk Groeneveld, Luca Soldaini, Kyle Lo, Noah A. Smith, Luke Zettlemoyer, Pang Wei Koh, Hannaneh Hajishirzi, Ali Farhadi, Sewon Min
  Under review
• RewardBench 2: Advancing Reward Model Evaluation
  Saumya Malik, Valentina Pyatkin, Sander Land, Jacob Morrison, Noah A. Smith, Hannaneh Hajishirzi, Nathan Lambert
  Under review
• 2 OLMo 2 Furious
  OLMo Team, Pete Walsh, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Shane Arora, Akshita Bhagia, Yuling Gu, Shengyi Huang, Matt Jordan, Nathan Lambert, Dustin Schwenk, Oyvind Tafjord, Taira Anderson, David Atkinson, Faeze Brahman, Christopher Clark, Pradeep Dasigi, Nouha Dziri, Michal Guerquin, Hamish Ivison, Pang Wei Koh, Jiacheng Liu, Saumya Malik, William Merrill, Lester James V. Miranda, Jacob Morrison, Tyler Murray, Crystal Nam, Valentina Pyatkin, Aman Rangapur, Michael Schmitz, Sam Skjonsberg, David Wadden, Christopher Wilhelm, Michael Wilson, Luke Zettlemoyer, Ali Farhadi, Noah A. Smith, Hannaneh Hajishirzi
  COLM 2025 paper blog

2024

• Tülu 3: Pushing Frontiers in Open Language Model Post-Training
  Nathan Lambert, Jacob Morrison, Valentina Pyatkin, Shengyi Huang, Hamish Ivison, Faeze Brahman, Lester James V. Miranda, Alisa Liu, Nouha Dziri, Shane Lyu, Yuling Gu, Saumya Malik, Victoria Graf, Jena D. Hwang, Jiangjiang Yang, Ronan Le Bras, Oyvind Tafjord, Chris Wilhelm, Luca Soldaini, Noah A. Smith, Yizhong Wang, Pradeep Dasigi, Hannaneh Hajishirzi
  COLM 2025 paper blog
• Holistically Evaluating the Environmental Impact of Creating Language Models
  Jacob Morrison, Clara Na, Jared Fernandez, Tim Dettmers, Emma Strubell, Jesse Dodge
  ICLR 2025 🔦 Spotlight Paper 🔦
• OLMoE: Open Mixture-of-Experts Language Models
  Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Jacob Morrison, Sewon Min, Weijia Shi, Pete Walsh, Oyvind Tafjord, Nathan Lambert, Yuling Gu, Shane Arora, Akshita Bhagia, Dustin Schwenk, David Wadden, Alexander Wettig, Binyuan Hui, Tim Dettmers, Douwe Kiela, Ali Farhadi, Noah A. Smith, Pang Wei Koh, Amanpreet Singh, Hannaneh Hajishirzi
  NeurIPS 2024 Workshop on Efficient Natural Language and Speech Processing (spotlight) 🔦 Spotlight Paper 🔦
  ICLR 2025 paper 🗣️ Oral Presentation 🗣️
• Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
  Jacob Morrison, Noah A. Smith, Hannaneh Hajishirzi, Pang Wei Koh, Jesse Dodge, Pradeep Dasigi
  Findings of EMNLP 2024 paper
• SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature
  David Wadden*, Kejian Shi*, Jacob Morrison, Aakanksha Naik, Shruti Singh, Nitzan Barzilay, Kyle Lo, Tom Hope, Luca Soldaini, Shannon Zejiang Shen, Doug Downey, Hannaneh Hajishirzi, Arman Cohan
  arXiv paper
• RewardBench: A Benchmark for Evaluating Reward Models
  Nathan Lambert, Valentina Piyatkin, Jacob Morrison, LJ Miranda, Bill Yuchen Lin, Khyathi Chandu, Tom Zick, Yejin Choi, Noah A. Smith, Hannaneh Hajishirzi
  Findings of NAACL 2025 paper code leaderboard
• Intentionally Unintentional Speech: Why Generative AI Models Are Not Protected by the First Amendment
  David Atkinson, Jena D. Hwang, Jacob Morrison
  First Amendment Law Review (University of North Carolina), Spring 2025 paper
• Unsettled Law in the Age of Generative AI: Time to Generate New Approaches?
  David Atkinson, Jacob Morrison
  Journal of Law and Technology at Texaspaper
• A Legal Risk Taxonomy for Generative Artificial Intelligence
  David Atkinson, Jacob Morrison
  arXiv preprint paper
• OLMo: Accelerating the Science of Language Models
  Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi
  ACL 2024 paper 🥇 Theme Paper Award 🥇
• Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
  Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Evan Pete Walsh, Hannaneh Hajishirzi, Noah A. Smith, Luke Zettlemoyer, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo
  ACL 2024 paper 🥇 Best Resource Paper Award 🥇

2022

• Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand
  Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Lavinia Dunagan, Jacob Morrison, Alexander R. Fabbri, Yejin Choi, Noah A. Smith
  NAACL 2022 paper
• Transparent Human Evaluation for Image Captioning
  Jungo Kasai, Keisuke Sakaguchi, Lavinia Dunagan, Jacob Morrison, Ronan Le Bras, Yejin Choi, Noah A. Smith
  NAACL 2022 paper