Publications

Date: 11 Feb 25 11 February 2025
Title: Scaling Pre-training to One Hundred Billion Data for Vision Language Models
Authors: Xiao Wang, Ibrahim Alabdulmohsin, Daniel Salz, Zhe Li, Keran Rong, Xiaohua Zhai*
Venue: arXiv

Date: 22 Jan 25 22 January 2025
Title: Are vision-language models shape or texture biased and can we steer them?
Authors: Paul Gavrikov, Jovita Lukasik, Steffen Jung, Robert Geirhos, Muhammad Jehanzeb Mirza, Margret Keuper, Janis Keuper
Venue: ICLR 2025

Date: 22 Jan 25 22 January 2025
Title: MONA: Myopic Optimization with Non-myopic Approval Can Mitigate Multi-step Reward Hacking
Authors: Sebastian Farquhar, Vikrant Varma, David Lindner, David Elson, Caleb Biddulph, Ian Goodfellow, Rohin Shah
Venue: arXiv

Date: 31 Dec 24 31 December 2024
Title: Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Web
Authors: Hiroki Furuta, Yutaka Matsuo, Aleksandra Faust, Izzeddin Gur
Venue: Transactions on Machine Learning Research (TMLR)

Date: 10 Dec 24 10 December 2024
Title: Machine Unlearning Doesn’t Do What You Think: Lessons for Generative AI Policy, Research, and Practice
Authors: A. Feder Cooper, Christopher A. Choquette-Choo, Miranda Bogen, Matthew Jagielski, Katja Filippova, Ken Ziyu Liu, Alexandra Chouldechova, Jamie Hayes, Yangsibo Huang, Niloofar Mireshghallah, Ilia Shumailov, Eleni Triantafillou, Peter Kairouz, Nicole Mitchell, Percy Liang, Daniel E. Ho, Yejin Choi, Sanmi Koyejo, Fernando Delgado, James Grimmelmann, Vitaly Shmatikov, Christopher De Sa, Solon Barocas, Amy Cyphert, Mark Lemley, danah boyd, Jennifer Wortman Vaughan, Miles Brundage, David Bau, Seth Neel, Abigail Z. Jacobs, Andreas Terzis, Hanna Wallach, Nicolas Papernot, Katherine Lee
Venue: arXiv

Date: 9 Dec 24 9 December 2024
Title: Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertainty
Authors: Zi Wang, Meera Hahn, Wenjun Zeng, Nithish Kannen, Been Kim, Rich Galt, Kartikeya Badola
Venue: arXiv

Date: 4 Dec 24 4 December 2024
Title: Mastering Board Games by External and Internal Planning with Language Models
Authors: John Schultz, Jakub Adamek, Matej Jusup, Marc Lanctot, Michael Kaisers, Sarah Perrin, Daniel Hennes, Jeremy Shar, Cannada Lewis, Anian Ruoss, Tom Zahavy, Petar Veličković, Laurel Prince, Satinder Singh, Eric Malmi, Nenad Tomašev
Venue: arXiv

Date: 26 Nov 24 26 November 2024
Title: How Well Do Large Language Models Perform Latent Multi-Hop Reasoning without Exploiting Shortcuts?
Authors: Sohee Yang, Nora Kassner, Elena Gribovskaya, Sebastian Riedel, Mor Geva
Venue: arXiv

Date: 18 Oct 24 18 October 2024
Title: AI can help humans find common ground in democratic deliberation
Authors: Michael Henry Tessler†, Michiel A Bakker†, Daniel Jarrett, Hannah Sheahan*, Martin Chadwick, Raphael Koster, Georgina Evans, Lucy Campbell-Gillingham, Teddy Collins*, David C Parkes*, Matthew Botvinick, Christopher Summerfield*
Venue: Science

Date: 14 Oct 24 14 October 2024
Title: Predicting from Strings: Language Model Embeddings for Bayesian Optimization
Authors: Tung Nguyen, Qiuyi Zhang, Bangding Yang, Chansoo Lee, Jorg Bornschein, Yingjie Miao, Sagi Perel, Yutian Chen, Xingyou Song
Venue: arXiv

Date: 9 Oct 24 9 October 2024
Title: Diffusion model predictive control
Authors: Stannis Zhou, Siva Swaminathan, Rajkumar Vasudeva Raju, Swaroop Guntupalli, Wolfgang Lehrach, Joseph Ortiz, Antoine Dedieu, Miguel Lazaro-Gredilla, Kevin Murphy
Venue: arXiv

Date: 26 Sep 24 26 September 2024
Title: Geometric-Averaged Preference Optimization for Soft Preference Labels
Authors: Hiroki Furuta, Kuang-Huei Lee, Shixiang Shane Gu, Yutaka Matsuo, Aleksandra Faust, Heiga Zen, Izzeddin Gur
Venue: NeurIPS 2024

Date: 21 Sep 24 21 September 2024
Title: Learned feature representations are biased by complexity, learning order, position, and more
Authors: Andrew Lampinen, Stephanie Chan, Katherine Hermann
Venue: Transactions on Machine Learning Research (TMLR)

Date: 19 Sep 24 19 September 2024
Title: Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queries
Authors: Kiran Vodrahalli, Santiago Ontanon, Nilesh Tripuraneni, Kelvin Xu, Sanil Jain, Rakesh Shivanna, Jeffrey Hui, Nishanth Dikkala, Mehran Kazemi, Bahar Fatemi, Rohan Anil, Ethan Dyer, Siamak Shakeri, Roopali Vij, Harsh Mehta, Vinay Ramasesh, Quoc Le, Ed Chi, Yifeng Lu, Orhan Firat, Angeliki Lazaridou, Jean-Baptiste Lespiau, Nithya Attaluri, Kate Olszewska
Venue: arXiv

Explore our other teams and product areas