Publications

Date: 25 Feb 24 25 February 2024
Title: Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
Authors: Krzysztof Marcin Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamas Sarlos, Thomas Weingarten, Adrian Weller
Venue: (deprecated) AISTATS2024

Date: 23 Feb 24 23 February 2024
Title: AlphaTensor for Optimizing Quantum Computations
Authors: Francisco Ruiz, Tuomas Laakkonen*, Johannes Bausch, Matej Balog, Mohammadamin Barekatain*, Francisco Heras, Alexander Novikov, Nathan Fitzpatrick*, Bernardino Romera Paredes, John van de Wetering*, Alhussein Fawzi, Konstantinos Meichanetzidis*, Pushmeet Kohli
Venue: arXiv

Date: 23 Feb 24 23 February 2024
Title: Genie: Generative Interactive Environments
Authors: Jake Bruce, Michael Dennis, Ashley Edwards, Jack Parker-Holder, Yuge Shi, Edward Hughes, Matthew Lai, Aditi Mavalankar, Richie Steigerwald, Chris Apps, Yusuf Aytar, Sarah Bechtle, Feryal Behbahani, Stephanie Chan, Nicolas Heess, Lucy Gonzalez, Simon Osindero, Sherjil Ozair, Scott Reed, Jingwei Zhang, Konrad Zolna, Jeff Clune, Nando de Freitas, Satinder Singh, Tim Rocktäschel
Venue: arXiv

Date: 22 Feb 24 22 February 2024
Title: When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method
Authors: Biao Zhang, Zhongtao Liu, Colin Cherry, Orhan Firat
Venue: ICLR 2024

Date: 22 Feb 24 22 February 2024
Title: OmniPred: Language Models as Universal Regressors
Authors: Xingyou Song, Oscar Li, Chansoo Lee, Bangding (Jeffrey) Yang, Daiyi Peng, Sagi Perel, Yutian Chen
Venue: arXiv

Date: 20 Feb 24 20 February 2024
Title: The Next 700 ML-Enabled Compiler Optimizations
Authors: S. VenkataKeerthy*, Siddharth Jain*, Umesh Kalvakuntla*, Gorantla Pranav Sai*, Albert Cohen, Eugene Brevdo, Mircea Trofin*, Ramakrishna Upadrasta*
Venue: ACM SIGPLAN 2024 International Conference on Compiler Construction

Date: 18 Feb 24 18 February 2024
Title: Learning to Learn Faster from Human Feedback with Language Model Predictive Control
Authors: Ken Caluwaerts, Ben Jyenis, Jasmine Hsu, andyzeng , Wenhao Yu, Nik Stewart, Jacky Liang, Fei Xia, Peng Xu, Jie Tan, ichter , Erik Frey, Carolina Parada, Dorsa Sadigh, Tingnan Zhang, Ted Xiao, Zhuo Xu, Nikhil Joshi, Kuang-Huei Lee, Chase Kew, Ken Oslund, Sean Kirmani, Dushyant Rao, quanhovuong , Keerthana Gopalakrishnan, Marissa Giustina, Jonathan Tompson, Assaf Hurwitz Michaely, Baruch Tabanpour, Maria Bauza, Edward Lee, Maria Attarian, Leonard Hasenclever, Alex Bewley, Jan Humplik, Nimrod Gileadi, Joss Moore, Leila Takayama, allenren , Adil Dostmohamed, Chuyuan Kelly Fu, Ayzaan Wahid, Matt Bennice, Vincent Zhuang, Nicolas Heess, Izhak Shafran, Vincent Vanhoucke, Maja Mataric, Montse Gonzalez Arenas, Ying Xu, Kanishka Rao
Venue: arXiv

Date: 15 Feb 24 15 February 2024
Title: A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts
Authors: Kuang-Huei Lee, Xinyun Chen, Hiroki Furuta, John Canny, Ian Fischer
Venue: arXiv

Date: 15 Feb 24 15 February 2024
Title: Experts Don't Cheat: Learning What You Don't Know by Predicting Pairs
Authors: Daniel D. Johnson, Daniel Tarlow, David Duvenaud, Chris J. Maddison
Venue: arXiv

Date: 13 Feb 24 13 February 2024
Title: A Distributional Analogue to the Successor Representation
Authors: Harley Wiltzer*, Jesse Farebrother, Arthur Gretton, Yunhao Tang, Andre Barreto, Will Dabney, Marc Bellemare*, Mark Rowland
Venue: arXiv

Date: 12 Feb 24 12 February 2024
Title: Near-Minimax-Optimal Distributional RL with a Generative Model
Authors: Mark Rowland, Kevin Li, Remi Munos, Clare Lyle, Yunhao Tang, Will Dabney
Venue: arXiv

Date: 12 Feb 24 12 February 2024
Title: PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs
Authors: Soroush Nasiriany*, Fei Xia*, Wenhao Yu, Ted Xiao*, Jacky Liang, Ishita Dasgupta, Annie Xie, Danny Driess , Ayzaan Wahid, Zhuo Xu, Quan Vuong, Tingnan Zhang, Tsang-Wei Edward Lee, Kuang-Huei Lee , Peng Xu, Sean Kirmani, Yuke Zhu, Andy Zeng, Karol Hausman, Nicolas Heess, Chelsea Finn, Sergey Levine, Brian Ichter*
Venue: arXiv

Date: 11 Feb 24 11 February 2024
Title: Chain-of-Table: Evolves Tables in the LLM Reasoning Chain for Table Understanding
Authors: Zilong Wang*, Chen-Yu Lee, chunliang , Hao Zhang, Julian Eisenschlos, Lesly Miculicich, Tomas Pfister, Vincent Perot, Yasuhisa Fujii, Zifeng Wang, Jingbo Shang*
Venue: ICLR 2024

Date: 8 Feb 24 8 February 2024
Title: Prior-Dependent Allocations for Bayesian Fixed-Budget Best-Arm Identification in Structured Bandits
Authors: Nicolas Nguyen, Imad Aouali, András György, Claire Vernade
Venue: arXiv

Date: 8 Feb 24 8 February 2024
Title: Memory Consolidation Enables Long-Context Video Understanding
Authors: Ivana Balazevic, Jimmy Shi, Nelly Papalampidi, Rahma Chaabouni, Skanda Koppula, Olivier Henaff
Venue: arXiv

Date: 6 Feb 24 6 February 2024
Title: States as Strings as Strategies: Steering Language Models with Game-Theoretic Solvers
Authors: Ian Gemp, Yoram Bachrach, Marc Lanctot, Roma Patel, Vibhavari Dasagi, Luke Marris, Georgios Piliouras, Siqi Liu, Karl Tuyls
Venue: arXiv

Date: 6 Feb 24 6 February 2024
Title: Large Language Models Self-Discover Reasoning Structures
Authors: Pei Zhou*, Jay Pujara*, Xiang Ren*, Swaroop Mishra, Steven Zheng, Denny Zhou, Heng-Tze Cheng, Quoc Le, Ed Chi, Xinyun Chen
Venue: arXiv

Explore our other teams and product areas