Research Publications 229 publications Date 17 Jan 24 17 January 2024 Title Asynchronous Local-SGD Training forLanguage Modeling Authors Bo Liu*, Arthur Douillard, Rachita Chhaparia, Jiajun Shen, Andrei Rusu, Arthur Szlam, Marc'aurelio Ranzato, Satyen Kale Venue arXiv Date 16 Jan 24 16 January 2024 Title GATS: Gather-Attend-Scatter Authors Konrad Zolna, Serkan Cabi, Yutian Chen, Eric Lau, Claudio Fantacci, Jurgis Pasukonis, Jost Tobias Springenberg, Sergio Gomez Venue arXiv Date 16 Jan 24 16 January 2024 Title Generative Adversarial Equilibrium Solvers Authors Denizalp Goktas, David C. Parkes, Ian Gemp, Luke Marris, Georgios Piliouras, Romuald Elie, Guy Lever, Andrea Tacchetti Venue ICLR 2024 Date 16 Jan 24 16 January 2024 Title NfgTransformer: Equivariant Representation Learning for Normal-form Games Authors Siqi Liu, Luke Marris, Ian Gemp, Georgios Piliouras, Nicolas Heess Venue ICLR 2024 Date 16 Jan 24 16 January 2024 Title Approximating Nash Equilibria in Normal-Form Games via Stochastic Optimization Authors Ian Gemp, Luke Marris, Georgios Piliouras Venue ICLR 2024 Date 16 Jan 24 16 January 2024 Title Directly Fine-Tuning Diffusion Models on Differentiable Rewards Authors Kevin Clark*, Paul Vicol*, Kevin Swersky, David J. Fleet Venue ICLR 2024 Date 16 Jan 24 16 January 2024 Title On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes Authors Rishabh Agarwal, Nino Vieillard, Yongchao Zhou, Piotr Stanczyk, Sabela Ramos, mfgeist , Olivier Bachem Venue ICLR 2024 Date 11 Jan 24 11 January 2024 Title Learning Planning-compatible Cognitive Maps with Transformers in PartiallyObserved Environments Authors Antoine Dedieu, Wolfgang Lehrach, Guangyao Zhou, Dileep George, Miguel Lázaro-Gredilla Venue arXiv Date 10 Jan 24 10 January 2024 Title Distributional reinforcement learning in prefrontal cortex Authors Timothy Muller*, James Butler*, Sebastijan Veselic*, Bruno Miranda*, Timothy Behrens*, Zeb Kurth-Nelson, Steve Kennerley* Venue Nature Neuroscience Date 4 Jan 24 4 January 2024 Title AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents Authors Alex Irpan, Keerthana Gopalakrishnan, Sergey Levine, Ted Xiao, Peng Xu, Ryan Julian, Sean Kirmani, Debidatta Dwibedi, Karol Hausman, Dorsa Sadigh, ichter , yaolug , Stefan Welker, Pannag Sanketi, Kanishka Rao, Edward Lee, Fei Xia, Isabel Leal, Pierre Sermanet, Nikhil Joshi, Zhuo Xu, Quan Vuong, Michael Ahn, chelseaf , Montse Gonzalez Arenas, Steve Xu, Sharath Maddineni Venue arXiv Date 25 Dec 23 25 December 2023 Title GenCast: learning skillful ensemble forecasting of medium-range weather Authors Ilan Price, Matthew Willson, Alvaro Sanchez, Peter Battaglia, Remi Lam, Ferran Alet, Jacklynn Stott, Timo Ewalds, Shakir Mohamed Venue arXiv Date 20 Dec 23 20 December 2023 Title Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model Authors Saurabh Saxena, Junhwa Hur, Charles Herrmann, Deqing Sun, David Fleet Venue arXiv Date 19 Dec 23 19 December 2023 Title Equivariant MuZero Authors Andreea Deac*, Theophane Weber, George Papamakarios Venue Transactions on Machine Learning Research (TMLR) Date 15 Dec 23 15 December 2023 Title Learning Silicon Dopant Transitions in Graphene using Scanning Transmission Electron Microscopy Authors Max Schwarzer, Jesse Farebrother, Joshua Greaves, Ekin Dogus Cubuk, Rishabh Agarwal, Aaron Courville, Marc G. Bellemare, Sergei Kalinin, Igor Mordatch, Pablo Samuel Castro, Kevin M. Roccapriore Venue NeurIPS Workshop 2023 Date 15 Dec 23 15 December 2023 Title Challenges with unsupervised LLM knowledge discovery Authors Sebastian Farquhar, Vikrant Varma, Zachary Kenton, Johannes Gasteiger, Vladimir Mikulik, Rohin Shah Venue arXiv Date 14 Dec 23 14 December 2023 Title Meta-in-context learning in large language models Authors Julian Coda-Forno, Marcel Binz, Zeynep Akata, Matthew Botvinick, Jane X. Wang, Eric Schulz Venue NeurIPS 2023 Date 12 Dec 23 12 December 2023 Title Online RL in Linearly $q^\pi$-Realizable MDPs Is as Easy as in Linear MDPs If You Learn What to Ignore Authors Gellért Weisz, Andras Gyorgy, Csaba Szepesvari Venue NeurIPS 2023 Date 12 Dec 23 12 December 2023 Title A Simple Recipe for Contrastively Pre-training Video-First Encoders Beyond 16 Frames Authors Nelly Papalampidi, Skanda Koppula, Shreya Pathak, Justin Chiu, Viorica Patraucean, Joe Heyward, Jiajun Shen, Antoine Miech, Andrew Zisserman, Aida Nematzadeh Venue CVPR 2024 Date 12 Dec 23 12 December 2023 Title Rethinking the Role of Token Retrieval in Multi-Vector Retrieval Authors Jinhyuk Lee, Zhuyun Dai, Sai Meher Karthik Duddu, Tao Lei, Iftekhar Naim, Ming-Wei Chang, Vincent Zhao Venue NeurIPS 2023 Date 12 Dec 23 12 December 2023 Title Schema-learning and rebinding as mechanisms of in-context learning and emergence Authors Sivaramakrishnan Swaminathan, Antoine Dedieu, Rajkumar Vasudeva Raju, Murray Shanahan, Miguel Lázaro-Gredilla, Dileep George Venue NeurIPS 2023 Page 1 (first page) … Page 7 Page 8 Page 9 … Page 12 (last page)