Embodied AI / Agents
cs.AI · 3 papers
cs.AI · 2023
Voyager: An Open-Ended Embodied Agent with LLMs
Minecraft (MineDojo): 63Guanzhi Wang, Yuqi Xie +6
We introduce Voyager, the first LLM-powered embodied lifelong learning agent in Minecraft that continuously explores the world, acquires diverse skills, and makes novel…
Code· 7.0k★
cs.LG · 2021
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
pre-training speedup: 7xWilliam Fedus, Barret Zoph, Noam Shazeer
In deep learning, models typically reuse the same parameters for all inputs. Mixture of Experts (MoE) defies this and instead selects different parameters for each incoming…
Code· 3.0k★
cs.CV · 2020
An Image is Worth 16x16 Words: Vision Transformers
ImageNet-1K: 88.55%Alexey Dosovitskiy, Lucas Beyer +10
While the Transformer architecture has become the de-facto standard for natural language processing tasks, its applications to computer vision remain limited. In vision,…
Code· 13k★