Embodied AI / Agents

cs.AI · 9 papers

cs.AI · 2023

Voyager: An Open-Ended Embodied Agent with LLMs

Guanzhi Wang, Yuqi Xie +6

We introduce Voyager, the first LLM-powered embodied lifelong learning agent in Minecraft that continuously explores the world, acquires diverse skills, and makes novel…

Code· 7.0k★

cs.LG · 2021

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

pre-training speedup: 7x

William Fedus, Barret Zoph, Noam Shazeer

In deep learning, models typically reuse the same parameters for all inputs. Mixture of Experts (MoE) defies this and instead selects different parameters for each incoming…

Code· 3.0k★

cs.CV · 2020

An Image is Worth 16x16 Words: Vision Transformers

ImageNet-1K: 88.55%

Alexey Dosovitskiy, Lucas Beyer +10

While the Transformer architecture has become the de-facto standard for natural language processing tasks, its applications to computer vision remain limited. In vision,…

Code· 13k★