Embodied AI / Agents
cs.AI · 4 papers
Beyond Domain-Routed Supervision: Cross-Teacher Guarding for Multi-Teacher On-Policy Distillation
Two-Domain All Avg: 47.92%Shi-Yu Tian, Yong Liu +11
Multi-teacher on-policy distillation (MOPD) extends on-policy distillation (OPD) by routing domain-specific data to specialized teachers, integrating their capabilities through…
Voyager: An Open-Ended Embodied Agent with LLMs
Minecraft (MineDojo): 63Guanzhi Wang, Yuqi Xie +6
We introduce Voyager, the first LLM-powered embodied lifelong learning agent in Minecraft that continuously explores the world, acquires diverse skills, and makes novel…
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
pre-training speedup: 7xWilliam Fedus, Barret Zoph, Noam Shazeer
In deep learning, models typically reuse the same parameters for all inputs. Mixture of Experts (MoE) defies this and instead selects different parameters for each incoming…
An Image is Worth 16x16 Words: Vision Transformers
ImageNet-1K: 88.55%Alexey Dosovitskiy, Lucas Beyer +10
While the Transformer architecture has become the de-facto standard for natural language processing tasks, its applications to computer vision remain limited. In vision,…