Transfer Learning

cs.LG · 2 papers

Featured

cs.CL · 2021

LoRA: Low-Rank Adaptation of Large Language Models

WikiSQL: 74.0%

Edward J. Hu, Yelong Shen +6

An important paradigm of natural language processing consists of large-scale pre-training on general domain data and adaptation to particular tasks or domains. As we pre-train…

Code· 14k★

cs.LG · 2019

Exploring the Limits of Transfer Learning with T5

GLUE: 90.3

Colin Raffel, Noam Shazeer +7

Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language…

Code· 6.5k★