← Flash Papers
LoRA: Low-Rank Adaptation of Large Language Models
Share
Share this Flash Paper
LoRA: Low-Rank Adaptation of Large Language Models
https://flashpapers.ai/p/axwndcargc
Copy link
Post to X
Post to Bluesky
Share on LinkedIn
Submit to Hacker News
Submit to Reddit
Email a link
Source PDF ↗
Open standalone ↗
Make your own
Make your own paper
Edward J. Hu, Yelong Shen +6 more
cs.CL
2021
arXiv:2106.09685
Code
· 14k★
· updated 2y ago
Details ▸
Details ▴
WikiSQL Accuracy:
74.0%
· WikiSQL
MultiNLI Accuracy:
91.7%
· MultiNLI
Trainable Parameters Reduction:
10000x
· GPT-3 175B
GPU Memory Requirement Reduction:
3x
· GPT-3 175B
WikiSQL Accuracy:
74.0%
· WikiSQL
MultiNLI Accuracy:
91.7%
· MultiNLI
Trainable Parameters Reduction:
10000x
· GPT-3 175B
GPU Memory Requirement Reduction:
3x
· GPT-3 175B
Concepts:
Transformer