← Flash PapersThe Era of 1-bit LLMs: BitNet b1.58

Share this Flash Paper

The Era of 1-bit LLMs: BitNet b1.58

https://flashpapers.ai/p/q7h37tenxq
Post to XPost to BlueskyShare on LinkedInSubmit to Hacker NewsSubmit to RedditEmail a link
Make your own
Shuming Ma, Hongyu Wang +8 more
cs.CL2024arXiv:2402.17764Code· 22k★· updated 6mo ago
Details ▸
Energy Savings:71.4x· Arithmetic operations on 7nmLatency Speedup:4.1x· 70B model sizeMemory Reduction:3.55x· 3B model sizePerplexity (PPL):9.91· WikiText2 / C4