← Flash PapersMixtral of Experts: Deep Dive

Share this Flash Paper

Mixtral of Experts: Deep Dive

https://flashpapers.ai/p/wtg5wtq4wt
Post to XPost to BlueskyShare on LinkedInSubmit to Hacker NewsSubmit to RedditEmail a link
Make your own
Albert Q. Jiang, Alexandre Sablayrolles +24 more
cs.LG2024arXiv:2401.04088Code· 11k★· updated 3mo ago
Details ▸
MMLU:70.6%· MMLUHumanEval:40.2%· HumanEvalGSM8K:74.4%· GSM8KMBPP:60.7%· MBPP
Concepts:Mixture of ExpertsDirect Preference Optimization