← Flash PapersGPQA: A Graduate-Level Google-Proof Q&A Benchmark

Share this Flash Paper

GPQA: A Graduate-Level Google-Proof Q&A Benchmark

https://flashpapers.ai/p/33n983ns7m
Make your own
David Rein, Betty Li Hou +6 more
Details ▸
Expert Accuracy (Main Set):71.9%· GPQA Main SetNon-Expert Accuracy (Main Set):30.4%· GPQA Main SetGPT-4 Few-Shot CoT Accuracy (Main Set):39.7%· GPQA Main SetExpert Accuracy (Diamond Set):81.3%· GPQA Diamond SetNon-Expert Accuracy (Diamond Set):22.1%· GPQA Diamond SetGPT-4 Few-Shot CoT Accuracy (Diamond Set):38.8%· GPQA Diamond Set