← Flash PapersRGSD: Rubric-Guided Self-Distillation

Share this Flash Paper

RGSD: Rubric-Guided Self-Distillation

https://flashpapers.ai/p/masr9szhxg
Make your own
MohammadHossein Rezaei, Anas Mahmoud +7 more
Details ▸
Medical domain avg improvement (RGSD):+6.1pp· RubricHub-medical + HealthBenchScience domain avg improvement (RGSD):+4.9pp· RubricHub-science + ResearchQAMedical domain avg improvement (GRPO):+5.9pp· RubricHub-medical + HealthBenchRubric-conditioning gap (Qwen-2.5-7B, medical):+45pp· RubricHub-medical training splitGRPO false-claim rate at step 450 (Qwen-2.5-7B medical):45.1%· HealthBench-300RGSD false-claim rate at step 450 (Qwen-2.5-7B medical):35.1%· HealthBench-300
Concepts:GRPO