Skip to main content

🏢 University of Washington

Stronger Models are NOT Stronger Teachers for Instruction Tuning
·3212 words·16 mins
AI Generated 🤗 Daily Papers Natural Language Processing Large Language Models 🏢 University of Washington
Larger language models aren’t always better teachers for instruction tuning; a new metric, CAR, predicts teacher model effectiveness better than existing methods.