🏢 University of Washington
Stronger Models are NOT Stronger Teachers for Instruction Tuning
·3212 words·16 mins
AI Generated
🤗 Daily Papers
Natural Language Processing
Large Language Models
🏢 University of Washington
Larger language models aren’t always better teachers for instruction tuning; a new metric, CAR, predicts teacher model effectiveness better than existing methods.