🏢 Generative AI Research Lab (GAIR)
O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?
·2809 words·14 mins·
loading
·
loading
AI Generated
🤗 Daily Papers
Natural Language Processing
Large Language Models
🏢 Generative AI Research Lab (GAIR)
Simple distillation from OpenAI’s API, combined with fine-tuning, surprisingly surpasses OpenAI’s O1-preview on complex mathematical reasoning, urging transparency in AI research.