Skip to main content

🏢 FPT Software AI Center

LIBMoE: A Library for comprehensive benchmarking Mixture of Experts in Large Language Models
·2387 words·12 mins
AI Generated 🤗 Daily Papers Natural Language Processing Large Language Models 🏢 FPT Software AI Center
LibMoE: A new library streamlines MoE research by offering standardized training, evaluation, and a modular design, enabling efficient benchmarking of various MoE algorithms for LLMs.