↓Skip to main content

🏢 Alibaba Group

SlimGPT: Layer-wise Structured Pruning for Large Language Models
·2966 words·14 mins· loading · loading
AI Generated Natural Language Processing Large Language Models 🏢 Alibaba Group
SlimGPT: Achieve near-optimal LLM structured pruning via Batched Greedy Pruning and Incremental Pruning Ratio, improving efficiency without sacrificing accuracy.
MoGenTS: Motion Generation based on Spatial-Temporal Joint Modeling
·2749 words·13 mins· loading · loading
AI Generated Multimodal Learning Vision-Language Models 🏢 Alibaba Group
MoGenTS revolutionizes human motion generation by quantizing individual joints into 2D tokens, enabling efficient spatial-temporal modeling and significantly outperforming existing methods.
Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources
·3653 words·18 mins· loading · loading
AI Generated Natural Language Processing Large Language Models 🏢 Alibaba Group
FlexLoRA: Efficient Federated Fine-tuning of LLMs for Heterogeneous Tasks and Resources.
$eta$-DPO: Direct Preference Optimization with Dynamic $eta$
·2106 words·10 mins· loading · loading
Natural Language Processing Large Language Models 🏢 Alibaba Group
β-DPO dynamically adjusts a key parameter in Direct Preference Optimization, significantly improving LLM alignment with human preferences.