🏢 Language Technology Lab, University of Amsterdam
3-in-1: 2D Rotary Adaptation for Efficient Finetuning, Efficient Batching and Composability
·2315 words·11 mins·
loading
·
loading
Natural Language Processing
Large Language Models
🏢 Language Technology Lab, University of Amsterdam
RoAd: a novel parameter-efficient finetuning method uses 2D rotation to adapt LLMs, enabling efficient batching, composability, and improved interpretability.