🏢 Georgia State University
VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks
·2846 words·14 mins·
loading
·
loading
Natural Language Processing
Large Language Models
🏢 Georgia State University
VB-LoRA achieves extreme parameter efficiency in fine-tuning LLMs by sharing parameters globally via a vector bank, outperforming state-of-the-art PEFT methods while maintaining comparable or better p…