🏢 Yandex
PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression
·3701 words·18 mins·
loading
·
loading
Large Language Models
🏢 Yandex
PV-Tuning achieves new state-of-the-art in extreme LLM compression by going beyond traditional straight-through estimators (STE). This novel framework provides a more accurate and efficient fine-tunin…