🏢 NLCo Lab, BIGAI
From Hours to Minutes: Lossless Acceleration of Ultra Long Sequence Generation up to 100K Tokens
·4298 words·21 mins·
loading
·
loading
AI Generated
🤗 Daily Papers
Natural Language Processing
Text Generation
🏢 NLCo Lab, BIGAI
TokenSwift: Accelerate LLM ultra-long sequence generation up to 100K tokens with >3x speedup and lossless accuracy!