🏢 Daegu Gyeongbuk Institute of Science and Technology
SpikedAttention: Training-Free and Fully Spike-Driven Transformer-to-SNN Conversion with Winner-Oriented Spike Shift for Softmax Operation
·2001 words·10 mins·
loading
·
loading
Natural Language Processing
Question Answering
🏢 Daegu Gyeongbuk Institute of Science and Technology
SpikedAttention: Training-free transformer-to-SNN conversion achieving state-of-the-art accuracy and 42% energy reduction!