🏢 FPT Software AI Center
Elliptical Attention
·3508 words·17 mins·
loading
·
loading
AI Generated
AI Theory
Robustness
🏢 FPT Software AI Center
Elliptical Attention enhances transformers by using a Mahalanobis distance metric, stretching the feature space to focus on contextually relevant information, thus improving robustness and reducing re…