🏢 Northeastern University
Search for Efficient Large Language Models
·2477 words·12 mins·
loading
·
loading
Natural Language Processing
Large Language Models
🏢 Northeastern University
Training-free architecture search finds optimal subnets in LLMs, boosting inference speed and slashing memory needs without retraining.
Personalized Federated Learning via Feature Distribution Adaptation
·2044 words·10 mins·
loading
·
loading
Machine Learning
Federated Learning
🏢 Northeastern University
Personalized federated learning (PFL) often struggles with data scarcity and distribution shifts. pFedFDA, a novel algorithm, tackles this by framing representation learning as a generative modeling …
MatrixNet: Learning over symmetry groups using learned group representations
·1841 words·9 mins·
loading
·
loading
AI Theory
Representation Learning
🏢 Northeastern University
MatrixNet learns efficient group representations for improved deep learning on symmetry groups, achieving higher sample efficiency and generalization than existing methods.
GraphCroc: Cross-Correlation Autoencoder for Graph Structural Reconstruction
·2820 words·14 mins·
loading
·
loading
Machine Learning
Representation Learning
🏢 Northeastern University
GraphCroc, a novel graph autoencoder, leverages cross-correlation to accurately reconstruct complex graph structures, outperforming self-correlation-based methods.
Fast and Memory-Efficient Video Diffusion Using Streamlined Inference
·3474 words·17 mins·
loading
·
loading
AI Generated
Computer Vision
Video Understanding
🏢 Northeastern University
Streamlined Inference, a novel training-free framework, dramatically reduces the computation and memory costs of video diffusion models without sacrificing quality, enabling high-resolution video gene…
Exploring Token Pruning in Vision State Space Models
·1749 words·9 mins·
loading
·
loading
Computer Vision
Image Classification
🏢 Northeastern University
This paper introduces a novel token pruning method for vision state space models, achieving significant computational reduction with minimal performance impact, addressing the limitations of directly …
Efficient Federated Learning against Heterogeneous and Non-stationary Client Unavailability
·2482 words·12 mins·
loading
·
loading
Machine Learning
Federated Learning
🏢 Northeastern University
FedAWE, a novel federated learning algorithm, efficiently handles intermittent and unpredictable client availability, ensuring fast and unbiased model training.
Bileve: Securing Text Provenance in Large Language Models Against Spoofing with Bi-level Signature
·2033 words·10 mins·
loading
·
loading
Natural Language Processing
Large Language Models
🏢 Northeastern University
Bileve: a novel bi-level signature secures text provenance in LLMs against spoofing, enhancing detectability and reliability via fine-grained integrity checks and coarse-grained source tracing.