๐ข University of Massachusetts Amherst
Thinking Forward: Memory-Efficient Federated Finetuning of Language Models
ยท4828 wordsยท23 minsยท
loading
ยท
loading
Natural Language Processing
Large Language Models
๐ข University of Massachusetts Amherst
SPRY: A memory-efficient federated learning algorithm for finetuning LLMs on resource-constrained devices, achieving high accuracy and speed.
OSLO: One-Shot Label-Only Membership Inference Attacks
ยท2719 wordsยท13 minsยท
loading
ยท
loading
AI Theory
Privacy
๐ข University of Massachusetts Amherst
One-shot label-only attack (OSLO) achieves high membership inference accuracy with only one query, surpassing existing methods by a large margin.
Learning Representations for Hierarchies with Minimal Support
ยท2038 wordsยท10 minsยท
loading
ยท
loading
AI Theory
Representation Learning
๐ข University of Massachusetts Amherst
Learn graph representations efficiently by identifying the minimal data needed to uniquely define a graphโs structure, achieving robust performance with fewer resources.
Hamiltonian Monte Carlo Inference of Marginalized Linear Mixed-Effects Models
ยท2352 wordsยท12 minsยท
loading
ยท
loading
Machine Learning
Deep Learning
๐ข University of Massachusetts Amherst
Accelerate Bayesian inference in linear mixed-effects models by efficiently marginalizing random effects using fast linear algebra, enabling faster and more accurate posterior estimations.
Gaussian Process Bandits for Top-k Recommendations
ยท1799 wordsยท9 minsยท
loading
ยท
loading
Machine Learning
Reinforcement Learning
๐ข University of Massachusetts Amherst
GP-TopK: A novel contextual bandit algorithm uses Gaussian processes with a Kendall kernel for efficient & accurate top-k recommendations, even with limited feedback.
Fair and Welfare-Efficient Constrained Multi-Matchings under Uncertainty
ยท2515 wordsยท12 minsยท
loading
ยท
loading
AI Generated
AI Theory
Fairness
๐ข University of Massachusetts Amherst
This paper presents novel, scalable algorithms for fair and efficient constrained resource allocation under uncertainty using robust and CVaR optimization.
Attack-Resilient Image Watermarking Using Stable Diffusion
ยท3069 wordsยท15 minsยท
loading
ยท
loading
Computer Vision
Image Generation
๐ข University of Massachusetts Amherst
ZoDiac: a novel image watermarking framework leveraging pre-trained stable diffusion models for robust, invisible watermarks resistant to state-of-the-art attacks.