🏢 University of Copenhagen
LoQT: Low-Rank Adapters for Quantized Pretraining
·2483 words·12 mins·
loading
·
loading
Natural Language Processing
Large Language Models
🏢 University of Copenhagen
LoQT enables efficient large language model training on consumer hardware via quantized weights and low-rank weight updates, overcoming memory limitations.
Kermut: Composite kernel regression for protein variant effects
·4659 words·22 mins·
loading
·
loading
🏢 University of Copenhagen
Kermut: A novel Gaussian process regression model achieves state-of-the-art accuracy in predicting protein variant effects and provides reliable uncertainty estimates, crucial for protein engineering …
Exact Gradients for Stochastic Spiking Neural Networks Driven by Rough Signals
·528 words·3 mins·
loading
·
loading
AI Generated
AI Theory
Optimization
🏢 University of Copenhagen
New framework uses rough path theory to enable gradient-based training of SSNNs driven by rough signals, allowing for noise in spike timing and network dynamics.
Conditioning non-linear and infinite-dimensional diffusion processes
·1703 words·8 mins·
loading
·
loading
🏢 University of Copenhagen
Conditioning infinite-dimensional nonlinear diffusion processes is made possible, enabling analysis of complex data like organism shapes in evolutionary biology.
BMRS: Bayesian Model Reduction for Structured Pruning
·2098 words·10 mins·
loading
·
loading
🏢 University of Copenhagen
BMRS: Bayesian Model Reduction for Structured Pruning offers a principled, threshold-free approach to neural network compression, achieving high accuracy and competitive efficiency.