🏢 Institute of Science and Technology Austria
The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information
·1778 words·9 mins·
loading
·
loading
Machine Learning
Deep Learning
🏢 Institute of Science and Technology Austria
I-OBS, a novel family of sparse recovery algorithms leveraging second-order information, achieves faster convergence rates for sparse DNNs, validated by large-scale experiments.
Smoke and Mirrors in Causal Downstream Tasks
·2586 words·13 mins·
loading
·
loading
AI Theory
Causality
🏢 Institute of Science and Technology Austria
AI for science faces hidden biases in causal inference; this paper reveals these flaws using ant behavior data, introducing ISTAnt benchmark, and provides guidelines for more accurate causal AI.
Neural collapse vs. low-rank bias: Is deep neural collapse really optimal?
·2988 words·15 mins·
loading
·
loading
AI Generated
AI Theory
Optimization
🏢 Institute of Science and Technology Austria
Deep neural collapse, previously believed optimal, is shown suboptimal in multi-class, multi-layer networks due to a low-rank bias, yielding even lower-rank solutions.
Matrix Denoising with Doubly Heteroscedastic Noise: Fundamental Limits and Optimal Spectral Methods
·1782 words·9 mins·
loading
·
loading
AI Generated
AI Theory
Optimization
🏢 Institute of Science and Technology Austria
Optimal matrix denoising with doubly heteroscedastic noise achieved!
Marrying Causal Representation Learning with Dynamical Systems for Science
·3100 words·15 mins·
loading
·
loading
AI Generated
AI Theory
Representation Learning
🏢 Institute of Science and Technology Austria
This study marries causal representation learning with dynamical systems to enable parameter identification in real-world scientific data, unlocking downstream causal analysis for various applications…