🏢 National University of Singapore
X-Ray: A Sequential 3D Representation For Generation
·2206 words·11 mins·
loading
·
loading
3D Vision
🏢 National University of Singapore
X-Ray: A novel 3D representation generating complete object surfaces from a single image!
VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstruction
·2586 words·13 mins·
loading
·
loading
Computer Vision
3D Vision
🏢 National University of Singapore
VCR-GauS: Novel view-consistent depth-normal regularizer for superior, real-time 3D surface reconstruction using Gaussian splatting.
Unveiling the Hidden Structure of Self-Attention via Kernel Principal Component Analysis
·2602 words·13 mins·
loading
·
loading
AI Theory
Robustness
🏢 National University of Singapore
Self-attention, a key component of transformers, is revealed to be a projection of query vectors onto the principal components of the key matrix, derived from kernel PCA. This novel perspective leads…
Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in LLMs
·3889 words·19 mins·
loading
·
loading
Natural Language Processing
Large Language Models
🏢 National University of Singapore
Uncertainty of Thoughts (UoT) algorithm significantly boosts LLMs’ information-seeking abilities, leading to substantial performance gains across diverse tasks.
Stochastic Taylor Derivative Estimator: Efficient amortization for arbitrary differential operators
·2876 words·14 mins·
loading
·
loading
🏢 National University of Singapore
Stochastic Taylor Derivative Estimator (STDE) drastically accelerates the optimization of neural networks involving high-dimensional, high-order differential operators by efficiently amortizing comput…
SpeedLoader: An I/O efficient scheme for heterogeneous and distributed LLM operation
·1914 words·9 mins·
loading
·
loading
Natural Language Processing
Large Language Models
🏢 National University of Singapore
SpeedLoader: A groundbreaking I/O efficient scheme dramatically boosts LLM training & inference speed on diverse hardware, even with limited resources!
Sparsity-Agnostic Linear Bandits with Adaptive Adversaries
·336 words·2 mins·
loading
·
loading
Machine Learning
Reinforcement Learning
🏢 National University of Singapore
SparseLinUCB: First sparse regret bounds for adversarial action sets with unknown sparsity, achieving superior performance over existing methods!
Solving Sparse & High-Dimensional-Output Regression via Compression
·2050 words·10 mins·
loading
·
loading
AI Generated
Machine Learning
Optimization
🏢 National University of Singapore
SHORE: a novel two-stage framework efficiently solves sparse & high-dimensional output regression, boosting interpretability and scalability.
SlimSAM: 0.1% Data Makes Segment Anything Slim
·2447 words·12 mins·
loading
·
loading
Computer Vision
Image Segmentation
🏢 National University of Singapore
SlimSAM achieves near original SAM performance using 0.1% of its training data by employing a novel alternate slimming framework and disturbed Taylor pruning, significantly advancing data-efficient mo…
Semidefinite Relaxations of the Gromov-Wasserstein Distance
·2209 words·11 mins·
loading
·
loading
AI Theory
Optimization
🏢 National University of Singapore
This paper introduces a novel, tractable semidefinite program (SDP) relaxation for the Gromov-Wasserstein distance, enabling the computation of globally optimal transportation plans.
RFLPA: A Robust Federated Learning Framework against Poisoning Attacks with Secure Aggregation
·2189 words·11 mins·
loading
·
loading
Machine Learning
Federated Learning
🏢 National University of Singapore
RFLPA: Secure Federated Learning resists poisoning attacks via efficient secure aggregation.
Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective
·1781 words·9 mins·
loading
·
loading
Machine Learning
Self-Supervised Learning
🏢 National University of Singapore
SCHOOL: A novel SHGL framework enhancing spectral clustering with rank and dual consistency constraints, effectively mitigating noise and leveraging cluster-level information for improved downstream t…
Remix-DiT: Mixing Diffusion Transformers for Multi-Expert Denoising
·2025 words·10 mins·
loading
·
loading
Computer Vision
Image Generation
🏢 National University of Singapore
Remix-DiT: Boosting diffusion model image generation quality by cleverly mixing smaller basis models into numerous specialized denoisers, improving efficiency and lowering costs!
Piecewise-Stationary Bandits with Knapsacks
·380 words·2 mins·
loading
·
loading
AI Theory
Optimization
🏢 National University of Singapore
A novel inventory reserving algorithm achieves near-optimal performance for bandit problems with knapsacks in piecewise-stationary settings, offering a competitive ratio of O(log(nmax/min)).
Optimal Batched Best Arm Identification
·1734 words·9 mins·
loading
·
loading
AI Generated
Machine Learning
Reinforcement Learning
🏢 National University of Singapore
Tri-BBAI & Opt-BBAI achieve optimal asymptotic and near-optimal non-asymptotic sample & batch complexities in batched best arm identification.
OnlineTAS: An Online Baseline for Temporal Action Segmentation
·2736 words·13 mins·
loading
·
loading
AI Generated
Computer Vision
Video Understanding
🏢 National University of Singapore
OnlineTAS, a novel framework, achieves state-of-the-art performance in online temporal action segmentation by using an adaptive memory and a post-processing method to mitigate over-segmentation.
One-shot Federated Learning via Synthetic Distiller-Distillate Communication
·2841 words·14 mins·
loading
·
loading
AI Generated
Machine Learning
Federated Learning
🏢 National University of Singapore
FedSD2C, a novel one-shot federated learning framework, tackles data heterogeneity and information loss by sharing synthetic distillates directly from local data, outperforming existing methods on com…
One Sample Fits All: Approximating All Probabilistic Values Simultaneously and Efficiently
·1941 words·10 mins·
loading
·
loading
AI Generated
AI Theory
Interpretability
🏢 National University of Singapore
One-Sample-Fits-All (OFA) framework efficiently approximates all probabilistic values simultaneously, achieving faster convergence rates than existing methods.
On Softmax Direct Preference Optimization for Recommendation
·1530 words·8 mins·
loading
·
loading
Natural Language Processing
Large Language Models
🏢 National University of Singapore
Softmax-DPO boosts LM-based recommender performance by directly optimizing for personalized ranking using a novel loss function that incorporates multiple negative samples, significantly outperforming…
MVSDet: Multi-View Indoor 3D Object Detection via Efficient Plane Sweeps
·2981 words·14 mins·
loading
·
loading
AI Generated
Computer Vision
3D Vision
🏢 National University of Singapore
MVSDet uses efficient plane sweeps for accurate indoor 3D object detection from multiple images, significantly outperforming previous NeRF-based methods.