Yoav Gelberg

Yoav Gelberg

About Me

I'm a PhD student at the University of Oxford, supervised by Haggai Maron, Michael Bronstein and Yarin Gal. My research focuses on the symmetry and structure of neural network parameter spaces with application to deep (meta-)learning. I'm also interested in architecture reserach more broadly and in the way structure can inform learning. I spent the summer of 2025 at Sakana AI, working on positional embeddings and length generalization in LLMs.

Before Oxford, I completed my undergraduate studies at the Technion as a Rothschild scholar, studied expander graphs at the Weizmann Institute, developed fair learning algorithms at Fairgen, and taught math and programming at the ARDC. My PhD is funded by the EPSRC through the AIMS CDT program.

Selected Publications

* denotes equal contribution; full list on Google Scholar

GradMetaNet

GradMetaNet: An Equivariant Architecture for Learning on Gradients

Yoav Gelberg*, Yam Eitan*, Aviv Navon, Aviv Shamsian, Theo (Moe) Putterman, Michael Bronstein, Haggai Maron

Venue: NeurIPS 2025

Also at: Weight Space Learning Workshop @ ICLR 2025

LoL

Leaning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Models

Theo (Moe) Putterman*, Derek Lim*, Yoav Gelberg, Stephanie Jegelka, Haggai Maron

Venue: LoG 2025, Oral Presentation 🎤

Also At: Weight Space Learning Workshop @ ICLR 2025

Misalignment

Misalignment Between Vision-Language Representations in Vision-Language Models

Yonatan Gideoni, Yoav Gelberg, Tim G. J. Rudner, Yarin Gal

Venue: UniReps + CogInterp Workshops @ NeurIPS 2025

LOSNet

Beyond Next Token Probabilities: Learnable, Fast Detection of Hallucinations and Data Contamination on LLM Output Distributions

Fabrizio Frasca*, Guy Bar-Shalom*, Derek Lim, Yoav Gelberg, Yftah Ziser, Ran El-Yaniv, Gal Chechik, Haggai Maron

Venue: R2-FM Workshop @ ICML 2025

Topological Blindspots

Topological Blindspots: Understanding and Extending Topological Deep Learning Through the Lens of Expressivity

Yam Eitan*, Yoav Gelberg*, Guy Bar-Shalom, Fabrizio Frasca, Michael Bronstein, Haggai Maron

Venue: ICLR 2025, Oral Presentation 🎤

KL Divergence

Variational Inference Failures Under Model Symmetries: Permutation Invariant Posteriors for Bayesian Neural Networks

Yoav Gelberg, Tycho van der Ouderaa, Mark van der Wilk, Yarin Gal

Venue: GRaM Workshop @ ICML 2024, Best Paper Award 🏆