Ido Shahaf

Ido Shahaf is a research scientist on the Deci team at NVIDIA. He works on optimizing inference for generative AI through compression, quantization, sparsity, and algorithmic advances. He holds a Ph.D. in computer science from the Hebrew University of Jerusalem.
Ido Shahaf

Posts by Ido Shahaf

Agentic AI / Generative AI

ReplaySSM: Rethinking State Storage for Faster Hybrid-Model Decoding

Hybrid models interleave state-space model (SSM) layers with a few attention layers. NVIDIA Nemotron 3, Qwen3.5 through Qwen3.8, Kimi-K3, and GLM-5.3-Flash are... 14 MIN READ