Jay Shah

Jay Shah is a research scientist in accelerated computing at Colfax International, a leading Silicon Valley-based provider of custom computing solutions. He leads Colfax’s efforts to optimize ML/AI applications for the latest NVIDIA GPU architectures. Prior to joining Colfax, he earned a Ph.D. in mathematics from MIT in 2017 and held several academic positions, where he conducted and published research on topology and higher category theory.
Avatar photo

Posts by Jay Shah

Models / Libraries / Frameworks

CUTLASS 3.x: Orthogonal, Reusable, and Composable Abstractions for GEMM Kernel Design

GEMM optimization on GPUs is a modular problem. Performant implementations need to specify hyperparameters such as tile shapes, math and copy instructions, and... 12 MIN READ