Vijay Thakkar

Vijay Thakkar is a senior compute architect at NVIDIA and the primary author of CUTLASS 3. In addition to his work on CUTLASS, he is involved in the development of Tensor Core architecture, PTX exposure, and programming model across the GPU architecture, compiler, and CUDA engineering teams.
Avatar photo

Posts by Vijay Thakkar

Generative AI Jul 11, 2024

Next Generation of FlashAttention

NVIDIA is excited to collaborate with Colfax, Together.ai, Meta, and Princeton University on their recent achievement to exploit the Hopper GPU architecture and... 1 MIN READ