Jason Tichy

Jason is the lead solutions architect dedicated to NVIDIA Grace product line at NVIDIA, known for his expertise in ARM architectures and low-powered computing solutions. His work primarily focuses on optimizing software on ARM CPUs for enhanced performance in AI applications and energy-efficient computing. Jason’s contributions have been pivotal in the development of technology enabled on ARM, first leading to breakthroughs in autonomous vehicles and IoT devices utilizing NVIDIA Jetson, now bringing high performance energy efficient compute back to the datacenter. His work not only reflects technical excellence but also a commitment to innovating for a sustainable future.
Avatar photo

Posts by Jason Tichy

Decorative image.
AI Platforms / Deployment

Accelerate Large-Scale LLM Inference and KV Cache Offload with CPU-GPU Memory Sharing

Large Language Models (LLMs) are at the forefront of AI innovation, but their massive size can complicate inference efficiency. Models such as Llama 3 70B and... 7 MIN READ