Shashank Verma

Shashank Verma is a deep learning technical marketing engineer at NVIDIA. He is responsible for developing and presenting developer-focused content on various deep learning frameworks. He obtained his master's in electrical engineering from the University of Wisconsin-Madison, where he focused on computer vision, security aspects in data science, and HPC.
Avatar photo

Posts by Shashank Verma

A larger and smaller cartoon llama on a sunny beach, wearing shirts that say 8B and 4B.
Generative AI Feb 12, 2025

LLM Model Pruning and Knowledge Distillation with NVIDIA NeMo Framework

Model pruning and knowledge distillation are powerful cost-effective strategies for obtaining smaller language models from an initial larger sibling. ... 10 MIN READ
Generative AI Aug 16, 2024

Leverage the Latest Open Models for Synthetic Data Generation with NVIDIA Nemotron-4-340B

This post was updated on August 16, 2024 to reflect the most recent Reward Bench results. Since the introduction and subsequent wide adoption of large language... 8 MIN READ
Generative AI Jul 10, 2024

Customizing NVIDIA NIM for Domain-Specific Needs with NVIDIA NeMo

Large language models (LLMs) adopted for specific enterprise applications most often benefit from model customization. Enterprises need to tailor ‌LLMs for... 11 MIN READ
Generative AI Jun 07, 2024

Seamlessly Deploying a Swarm of LoRA Adapters with NVIDIA NIM

The latest state-of-the-art foundation large language models (LLMs) have billions of parameters and are pretrained on trillions of tokens of input text. They... 11 MIN READ
Illustration representing LLMs.
Generative AI Feb 28, 2024

Unlock Your LLM Coding Potential with StarCoder2

Coding is essential in the digital age, but it can also be tedious and time-consuming. That's why many developers are looking for ways to automate and... 7 MIN READ
Illustration demonstrating RAG.
Generative AI Feb 23, 2024

Evaluating Retriever for Enterprise-Grade RAG

The conversation about designing and evaluating Retrieval-Augmented Generation (RAG) systems is a long, multi-faceted discussion. Even when we look at retrieval... 14 MIN READ