Optimizing Inference Efficiency for LLMs at Scale with NVIDIA NIM Microservices
As large language models (LLMs) continue to evolve at an unprecedented pace, enterprises are looking to build generative AI-powered applications that maximize...
Shader Debugging Made Easy with NVIDIA Nsight Graphics
Shaders are specialized programs that run on the GPU that manipulate rays, pixels, vertices, and textures to achieve unique visual effects. With shaders, you...
Developers from advertising agencies to software vendors are empowering global brands to deliver hyperpersonalization for digital experiences and visual...
Building Cyber Language Models to Unlock New Cybersecurity Capabilities
General-purpose large language models (LLMs) have proven their usefulness across various fields, offering substantial benefits in applications ranging from text...
Secure LLM Tokenizers to Maintain Application Integrity
This post is part of the NVIDIA AI Red Team’s continuing vulnerability and technique research. Use the concepts presented to responsibly assess and increase...
Introducing Grouped GEMM APIs in cuBLAS and More Performance Updates
The latest release of NVIDIA cuBLAS library, version 12.5, continues to deliver functionality and performance to deep learning (DL) and high-performance...
Tips for Building a RAG Pipeline with NVIDIA AI LangChain AI Endpoints
Retrieval-augmented generation (RAG) is a technique that combines information retrieval with a set of carefully designed system prompts to provide more...
Top Data Science Sessions from NVIDIA GTC 2024 Now Available On Demand
At GTC 2024, experts from NVIDIA and our partners shared insights about GPU-accelerated tools, optimizations, and best practices for data scientists. From the...
Many PC games are designed around an eight-core console with an assumption that their software threading system ‘just works’ on all PCs, especially...
Simplifying Network Operations for AI with NVIDIA Quantum InfiniBand
A common technological misconception is that performance and complexity are directly linked. That is, the highest-performance implementation is also the most...
Improving CUDA Initialization Times Using cgroups in Certain Scenarios
Many CUDA applications running on multi-GPU platforms usually use a single GPU for their compute needs. In such scenarios, a performance penalty is paid by...
Swap chains are an integral part of how you get rendering data output to a screen. They usually consist of some group of output-ready buffers, each of which can...
Best Practices for Securing LLM-Enabled Applications
Large language models (LLMs) provide a wide range of powerful enhancements to nearly any application that processes text. And yet they also introduce new risks,...
Accelerating Ptychography Workflows with NVIDIA Holoscan at Diamond Light Source
Diamond Light Source is a world-renowned synchrotron facility in the UK that provides scientists with access to intense beams of x-rays, infrared, and other...
