Joseph Lucas

Joe is a senior offensive security researcher focused on AI at NVIDIA. He is the founder and chair of the NumFOCUS Security Committee and is a member of the Jupyter Security Council. He was one of the architects and hosts of the DEF CON 30 AI Village Capture the Flag competition and is passionate about machine learning security education. He served in the US Army at US Cyber Command and the 101st Airborne Division. He holds a master's degree in Computer Science from Georgia Institute of Technology and a bachelor's degree in Mathematics from the United States Military Academy.
Joseph Lucas

Posts by Joseph Lucas

An illustration showing a securit alert.
Cybersecurity Jul 11, 2024

Defending AI Model Files from Unauthorized Access with Canaries

As AI models grow in capability and cost of creation, and hold more sensitive or proprietary data, securing them at rest is increasingly important.... 6 MIN READ
Data Science Jun 27, 2024

Secure LLM Tokenizers to Maintain Application Integrity

This post is part of the NVIDIA AI Red Team’s continuing vulnerability and technique research. Use the concepts presented to responsibly assess and increase... 6 MIN READ
Picture of the ML security training classroom at Black Hat USA
Cybersecurity Oct 19, 2023

NVIDIA AI Red Team: Machine Learning Security Training

At Black Hat USA 2023, NVIDIA hosted a two-day training session that provided security professionals with a realistic environment and methodology to explore the... 4 MIN READ
Data Science Oct 04, 2023

Analyzing the Security of Machine Learning Research Code

The NVIDIA AI Red Team is focused on scaling secure development practices across the data, science, and AI ecosystems. We participate in open-source security... 12 MIN READ
Conversational AI Aug 04, 2023

Mitigating Stored Prompt Injection Attacks Against LLM Applications

Prompt injection attacks are a hot topic in the new world of large language model (LLM) application security. These attacks are unique due to how ‌malicious... 10 MIN READ
Two men working at a desktop computer in an office.
Cybersecurity Jun 14, 2023

NVIDIA AI Red Team: An Introduction

Machine learning has the promise to improve our world, and in many ways it already has. However, research and lived experiences continue to show this technology... 12 MIN READ