Stark's AI Security Vault
Prompt Injection attacks Prompt injection, one of the top vulnerabilities in the OWASP Top 10 for Large Language Model Applications, enables attackers to use carefully crafted inputs to manipulate LLMs into executing their instructions. This can lead to serious consequences such as data leakage, unauthorized access, and security breaches. There are two main types of […]
Intro to Stark Game
What’s Stark Game Stark Game was born out of an internal hackathon at TrustAI, where the Blue Team insists that the strongest defense can be achieved through the base model’s own safety training and prompt reinforcement. But the Red Team tried to build the strongest attacks for an LLM holding a secret flag. The flag […]