AI Security

AI and LLM Security

Test and defend models, prompts, agents and the infrastructure around them.

45 tools profiled

How it differs Tests and guards models, LLM applications and agents against prompt injection, jailbreaks and data leakage. Scanning an AI app's own code is still SAST or SCA.

License
Subcategory
Deployment
Languages
Integrations
Maturity
Signals

45 tools

  • Vectara

    Vectara

    AI Security

    Managed retrieval augmented generation platform whose security relevance is grounding, citation and a hallucination evaluation model applied to responses.

    Commercial
    Established
  • CalypsoAI

    CalypsoAI

    AI Security

    Commercial platform that proxies enterprise LLM traffic through policy scanners and runs automated red teaming against models and applications.

    Commercial
    Growing
  • Augustus

    Praetorian

    AI Security

    Open source prompt injection testing tool released by Praetorian for probing LLM applications with adversarial inputs.

    Open source
    Emerging
  • Prophet AI

    Prophet Security

    AI Security

    AI agent that ingests security alerts, gathers supporting evidence across connected tools, and returns a reasoned verdict for analyst review.

    Commercial
    Emerging
  • LLM Guard

    Protect AI

    AI Security

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source
    Growing
  • HiddenLayer AISec

    HiddenLayer

    AI Security

    Commercial platform that scans serialized model files for embedded code and watches inference traffic for extraction and evasion behavior.

    Commercial
    Growing
  • FuzzyAI

    CyberArk

    AI Security

    Open source fuzzer that applies a catalog of published jailbreak and prompt injection techniques against local or hosted language model endpoints.

    Open source
    Growing
  • AI Security

    AI detection and response module on the Falcon platform that discovers AI tools, models and libraries in use and detects threats against them.

    Commercial
    Emerging
  • Arthur AI

    Arthur

    AI Security

    Model monitoring and guardrail platform that evaluates LLM inputs and outputs inline for injection, sensitive data and unsupported claims.

    Open source and commercial
    Growing
  • PyRIT

    Microsoft

    AI Security

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source
    Growing
  • Agentic Radar

    SplxAI

    AI Security

    Open source CLI that statically analyzes agentic AI codebases and produces a visual map of agents, their tools and the risks in that wiring.

    Open source
    Emerging
  • Vectara

    Vectara

    Managed retrieval augmented generation platform whose security relevance is grounding, citation and a hallucination evaluation model applied to responses.

    Commercial Established
    AI Security
  • CalypsoAI

    CalypsoAI

    Commercial platform that proxies enterprise LLM traffic through policy scanners and runs automated red teaming against models and applications.

    Commercial Growing
    AI Security
  • Augustus

    Praetorian

    Open source prompt injection testing tool released by Praetorian for probing LLM applications with adversarial inputs.

    Open source Emerging
    AI Security
  • Prophet AI

    Prophet Security

    AI agent that ingests security alerts, gathers supporting evidence across connected tools, and returns a reasoned verdict for analyst review.

    Commercial Emerging
    AI Security
  • LLM Guard

    Protect AI

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source Growing
    AI Security
  • HiddenLayer AISec

    HiddenLayer

    Commercial platform that scans serialized model files for embedded code and watches inference traffic for extraction and evasion behavior.

    Commercial Growing
    AI Security
  • FuzzyAI

    CyberArk

    Open source fuzzer that applies a catalog of published jailbreak and prompt injection techniques against local or hosted language model endpoints.

    Open source Growing
    AI Security
  • AI detection and response module on the Falcon platform that discovers AI tools, models and libraries in use and detects threats against them.

    Commercial Emerging
    AI Security
  • Arthur AI

    Arthur

    Model monitoring and guardrail platform that evaluates LLM inputs and outputs inline for injection, sensitive data and unsupported claims.

    Open source and commercial Growing
    AI Security
  • PyRIT

    Microsoft

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source Growing
    AI Security
  • Agentic Radar

    SplxAI

    Open source CLI that statically analyzes agentic AI codebases and produces a visual map of agents, their tools and the risks in that wiring.

    Open source Emerging
    AI Security
  • Prompt Security

    Prompt Security

    AI Security

    Inspects GenAI traffic across employee tools, homegrown applications and AI coding assistants, applying redaction and blocking policy inline.

    Commercial
    Growing
  • Rebuff

    Protect AI

    AI Security

    Open source prompt injection detector that layers heuristics, a classifier prompt, a vector store of known attacks and canary tokens.

    Open source
    Emerging
  • Alter

    Alter

    AI Security

    Commercial product in the AI security category addressing identity and access control for AI agents.

    Commercial
    Emerging
  • AI Security

    Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source
    Growing
  • Lakera Guard

    Lakera

    AI Security

    Detection API that classifies prompts and model outputs for injection, jailbreak attempts, sensitive data and policy violations before they land.

    Commercial, free tier
    Growing
  • AI Security

    Open source project from Cisco's AI Defense group addressing security controls for AI agent and LLM application activity.

    Open source
    Emerging
  • Arize AI

    Arize AI

    AI Security

    LLM and ML observability platform that captures application traces and runs evaluations over them, with an open source tracing and evaluation component.

    Open source and commercial
    Established
  • Runlayer

    Runlayer

    AI Security

    Commercial control layer for AI agent tool access, mediating connections between agents and the systems they act on.

    Commercial
    Emerging
  • Protect AI Guardian

    Protect AI

    AI Security

    Scanning gateway for machine learning model files that inspects serialized artifacts for executable payloads and enforces policy on what may be pulled.

    Commercial
    Growing
  • 7AI

    7AI

    AI Security

    Platform that applies AI agents to security operations work such as alert triage, phishing analysis and exposure investigation.

    Commercial
    Emerging
  • Prompt Security

    Prompt Security

    Inspects GenAI traffic across employee tools, homegrown applications and AI coding assistants, applying redaction and blocking policy inline.

    Commercial Growing
    AI Security
  • Rebuff

    Protect AI

    Open source prompt injection detector that layers heuristics, a classifier prompt, a vector store of known attacks and canary tokens.

    Open source Emerging
    AI Security
  • Alter

    Alter

    Commercial product in the AI security category addressing identity and access control for AI agents.

    Commercial Emerging
    AI Security
  • Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source Growing
    AI Security
  • Lakera Guard

    Lakera

    Detection API that classifies prompts and model outputs for injection, jailbreak attempts, sensitive data and policy violations before they land.

    Commercial, free tier Growing
    AI Security
  • Open source project from Cisco's AI Defense group addressing security controls for AI agent and LLM application activity.

    Open source Emerging
    AI Security
  • Arize AI

    Arize AI

    LLM and ML observability platform that captures application traces and runs evaluations over them, with an open source tracing and evaluation component.

    Open source and commercial Established
    AI Security
  • Runlayer

    Runlayer

    Commercial control layer for AI agent tool access, mediating connections between agents and the systems they act on.

    Commercial Emerging
    AI Security
  • Protect AI Guardian

    Protect AI

    Scanning gateway for machine learning model files that inspects serialized artifacts for executable payloads and enforces policy on what may be pulled.

    Commercial Growing
    AI Security
  • 7AI

    7AI

    Platform that applies AI agents to security operations work such as alert triage, phishing analysis and exposure investigation.

    Commercial Emerging
    AI Security
Tick up to 4 tools above.