TypeScript MIT

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Stars
27,304
Forks
2,778
Open issues
965
Last commit

Share this project

Link

Share to

Star growth

We record this repository's stars once a day. The chart appears after a few days of data.

More in DevOps & Deployment

  1. Shannon is an AI pentester for web applications and APIs. It analyzes your source code, identifies attack vectors, and executes real exploits to prove vulnerabilities before they reach production.

    • TypeScript
    • AGPL-3.0
    • #ai-penetration-testing
    • #ai-security
    • #api-security

    52k stars

    Last commit

  2. Scalable PaaS (automated Docker+nginx) - aka Heroku on Steroids

    • TypeScript
    • #aws
    • #azure
    • #caprover

    15.2k stars

    Last commit

  3. Database governance built for humans and agents — controlling changes and access across every major database.

    • TypeScript
    • #cicd
    • #data-governance
    • #data-masking

    14.7k stars

    Last commit

  4. Open-source feature management platform

    • TypeScript
    • AGPL-3.0
    • #activation-strategies
    • #collaboration
    • #continuous-delivery

    14.3k stars

    Last commit

  5. PostgreSQL backup tool with Point-In-Time-Recovery and restore verification

    • TypeScript
    • Apache-2.0
    • #backup
    • #backups
    • #database

    9.3k stars

    Last commit

  6. Complete open-source monitoring and observability platform.

    • TypeScript
    • #devops
    • #incident-management
    • #incident-response

    7.8k stars

    Last commit