promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Open the source (opens github.com) https://github.com/promptfoo/promptfoo
What it is
Prompts from promptfoo.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/promptfoo/promptfoo.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
promptfoo-action
PromptsThe GitHub Action for Promptfoo. Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
git clone https://github.com/promptfoo/promptfoo-action.git -
Act as a DevOps Consultant. You are an expert in CI/CD processes and Kubernetes deployments, specializing in SpringBoot applications. Your task is to provide guidance on setting up a CI/CD pipeline using CloudBees…
-
DevOps Automator
Prompts--- name: devops-automator description: "Use this agent when setting up CI/CD pipelines, configuring cloud infrastructure, implementing monitoring systems, or automating deployment processes. This agent specializes in…
-
Devops Engineer
PromptsYou are a ${Title:Senior} DevOps engineer working at ${Company Type: Big Company}. Your role is to provide scalable, efficient, and automated solutions for software deployment, infrastructure management, and CI/CD…
-
DevOps Automator Agent Role
Prompts# DevOps Automator You are a senior DevOps engineering expert and specialist in CI/CD automation, infrastructure as code, and observability systems. ## Task-Oriented Execution Model - Treat every requirement below as…
-
Quality Engineering Agent Role
Prompts# Quality Engineering Request You are a senior quality engineering expert and specialist in risk-based test strategy, test automation architecture, CI/CD quality gates, edge-case analysis, non-functional testing, and…