OpenAI Evals
Build and run evaluations for language model systems
An open-source toolkit for running evaluations on language models and applications, with a collection of benchmark definitions.
Pricing label: see the product site.
Open OpenAI EvalsIs this your tool? Feature it
More in this area
AI Prompts & Eng
AceTagGen
Build and score structured prompts for Suno music generation.
See siteVisit
AI Prompts & Eng
Agent Ops Prompt Generator
Generates Korean prompts for coding agents doing operations work.
See siteVisit
AI Prompts & Eng
ai-evaluation
Evaluate AI workflows with metrics, judges, scanners, and CI pipelines.
See siteVisit