$ the open-source LLM evaluation framework

Regression Testing for LLMs

LLM evaluation metrics to unit test LLM outputs in Python

Prompt and Model Discovery

Gain insights to quickly iterate towards optimal prompts and model

LLM Red Teaming

Security and safety test LLM applications for vulnerabilities