$ the open-source LLM evaluation framework

Unit-Testing for LLMs

LLM evaluation metrics to regression test LLM outputs in Python

Prompt and Model Discovery

Gain insights to quickly iterate towards optimal prompts and model

LLM Red Teaming

Security and safety test LLM applications for vulnerabilities