safety-benchmark

A comprehensive evaluation framework for Large Language Models (LLMs), providing extensive assessments across three key dimensions: general capabilities, safety, and robustness. The framework includes diverse benchmarks and supports both API-based and local models with distributed evaluation capabilities.

Multilingual LLM safety benchmark for Urdu, Pashto, and code-switching prompts across different prompting techniques

500+ labeled VLA safety scenarios across 7 risk levels — benchmark dataset for safety evaluation.