Skip to content
Vieval

Vieval Guide ​

Vieval helps you define repeatable evaluations next to product code, expand them across models and scenarios, and retain both human-readable output and machine-readable evidence.

Start here ​

  • Why Vieval explains the problems Vieval handles and where its boundaries are.
  • Getting Started runs a deterministic evaluation with no provider call, credentials, or model cost.
  • Core Concepts introduces the objects and lifecycle used throughout the guide.

Learn by following an evaluation ​

  1. Tasks, Cases, and Inputs
  2. Assertions, Scores, and Metrics
  3. Models and Inference Executors
  4. Matrices and Datasets
  5. Reliable Execution
  6. Reports and Comparisons

For option details and exported interfaces, continue to the Config reference and API reference.