---
title: Metrics
description: In-tree metric registry and distribution/perceptual compute APIs.
---

import MetricsSetup from '../../../../mdx/partials/metrics-usage-setup.mdx';

WorldFoundry ships an in-tree metric layer — a registry of scorers and distribution/perceptual compute routines that runners invoke through a stable contract. Benchmarks decide *what* to measure on *which* data; metrics decide *how* to turn predictions into numbers. Each entry declares inputs, optional checkpoint dependencies, and output shape; runners reference metric IDs and the registry resolves aliases, validates availability, and routes to the right `compute_*`. This keeps model code out of scoring while making scoring reproducible across machines. This hub documents what the repository actually implements — it is not a survey of every published score.

The in-tree catalog spans four families: **scorers & quality** (CLIP, VQA, ITM, face, art, S2V judges), **distribution** (FID, IS, KID, FVD, JEDi, CMMD, Clean-FID), **perceptual pairwise** (LPIPS, SSIM, DINO, mask, layout), and **editing & layout** (SemSR, IRS, CAS, manipulation). Metrics that need pretrained backbones declare those dependencies explicitly — missing checkpoints fail loudly, never silently substitute a proxy. A fifth page, [Registry & reference](/docs/evaluation/metrics/reference), covers discovery (`worldfoundry-eval metric list`), parameterized ids, checkpoint staging, and package layout. For benchmark-specific evaluator assets and commands, see [Benchmark Hub](/docs/evaluation/benchmark-hub); individual pages call out approximations and cases where official scripts must be used instead of the generic compute API.

## Getting started

<MetricsSetup />

## Pages

- [Scorers & quality](/docs/evaluation/metrics/scorers) — CLIPScore, VQAScore, ITMScore, FaceScore, ArtScore, OpenS2V reward metrics.
- [Distribution](/docs/evaluation/metrics/distribution) — FID, IS, KID, FVD, JEDi, CMMD, Clean-FID, and feature-array metrics.
- [Perceptual pairwise](/docs/evaluation/metrics/perceptual) — LPIPS, SSIM, DINO similarity, mask accuracy, layout quality.
- [Editing & layout](/docs/evaluation/metrics/editing) — SemSR, IRS, CAS, manipulation direction, object-wise consistency.
- [Registry & reference](/docs/evaluation/metrics/reference) — `MetricRegistry`, registered-metric tables, CLI surface, checkpoints, architecture.

## Related pages

- [Evaluation](/docs/evaluation) — run contract, `evaluate`, and scorecard outputs.
- [Benchmark Hub](/docs/evaluation/benchmark-hub) — benchmark-specific metric assets and evaluator requirements.
- [Local asset preparation](/docs/guides/local-assets) — checkpoint staging including FVD I3D weights.