---
title: AIGCBench
description: "BenchCouncil I2V quality bench: first-frame fidelity, alignment, motion, temporality, DOVER. WorldFoundry imports official metrics; it does not invent a board."
---

AIGCBench (BenchCouncil, ICT / CAS) evaluates **image-to-video** generation: given a condition image and a prompt, does the clip stay faithful, move, and stay temporally coherent? Metric families:

- **First-frame fidelity** — `mse_first` / `ssim_first` vs the condition image.
- **Alignment** — image–video and text–video CLIP.
- **Reference-video match** — keyframe / corresponding-frame CLIP and SSIM (needs official references).
- **Motion** — optical-flow square mean.
- **Temporality** — adjacent-frame CLIP.
- **Perceptual quality** — DOVER. `frame_count` is also recorded.

Paper: [AIGCBench](https://arxiv.org/abs/2401.01651). Project: [benchcouncil.org/AIGCBench](https://www.benchcouncil.org/AIGCBench). Code: [BenchCouncil/AIGCBench](https://github.com/BenchCouncil/AIGCBench) (Apache-2.0). Dataset: [`stevenfan/AIGCBench_v1.0`](https://huggingface.co/datasets/stevenfan/AIGCBench_v1.0).

WorldFoundry **imports official metric CSV / TSV** (or pipeline score dumps) through the in-tree runner. Bundled `prompt_suite.json` under `worldfoundry/data/benchmarks/assets/aigcbench` can materialize requests without the full Hugging Face download. CLIP, DOVER, and flow scorers stay caller-supplied. Primary key: `aigcbench_average` when the official dump provides it.

<BenchmarkPageSections id="aigcbench" locale="en" />

## How to run

```bash
worldfoundry-eval zoo benchmark-run \
  --benchmark-id aigcbench \
  --mode official-validation \
  --official-results-path <official_results.csv> \
  --generated-artifact-dir <generated_videos> \
  --output-dir tmp/aigcbench/official-validation \
  --json
```

`--strict` fails on coverage gaps; `--prompt-manifest` restricts to a prompt subset. Reference-image / reference-video families need those official assets staged. Default import path: `WORLDFOUNDRY_AIGCBENCH_RESULTS_PATH`. Shared stack: `video_quality_motion_stack`.

In-tree pointers:

```text
worldfoundry/data/benchmarks/tasks/external/aigcbench.yaml
worldfoundry/data/benchmarks/assets/aigcbench
```

Outputs include `scorecard.json` (primary `aigcbench_average`), `benchmark_contract.json`, and `raw_metric_table.jsonl`.

[← Benchmark Hub](/docs/evaluation/benchmark-hub)