---
title: FETV
description: "NeurIPS 2023 fine-grained T2V bench: 619 prompts on content, attributes, and complexity. WorldFoundry ships CLIPScore plus an importer; no invented board."
---

FETV (Peking University and Huawei Noah's Ark Lab) is a **fine-grained** open-domain text-to-video bench. **619 prompts** sit on three orthogonal axes: **major content**, **attribute control** (color, count, style), and **prompt complexity** (simple vs compositional). Scoring mixes human ratings (static quality, temporal quality, overall / fine-grained alignment) with automatic metrics (CLIPScore, BLIPScore, FID, FVD). `fetv_average` is emitted only when every declared component is present.

Paper: [FETV (NeurIPS 2023 D&B)](https://proceedings.neurips.cc/paper_files/paper/2023/hash/c481049f7410f38e788f67c171c64ad5-Abstract-Datasets_and_Benchmarks.html). Prompts: [llyx97/FETV](https://github.com/llyx97/FETV). Scorer: [llyx97/FETV-EVAL](https://github.com/llyx97/FETV-EVAL). Dataset: [`lyx97/FETV`](https://huggingface.co/datasets/lyx97/FETV) (CC-BY-4.0).

WorldFoundry **vendors FETV-EVAL**, joins generated videos to the official prompt index (official 16-frame layout), runs the **CLIPScore** component through shared base-model assets, and normalizes FETV-EVAL result directories or CSV dumps. Human ratings cannot be recomputed. BLIP / FID / FVD need their packages and reference frames.

<BenchmarkPageSections id="fetv" locale="en" />

## How to run

Import a FETV-EVAL directory or official CSV:

```bash
worldfoundry-eval zoo benchmark-run \
  --benchmark-id fetv \
  --mode official-validation \
  --official-results-path <official_results.csv-or-FETV-EVAL-dir> \
  --generated-artifact-dir <generated_videos> \
  --output-dir tmp/fetv/official-validation \
  --json
```

Select automatic families with `--fetv-metrics` (`clip_score`, `blip_score`, `fid`, `fvd`). FID / FVD need `--fetv-fid-real-video-dir` / `--fetv-fvd-real-video-dir`. Default import path: `WORLDFOUNDRY_FETV_RESULTS_PATH`. Optional: `WORLDFOUNDRY_FETV_RUNTIME_ROOT`, `WORLDFOUNDRY_FETV_ARTIFACT_SCORE_DIR`. Shared stacks: `video_quality_motion_stack`, `fetv_blip_retrieval_source`, `fetv_stylegan_v_fvd_source`.

In-tree pointers:

```text
worldfoundry/data/benchmarks/tasks/external/fetv.yaml
worldfoundry/evaluation/tasks/execution/runners/fetv/runtime/fetv_eval
worldfoundry/data/benchmarks/assets/fetv/fetv_data.json
```

Outputs include `scorecard.json` (primary `fetv_average` when complete), `benchmark_contract.json`, and `raw_metric_table.jsonl`.

[← Benchmark Hub](/docs/evaluation/benchmark-hub)