---
title: Physics-IQ Verified
description: "Anates Labs revision of Physics-IQ: same 5-second continuation task, different Hugging Face media and per-view scoring. Not interchangeable with Original."
---

Physics-IQ Verified is the **recommended revision** of DeepMind's continuation protocol, packaged by Anates Labs. The *task* is the same as [Physics-IQ Original](/docs/evaluation/benchmark-hub/physics-iq): continue a filmed scene for **5 seconds**. The *dataset and score adapter are not*. Verified ships repaired prompts/masks and Hugging Face media (`Anates-Labs-Research/Physics-IQ-Verified`), then scores **per view** before aggregation (`physics_iq_verified_score` = official `final_score_view`). Original uses GCS media and global `final_score_orig`. Do not mix the two.

Paper: [Physics-IQ Verified](https://arxiv.org/abs/2606.18943). Project: [physics-iq-verified.anates.ai](https://physics-iq-verified.anates.ai/). Shared engine provenance: [google-deepmind/physics-IQ-benchmark](https://github.com/google-deepmind/physics-IQ-benchmark).

WorldFoundry **ships the scoring runtime** in tree (`run_physics_iq_official_runner.py --protocol verified`) plus prompt metadata under `worldfoundry/data/benchmarks/assets/physics-iq-verified`. Official **media** (396 reference videos + 396 masks) still download from Hugging Face — they are not in the repo. One run covers **198** generated continuations; maintainers recommend averaging **four** runs for leaderboard claims.

<BenchmarkPageSections id="physics-iq-verified" locale="en" />

## How to run

Import an existing `raw_metrics.csv`:

```bash
worldfoundry-eval zoo benchmark-run \
  --benchmark-id physics-iq-verified \
  --mode official-validation \
  --official-results-path <raw_metrics.csv> \
  --output-dir tmp/physics-iq-verified/official-validation \
  --json
```

Recompute from 198 generated continuations named by official scenario ids (`--protocol` is `verified`, not `physics-iq-verified`):

```bash
hf download Anates-Labs-Research/Physics-IQ-Verified \
  --repo-type dataset \
  --local-dir /path/to/physics-iq-verified

export WORLDFOUNDRY_PHYSICS_IQ_VERIFIED_ROOT=/path/to/physics-iq-verified
export WORLDFOUNDRY_GENERATED_ARTIFACT_DIR=/path/to/physics-iq-verified/generated_videos
${WORLDFOUNDRY_UNIFIED_PYTHON} \
  worldfoundry/evaluation/tasks/execution/runners/physics_iq/run_physics_iq_official_runner.py \
  --benchmark-id physics-iq-verified \
  --protocol verified \
  --run-official \
  --dataset-root "${WORLDFOUNDRY_PHYSICS_IQ_VERIFIED_ROOT}" \
  --generated-artifact-dir "${WORLDFOUNDRY_GENERATED_ARTIFACT_DIR}" \
  --output-dir tmp/physics-iq-verified/official-run \
  --strict \
  --json
```

`--strict` fails on missing scenario videos. Outputs include `scorecard.json` (primary `physics_iq_verified_score`), `raw_metrics.csv`, and `official_metrics.json`. `physics_iq_verified_mse` is official `score_mse_view` (higher is better after variance normalization), not Original's `physics_iq_mse_penalty`.

[← Benchmark Hub](/docs/evaluation/benchmark-hub)