WorldFoundry
English中文

FantasyWorld

Method overview: Overview.

FantasyWorld from Alibaba (Amap, Fantasy-AMAP): geometry-consistent world modeling; Verified; 2 variants.

Edit this pageGitHubMarkdown

FantasyWorld does geometry-consistent world modeling by unifying video and 3D prediction: from an image it produces camera-controllable world video that stays geometrically coherent. Two variants are recorded — the verified Wan2.1 pipeline (the release-facing default) and a Wan2.2 pipeline that stays hidden from Studio until its official memory strategy is verified.

Official paper teaser: FantasyWorld overview. Given multimodal inputs (image, text, and camera trajectory), the model generates photorealistic videos along the specified views while constructing an implicit 3D representation for consistent.
Official paper teaser: FantasyWorld overview. Given multimodal inputs (image, text, and camera trajectory), the model generates photorealistic videos along the specified views while constructing an implicit 3D representation for consistent.
Method overview: Overview.
Method overview: Overview.

Project page: fantasy-amap.github.io/fantasy-world. Code: Fantasy-AMAP/fantasy-world.

Paper: FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Prediction (arXiv 2509.21657). Project: fantasy-amap.github.io/fantasy-world. Code: Fantasy-AMAP/fantasy-world. Publisher: Alibaba Amap (Fantasy-AMAP) with BUPT authors. Catalog marks the source source_available — no LICENSE file was found, so it is not recorded as open_source.

Runtime needs local FantasyWorld Wan2.1 (acvlab/FantasyWorld-Wan2.1-I2V-14B-480P), Wan2.1 I2V (Wan-AI/Wan2.1-I2V-14B-480P), MoGe (Ruicheng/moge-2-vitl-normal), and CUDA assets. Runner: verified on the official camera-world contract.

Build your run

Pipeline
FantasyWorldWan21Pipelineworldfoundry.pipelines.fantasy_world.pipeline_fantasy_world
TaskOfficial Camera World official-camera-world
Environmentworldfoundry-unified-cu128
DeviceCUDA 12.8
Runnerworldfoundry.pipeline
Loadingfrom_pretrained
Invocationnative_or_standard_invocation
worldfoundry-eval run \
  fantasyworld-wan21 \
  --pipeline.task-profile official-camera-world \
  --json

Variants

  • fantasyworld-wan21
    StatusVerified

    image-to-world-video

    Runtime profilefantasyworld-wan21

    Pipeline bindingfantasyworld-wan21

  • fantasyworld-wan22
    StatusRunner parity pending

    camera-controlled-world-video

    Runtime profilefantasyworld-wan22

    Pipeline bindingfantasyworld-wan22

What it is for

Use fantasyworld-wan21 for catalog world-model inference. Choose it when you need action-conditioned future frames rather than a standalone clip generator.

FantasyWorld augments a Wan video backbone with a unified 3D-prediction branch so that generated frames respect scene geometry (per arXiv 2509.21657). Runtime execution requires local FantasyWorld Wan2.1, Wan2.1 I2V, MoGe, and CUDA assets. It is published by Alibaba (Amap, Fantasy-AMAP).

Catalog tasks include geometry-consistent world modeling. Catalog aliases include Geometry-Consistent World Modeling via Unified Video and 3D Prediction. Also recorded: fantasyworld-wan22.

Recorded evaluation entry points include WorldScore (Scores geometry-consistent generated worlds), CameraBench (Camera-control quality evaluation).

Runtime contract

Optional input_path, prompt, camera_json_path, fps, and seed; artifacts generated_world and fantasyworld-wan21.mp4.

CLI task profiles: official-camera-world. WorldFoundry binds FantasyWorldPipeline.

Start on fantasyworld-wan21. The family registers 2 catalog variants (cards above): fantasyworld-wan21 (image-to-world-video) — Runner parity pending; fantasyworld-wan22 (camera-controlled-world-video) — Runner parity pending. Family status: Verified.

Recorded official-camera-world defaults: fps=16, seed=1024.

The default row resolves to the verified in-tree Wan2.1 runner — that is the route to use. The Wan2.2 variant remains pending because the official single-GPU run requires an accepted memory strategy.

Running in WorldFoundry

Launch worldfoundry-eval run fantasyworld-wan21 --pipeline.task-profile official-camera-world to step the world. The command builder above switches --pipeline.task-profile among recorded tasks and still emits worldfoundry-eval run.

It runs in the unified environment worldfoundry-unified-cu128 (Python 3.11, CUDA 12.8).

Recorded weight repositories include acvlab/FantasyWorld-Wan2.1-I2V-14B-480P, Wan-AI/Wan2.1-I2V-14B-480P, and Ruicheng/moge-2-vitl-normal. Prepare the environment and check local assets with bash scripts/inference/prepare_model_infer.sh fantasyworld-wan21. Add --download to fetch missing public checkpoints.

Status: Verified.