WorldFoundry
English中文

Matrix-Game 3.0

Method overview: Overview of Matrix-Game 3.0 . Our framework unifies Unreal Engine–based data generation, memory-augmented DiT training with an error buffer, and accelerated real-time deployment. It generates long-horizon training.

Matrix-Game 3.0 from Skywork AI (Kunlun Tech): `prompt` and `image` in; `matrix-game-3.mp4` out; runner verified; start on `matrix-game-3`.

Edit this pageGitHubMarkdown

Matrix-Game 3.0 is the third Skywork generation, pushing interactive world video to higher resolution with few-step inference. In this catalog the runner is verified — the official cityscape image-conditioned demo runs with actions forward + camera_r, 12 iterations, 3 inference steps, 704x1280, int8 quantization, compiled VAE, and the mg_lightvae decoder.

Official paper teaser: Matrix-Game 3.0 introduces precise action control and long-horizon memory retrieval, enabling an interactive world model with long-term memory and real-time performance of up to 40 FPS.
Official paper teaser: Matrix-Game 3.0 introduces precise action control and long-horizon memory retrieval, enabling an interactive world model with long-term memory and real-time performance of up to 40 FPS.
Method overview: Overview of Matrix-Game 3.0 . Our framework unifies Unreal Engine–based data generation, memory-augmented DiT training with an error buffer, and accelerated real-time deployment. It generates long-horizon training.
Method overview: Overview of Matrix-Game 3.0 . Our framework unifies Unreal Engine–based data generation, memory-augmented DiT training with an error buffer, and accelerated real-time deployment. It generates long-horizon training.

The paper is arXiv 2604.08995. Project page: matrix-game-v3.github.io. Code: SkyworkAI/Matrix-Game.

Build your run

Pipeline
MatrixGame3Pipelineworldfoundry.pipelines.matrix_game.pipeline_matrix_game_3
TaskOfficial Cityscape Image official-cityscape-image
Environmentworldfoundry-unified-cu128
DeviceCUDA 12.8
Runnerworldfoundry.pipeline
Loadingfrom_pretrained
Invocationnative_or_standard_invocation
worldfoundry-eval run \
  matrix-game-3 \
  --pipeline.task-profile official-cityscape-image \
  --json

What it is for

Interactive world on Matrix-Game 3. Sibling cards cover 1, 2.0, and 3.5 first-person.

Launch worldfoundry-eval run matrix-game-3 with --pipeline.task-profile official-cityscape-image.

Score on WorldModelBench — action-conditioned game-world rollout quality.

Runtime contract

Required: prompt and image; optional: video; actions: keyboard, mouse; artifacts: matrix-game-3.mp4.

Defaults: num_inference_steps=3, fps=17.

Recorded official-cityscape-image defaults: num_inference_steps=3, fps=17.

Run in WorldFoundry

Status: Runner parity pending. Unified environment worldfoundry-unified-cu128 (Python 3.11, CUDA 12.8). Stage Skywork/Matrix-Game-3.0 locally — missing files fail at load, nothing is downloaded. Run worldfoundry-eval run matrix-game-3 with --pipeline.task-profile official-cityscape-image. Catalog VRAM is unset.