3D & 4D · 4D world modeling from in-the-wild monocular videos

NeoVerse

CASIA and CreateAI authors

WorldFoundry exposes the in-tree NeoVerse pipeline and vendored DiffSynth runtime adapter.

Runner verifiedUnified environmentneoverse

Build your run

Choose a recorded variant, then copy the exact setup or inspection command.

worldfoundry.pipeline
Task4D world modeling from in-the-wild monocular videos
Environmentworldfoundry-unified-cu128
DeviceCUDA 12.8
worldfoundry-eval evaluate \
  --mode model \
  --model-id neoverse \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/neoverse \
  --metric artifact_count \
  --json
01

Compatibility & versions

Manifest-backed recipe

Integration
integrated
Runner evidence
verified
Environment
worldfoundry-unified-cu128
Python
3.11
CUDA
CUDA 12.8
PyTorch
torch
Source revision
Checkpoint revision
Runtime profile
neoverse
Pipeline binding
neoverse
Runner
worldfoundry.pipeline
Pipeline target
worldfoundry.pipelines.neoverse.pipeline_neoverse:NeoVersePipeline
Backend stage
in_tree_runtime
Runtime status
official_tilt_up_video_contract
Driver status
compatible_unified_default
Environment kind
Unified environment
02

Install environment

The environment resolver reads the recorded profile and chooses the unified or dedicated environment shown here.

bash scripts/setup/model_env_install.sh --model neoverse
Package constraints 4
  • torch
  • torchvision
  • torchaudio
  • xfuser
Conda packages 5
  • python=3.11
  • pip
  • ffmpeg
  • setuptools
  • wheel
03

Checkpoints & assets

Run the local check before allocating compute. Gated, private, and license fields below come directly from the checkpoint manifest.

worldfoundry-eval zoo model-download --model-id neoverse --check-local --json
Yuppie1204/NeoVerse
Revision
License
Gated
Private
04

Launch & outputs

The generated command uses the shared evaluation boundary and writes durable result manifests and artifacts.

worldfoundry-eval evaluate \
  --mode model \
  --model-id neoverse \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/neoverse \
  --metric artifact_count \
  --json

Input contract

FieldRecorded contract
promptRequired
imageRequired
videoRequired
actionscamera_actions, predefined_trajectory, trajectory_file

Artifact contract

Artifact kindFilename / path
generated_world
generated_4d_scene
generated_worldneoverse.mp4
05

Evidence & sources

Catalog integration, native-demo parity, and runner parity are independent records.

Integration
integrated
Runner evidence
verified
Native demo evidence
Not recorded
Validation imports
torch, torchvision, numpy, transformers, diffusers, xfuser, worldfoundry