WorldFoundry
English中文

Video · video-generation · memory · stream · interactive-world-model

VMem

liguang0115

In-tree VMem runtime at worldfoundry/synthesis/visual_generation/vmem/vmem_runtime; no external checkout is required.

Runner verifiedUnified environmentvmem

Build your run

Choose a recorded variant, then copy the exact setup or inspection command.

worldfoundry.pipeline
Taskvideo-generation
Environmentworldfoundry-unified-cu128
DeviceCUDA 12.8
worldfoundry-eval evaluate \
  --mode model \
  --model-id vmem \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/vmem \
  --metric artifact_count \
  --json
01

Compatibility & versions

Manifest-backed recipe

Integration
verified
Runner evidence
verified
Environment
worldfoundry-unified-cu128
Python
3.11
CUDA
CUDA 12.8
PyTorch
torch
Source revision
—
Checkpoint revision
ac5921080a57f5a634f4b9acbbc8f3db67c9d113
Runtime profile
vmem
Pipeline binding
vmem
Runner
worldfoundry.pipeline
Pipeline target
worldfoundry.pipelines.vmem.pipeline_vmem:VMemPipeline
Backend stage
official_in_tree_runtime
Runtime status
verified
Driver status
compatible_unified_default
Environment kind
Unified environment
02

Install environment

The environment resolver reads the recorded profile and chooses the unified or dedicated environment shown here.

bash scripts/setup/model_env_install.sh --model vmem
Package constraints 4
  • torch
  • torchvision
  • torchaudio
  • xfuser
Conda packages 5
  • python=3.11
  • pip
  • ffmpeg
  • setuptools
  • wheel
03

Checkpoints & assets

Run the local check before allocating compute. Gated, private, and license fields below come directly from the checkpoint manifest.

worldfoundry-eval zoo model-download --model-id vmem --check-local --json
liguang0115/vmem
Revision
ac5921080a57f5a634f4b9acbbc8f3db67c9d113
License
—
Gated
—
Private
—
liguang0115/cut3r
Revision
b14faf986da0df405cff1b41e60e2975c4da2745
License
—
Gated
—
Private
—
SagiPolaczek/stable-diffusion-2-1-base
Revision
d1dc907291ce017defe5ec44dc1ec7ef55a1e26e
License
—
Gated
—
Private
—
laion/CLIP-ViT-H-14-laion2B-s32B-b79K
Revision
1c2b8495b28150b8a4922ee1c8edee224c284c0c
License
—
Gated
—
Private
—
naver/DUSt3R_ViTLarge_BaseDecoder_512_dpt
Revision
61c57447d7b0adc8a1a30b2b0adec7a8935aa2a3
License
—
Gated
—
Private
—
04

Launch & outputs

The generated command uses the shared evaluation boundary and writes durable result manifests and artifacts.

worldfoundry-eval evaluate \
  --mode model \
  --model-id vmem \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/vmem \
  --metric artifact_count \
  --json

Input contract

FieldRecorded contract
promptRequired
imageRequired
videoOptional
actionsinteraction, navigation

Artifact contract

Artifact kindFilename / path
generated_videovmem.mp4
05

Evidence & sources

Catalog integration, native-demo parity, and runner parity are independent records.

Integration
verified
Runner evidence
verified
Native demo evidence
Not recorded
Validation imports
torch, torchvision, numpy, transformers, diffusers, xfuser, worldfoundry
Recipe provenance
worldfoundry/data/models/catalog/video/vmem.yamlProjecthttps://v-mem.github.io/Paperhttps://arxiv.org/abs/2506.18903GitHubhttps://github.com/runjiali-rl/vmemHugging Facehttps://huggingface.co/liguang0115/vmemHugging Facehttps://huggingface.co/liguang0115/cut3r