WorldFoundry
English中文

World models · Not recorded

MotionCtrl

Camera/Object Motion Control

Runtime code is vendored in-tree; checkpoints remain external assets under the normal hfd/ckpt cache.

Runner verifiedUnified environmentmotionctrl

Build your run

Choose a recorded variant, then copy the exact setup or inspection command.

worldfoundry.pipeline
TaskNot recorded
Environmentworldfoundry-unified-cu128
DeviceCUDA 12.8
worldfoundry-eval evaluate \
  --mode model \
  --model-id motionctrl \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/motionctrl \
  --metric artifact_count \
  --json
01

Compatibility & versions

Manifest-backed recipe

Integration
integrated
Runner evidence
verified
Environment
worldfoundry-unified-cu128
Python
3.11
CUDA
CUDA 12.8
PyTorch
torch
Source revision
—
Checkpoint revision
—
Runtime profile
motionctrl
Pipeline binding
motionctrl
Runner
worldfoundry.pipeline
Pipeline target
worldfoundry.pipelines.component_pipelines:MotionCtrlPipeline
Backend stage
in_tree_runtime
Runtime status
in_tree_motionctrl_runtime_ported
Driver status
compatible
Environment kind
Unified environment
02

Install environment

The environment resolver reads the recorded profile and chooses the unified or dedicated environment shown here.

bash scripts/setup/model_env_install.sh --model motionctrl
Package constraints 30
  • torch
  • torchvision
  • numpy
  • pytorch-lightning
  • decord
  • kornia
  • timm
  • open_clip_torch
  • av
  • omegaconf
  • transformers
  • einops
  • scikit-learn
  • taming-transformers-rom1504
  • pandas
  • fairscale
  • psutil
  • plotly
  • imageio
  • imageio-ffmpeg
  • opencv-python
  • moviepy
  • Pillow
  • tqdm
  • gradio
  • gradio_client
  • fastapi
  • pydantic
  • socksio
  • setuptools
Conda packages 3
  • python
  • pip
  • ffmpeg
03

Checkpoints & assets

Run the local check before allocating compute. Gated, private, and license fields below come directly from the checkpoint manifest.

worldfoundry-eval zoo model-download --model-id motionctrl --check-local --json

No checkpoint repository is recorded in the catalog manifest.

04

Launch & outputs

The generated command uses the shared evaluation boundary and writes durable result manifests and artifacts.

worldfoundry-eval evaluate \
  --mode model \
  --model-id motionctrl \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/motionctrl \
  --metric artifact_count \
  --json

Input contract

FieldRecorded contract
actionscamera_motion, object_motion
imageRequired
promptRequired

Artifact contract

Artifact kindFilename / path
generated_videomotionctrl.mp4
05

Evidence & sources

Catalog integration, native-demo parity, and runner parity are independent records.

Integration
integrated
Runner evidence
verified
Native demo evidence
Not recorded
Validation imports
torch, pytorch_lightning, decord, transformers
Recipe provenance
worldfoundry/data/models/catalog/world_models/motionctrl.yamlGitHubhttps://github.com/TencentARC/MotionCtrlHugging Facehttps://huggingface.co/TencentARC/MotionCtrlHugging Facehttps://huggingface.co/TencentARC/MotionCtrl_SVD