World models · world · video · camera_control · world_model

CameraCtrl

Camera-Control Video

Runtime code is vendored in-tree; checkpoints remain external assets under the normal hfd/ckpt cache.

Runner verified统一环境cameractrl

构建运行命令

选择仓库中已记录的 variant,然后复制对应的准备、检查或运行命令。

worldfoundry.pipeline
任务world
环境worldfoundry-unified-cu128
设备CUDA 11.3
worldfoundry-eval evaluate \
  --mode model \
  --model-id cameractrl \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/cameractrl \
  --metric artifact_count \
  --json
01

兼容性与版本

由 Manifest 生成

集成状态
verified
Runner 证据
verified
环境
worldfoundry-unified-cu128
Python
3.10
CUDA
CUDA 11.3
PyTorch
torch
源码 revision
Checkpoint revision
Runtime profile
cameractrl
Pipeline binding
cameractrl
Runner
worldfoundry.pipeline
Pipeline target
worldfoundry.pipelines.component_pipelines:CameraCtrlPipeline
Backend stage
in_tree_runtime
Runtime 状态
official_trajectory_contract
Driver 状态
compatible_with_downgraded_torch
环境类型
统一环境
02

安装环境

环境解析器会读取已记录 profile,并选择此处显示的统一或独立环境。

bash scripts/setup/model_env_install.sh --model cameractrl
依赖版本约束 23
  • torch
  • torchvision
  • torchaudio
  • diffusers
  • huggingface_hub
  • imageio
  • imageio-ffmpeg
  • numpy
  • opencv-python
  • transformers
  • gdown
  • einops
  • decord
  • omegaconf
  • safetensors
  • gradio
  • gradio_client
  • fastapi
  • pydantic
  • socksio
  • setuptools
  • wandb
  • termcolor
Conda 依赖 3
  • python
  • pip
  • ffmpeg
03

Checkpoint 与资产

分配算力前先做本地检查;gated、private 与 license 字段直接来自 checkpoint manifest。

worldfoundry-eval zoo model-download --model-id cameractrl --check-local --json
hehao13/CameraCtrl
Revision
License
Gated
Private
04

运行与输出

生成的命令通过共享 evaluation 边界运行,并持久保存结果 manifest 与 artifact。

worldfoundry-eval evaluate \
  --mode model \
  --model-id cameractrl \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/cameractrl \
  --metric artifact_count \
  --json

输入契约

字段已记录契约
promptRequired
imageOptional
videoOptional
actionscamera_trajectory, pose_file

Artifact 契约

Artifact 类型文件名 / 路径
generated_videocameractrl.mp4
05

证据与来源

Catalog 集成、原生 demo parity 与 runner parity 是三条独立记录。

集成状态
verified
Runner 证据
verified
原生 Demo 证据
未记录
验证 Imports
torch, diffusers, transformers, decord
配方溯源
worldfoundry/data/models/catalog/world_models/cameractrl.yamlGitHubhttps://github.com/hehao13/CameraCtrlHugging Facehttps://huggingface.co/hehao13/CameraCtrl