World models · camera-control-video · text-to-video · video-diffusion-plugin

AC3D

Camera-Control Video

WorldFoundry vendors the official AC3D inference runtime under worldfoundry/synthesis/visual_generation/ac3d/ac3d_runtime; WorldFoundry owns path resolution, command construction, output loading, and pipeline/catalog exposure.

Runner verified独立环境源码已固定ac3d

构建运行命令

选择仓库中已记录的 variant，然后复制对应的准备、检查或运行命令。

worldfoundry.pipeline

Variant

任务camera-control-video

环境ac3d

设备CUDA 12.4

worldfoundry-eval evaluate \
  --mode model \
  --model-id ac3d \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/ac3d \
  --metric artifact_count \
  --json

兼容性与版本

由 Manifest 生成

集成状态: integrated
Runner 证据: verified
环境: ac3d
Python: 3.10
CUDA: CUDA 12.4
PyTorch: torch==2.4.0+cu124
源码 revision: fe40a8d2dee163b951e6405d8cf1a2c14ecc68eb
Checkpoint revision: —

Runtime profile: ac3d
Pipeline binding: ac3d
Runner: worldfoundry.pipeline
Pipeline target: worldfoundry.pipelines.ac3d.pipeline_ac3d:AC3DPipeline
Backend stage: official_in_tree_runtime
Runtime 状态: official_in_tree_runtime_ready
Driver 状态: compatible
环境类型: 独立环境

安装环境

环境解析器会读取已记录 profile，并选择此处显示的统一或独立环境。

bash scripts/setup/model_env_install.sh --model ac3d

依赖版本约束 16

torch==2.4.0+cu124
torchvision==0.19.0+cu124
diffusers==0.32.2
transformers>=4.44.0,<5
accelerate>=0.34.2
safetensors>=0.4.5
sentencepiece>=0.2.0
numpy==1.26.0
opencv-python>=4.10.0.84
imageio==2.34.2
imageio-ffmpeg>=0.5.1
moviepy>=1.0.3
pillow==9.5.0
decord==0.6.0
einops
packaging

Conda 依赖 3

python
pip
ffmpeg

Checkpoint 与资产

分配算力前先做本地检查；gated、private 与 license 字段直接来自 checkpoint manifest。

worldfoundry-eval zoo model-download --model-id ac3d --check-local --json

Catalog manifest 没有记录 checkpoint 仓库。

运行与输出

生成的命令通过共享 evaluation 边界运行，并持久保存结果 manifest 与 artifact。

worldfoundry-eval evaluate \
  --mode model \
  --model-id ac3d \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/ac3d \
  --metric artifact_count \
  --json

输入契约

字段	已记录契约
`prompt`	Required
`image`	Optional
`video`	Required
`actions`	camera_index, camera_index_range, camera_pose_rows

Artifact 契约

Artifact 类型	文件名 / 路径
`generated_video`	`ac3d.mp4`

证据与来源

Catalog 集成、原生 demo parity 与 runner parity 是三条独立记录。

集成状态: integrated
Runner 证据: verified
原生 Demo 证据: 未记录
验证 Imports: torch, torchvision, diffusers, transformers, decord, einops

配方溯源

worldfoundry/data/models/catalog/world_models/ac3d.yamlProjecthttps://snap-research.github.io/ac3d/Paperhttps://arxiv.org/abs/2411.18673GitHubfe40a8d2dee163b951e6405d8cf1a2c14ecc68eb

构建运行命令

输入契约

Artifact 契约

相关配方