Model recipes

Pick a model, inspect its runtime, and copy a command that matches your machine.

On this page
267 modelsruntime data from repository manifests

267 recipes

ModelTasksRuntimePythonCUDACheckpoint
AC3DCamera-Control VideoWorldFoundry vendors the official AC3D inference runtime under worldfoundry/synthesis/visual_generation/ac3d/ac3d_runtime; WorldFoundry owns path resolution, command construction, output loading, and pipeline/catalog exposure.camera-control-videotext-to-video+1Runner verifiedDedicated environment3.1012.4AnimateDiffguoywwVerified against the official repo default RealisticVision scripts.animate demo; file SHA256, decoded pixel SHA256, and artifact size match exactly.text-to-videolegacy-unet-diffusionRunner verifiedUnified environment3.1112.8guoyww/animatediffAstraEvanEternalIn-tree Astra inference route is registered under worldfoundry/synthesis/visual_generation/kling/astra_runtime.image-to-videocamera-control+1Runner verifiedUnified environment3.1112.8EvanEternal/AstraBeing-H0.5BeingBeyondWorldFoundry keeps the inference-only Being-H0.5 architecture and policy runtime directly under worldfoundry/synthesis/action_generation/being_h05.vlavla.policy_rollout+2Runner verifiedDedicated environment3.10Cu118 Or NewerBeingBeyond/Being-H05-2BCameraCtrlCamera-Control VideoRuntime code is vendored in-tree; checkpoints remain external assets under the normal hfd/ckpt cache.worldvideo+2Runner verifiedUnified environment3.1011.3hehao13/CameraCtrlCogVideoXTHUDMHF cardData reports Apache-2.0 for 2B and 'other' for several larger variants.text-to-videoimage-to-videoRunner verifiedUnified environment3.1112.81137dacfcDepth Any PanoramasInsta360-ResearchIntegrated as an independent geometric prior at worldfoundry/base_models/three_dimensions/depth/depth_anything/depth_anything_v1.panoramic-depth-estimationmetric-depth-estimation+1Runner verifiedUnified environment3.1112.8Insta360-Research/DAP-weightsDepth Anything 3 Priordepth-anythingIntegrated as an independent depth prior at worldfoundry/base_models/three_dimensions/depth/depth_anything/depth_anything_v3.monocular-depth-estimationmetric-depth-estimation+1Runner verifiedUnified environment3.1112.8depth-anything/DA3METRIC-LARGEDepth Anything V1LiheYoungIn-tree Depth Anything V1 pipeline is registered for relative depth and geometry artifact export.depthgeometry+1Runner verifiedUnified environment3.1112.8LiheYoung/depth-anything-large-hfDepth Anything V2 Priordepth-anythingIntegrated as an independent depth prior at worldfoundry/base_models/three_dimensions/depth/depth_anything/depth_anything_v2.monocular-depth-estimationmetric-depth-estimation+1Runner verifiedUnified environment3.1112.8depth-anything/Depth-Anything-V2-LargeDualCamCtrlCamera-Control VideoRuntime code is integrated in-tree; checkpoints use the default Hugging Face/local cache loading path.worldvideo+4Runner verifiedUnified environment3.1112.8FayeHongfeiZhang/DualCamCtrlDUSt3RNAVER LABS EuropeWorldFoundry vendors DUSt3R under worldfoundry.base_models.three_dimensions.general_3d.dust3r.feed-forward multi-view 3D reconstruction and geometry estimationRunner verifiedUnified environment3.1112.8DUSt3R Base ModelnaverBase-model profile for the DUSt3R catalog entry; exposed through the shared geometry-prior pipeline/operator contract.geometry3d-reconstruction+1Runner verifiedUnified environment3.1112.8FantasyWorldAMAP and Beijing University of Posts and Telecommunications authorsWorldFoundry exposes the in-tree FantasyWorld Wan2.1 and Wan2.2 camera-control pipelines.geometry-consistent world modelingRunner verifiedUnified environment3.1112.8acvlab/FantasyWorld-Wan2.1-I2V-14B-480PFlashWorldFlashWorld authorsWorldFoundry exposes the in-tree FlashWorld pipeline, operator, and representation runtime.fast 3D scene generation from image or textRunner verifiedUnified environment3.1112.8imlixinyang/FlashWorldGeoCalib PriorcvgIntegrated as an independent camera-calibration prior at worldfoundry/base_models/three_dimensions/general_3d/geocalib.camera-calibrationgravity-estimation+1Runner verifiedUnified environment3.1112.8GigaBrain-0open-gigaaiWorldFoundry in-tree GigaBrain-0.1 runtime emitted a checkpoint-backed CUDA action_trace using converted LeRobot RobotWin stats.vlavla.action_prediction+3Runner verifiedUnified environment3.1112.8open-gigaai/GigaBrain-0-3.5B-BaseHunyuan Game CrafttencentIn-tree Hunyuan GameCraft pipeline is registered; official inference uses the HYGameCraft conda profile and torchrun dispatch.interactive-world-modelimage-to-video+1Runner verifiedDedicated environment3.1012.4022caa869HunyuanVideotencentTencent-Hunyuan GitHub and tencent Hugging Face repos were both reachable.text-to-videoimage-to-videoRunner verifiedDedicated environment3.1012.46204ad6aeHunyuanVideo 1.5tencentAdded as a high-priority current open-weight video model. Native T2V and I2V infer-only `generate.py` paths are now ported in-tree and release-validation verified with local checkpoint assets.text-to-videoimage-to-videoRunner verifiedUnified environment3.1112.89b49404b3HunyuanWorld-MirrorTencent Hunyuan / HY-WorldWorldFoundry exposes framework inference through the in-tree HunyuanMirrorPipeline and vendored inference-only WorldMirror model code.three_dimensionRunner verifiedUnified environment3.1012.8tencent/HunyuanWorld-MirrorHunyuanWorld-VoyagerTencent Hunyuan / HY-WorldExisting in-tree runtime is now exposed through a BaseSynthesis subclass.worldvideo+1Runner verifiedUnified environment3.1112.8ef280b832HY-WorldPlayTencent Hunyuan / HY-WorldExisting in-tree runtime is now exposed through a BaseSynthesis subclass.worldvideo+1Runner verifiedUnified environment3.1112.8tencent/HY-WorldPlayInfinite-WorldMeiGen-AIIn-tree Infinite-World runtime resolves local or Hugging Face checkpoint layouts without relying on an external repository at inference time.worldvideo+1Runner verifiedUnified environment3.1112.8thuml/InfiniteWorldInSpatio-WorldinspatioThe in-tree InSpatio-World pipeline generated and visually validated a 297-frame video through Workspace on 2026-07-10.video-conditioned-world-generationtrajectory-conditioned-video+1Runner verifiedUnified environment3.1112.8inspatio/worldInSpatio-WorldFMInSpatioThe WorldFoundry runner supports the official meta.json demo in the unified environment profile with local WorldFM assets.worldvideo+1Runner verifiedUnified environment3.1112.8Kairos SensenovaEmbodied World ModelUses the in-tree Apache-2.0 official torchrun runtime under worldfoundry/synthesis/visual_generation/kairos/kairos_runtime.text-to-videoimage-to-video+2Runner verifiedDedicated environment3.1012.8kairos-agi/kairos-sensenova-robot-4B-480P-distilledLingBot-WorldLingBotLingBot-World wrapper now only resolves local HFD or explicit checkpoint directories and no longer downloads at runtime.worldcamera_control+1Runner verifiedDedicated environment3.1012.16fc824ffcLoGeRJunyi42In-tree LoGeR point-cloud navigation pipeline is registered for reconstruction and trajectory rendering.3d-reconstructiontrajectory+1Runner verifiedUnified environment3.1112.8Junyi42/LoGeRLyraNVIDIA Spatial Intelligence LabWorldFoundry exposes in-tree Lyra-1 and Lyra-2 pipelines backed by vendored runtime adapters.open generative 3D and 4D world modelsRunner verifiedDedicated environment3.1012.4depth-anything/DA3NESTED-GIANT-LARGE-1.1Matrix-Game 2.0Matrix-GameMatrix-Game 2 already uses an in-tree runtime and no external repo_root dependency was found.worldinteractive+1Runner verifiedUnified environment3.1112.8f1729d99aMatrix-Game 3.0Matrix-GameMatrix-Game 3 runtime is vendored under worldfoundry/synthesis/visual_generation/matrix_game/matrix_game_3_runtime.worldinteractive+1Runner verifiedUnified environment3.1112.8382aa382aMetric3D PriorJUGGHMIntegrated as an independent metric-depth prior at worldfoundry/base_models/three_dimensions/depth/metric3d.monocular-depth-estimationmetric-depth-estimation+1Runner verifiedUnified environment3.1112.8JUGGHM/Metric3DMolmoAct2allenaiWorldFoundry in-tree MolmoAct2 runtime lives under worldfoundry/synthesis/action_generation/molmoact2 and no longer depends on the external molmoact2 checkout at runtime.vlavla.action_prediction+2Runner verifiedUnified environment3.1112.8allenai/MolmoAct2-DROIDMonST3RMonST3R authorsWorldFoundry vendors the MonST3R infer-time components in-tree.geometry estimation in the presence of motionRunner verifiedUnified environment3.1112.8MotionCtrlCamera/Object Motion ControlRuntime code is vendored in-tree; checkpoints remain external assets under the normal hfd/ckpt cache.Runner verifiedUnified environment3.1112.8NeoVerseCASIA and CreateAI authorsWorldFoundry exposes the in-tree NeoVerse pipeline and vendored DiffSynth runtime adapter.4D world modeling from in-the-wild monocular videosRunner verifiedUnified environment3.1112.8Yuppie1204/NeoVerseOpenVLAopenvlaIn-tree OpenVLA HF runtime is registered through the WorldFoundry pipeline binding.vlavla.action_prediction+1Runner verifiedUnified environment3.1011.347a0ec7fcPrior Depth AnythingRain729Integrated as an independent depth-completion prior at worldfoundry/base_models/three_dimensions/depth/priorda.depth-completionmetric-depth-estimation+1Runner verifiedUnified environment3.1112.8Rain729/Prior-Depth-AnythingReCamMasterKling Team / Kuaishou, Zhejiang University, CUHK, and HUST authorsWorldFoundry exposes the in-tree ReCamMaster pipeline, operator, and synthesis runtime under the Kling namespace.camera-controlled video rerenderingRunner verifiedUnified environment3.1112.84f3f73917RoboFlamingorobovlmsRoboFlamingo/OpenFlamingo architecture and inference source are vendored in-tree; public pipeline CUDA action_trace validation passed.vlavla.policy_rollout+2Runner verifiedUnified environment3.8Prepare Onlyrobovlms/RoboFlamingoSCOPEzizhaotongOfficial SCOPE inference source, DiffSynth fork, README, license, and examples are vendored under worldfoundry.synthesis.visual_generation.scope.scope_runtime.interactive-world-modelgame-world-model+2Runner verifiedUnified environment3.1012.8zizhaotong/SCOPEShow-oshowlabRuntime source is vendored in-tree; current WorldFoundry wrapper supports t2i image generation.multimodal-generationtext-to-imageRunner verifiedUnified environment3.1011.3c2c6f548cSkyReels V3SkyworkWorldFoundry registers SkyReels V3 through a model-specific pipeline backed by the in-tree runtime shim.reference-to-videoaudio-guided-video+2Runner verifiedUnified environment3.1112.8Skywork/SkyReels-V3-R2V-14BSolarisnyu-visionxIn-tree inference-only Solaris runtime is packaged under worldfoundry/synthesis/visual_generation/solaris/solaris_runtime.video_generationmulti-agent-world-model+1Runner verifiedUnified environment3.1112.8nyu-visionx/solarisSplatt3RbrandonsmartRuntime code is vendored in-tree under worldfoundry/base_models/three_dimensions/general_3d/splatt3r/splatt3r_runtime; checkpoints remain external assets.3d-reconstructiongaussian-splattingRunner verifiedUnified environment3.1011.3brandonsmart/splatt3r_v1.0StarVLAStarVLAWorldFoundry runtime executed official StarVLA QwenOFT predict_action with local Qwen3-VL-OFT-LIBERO-4in1 checkpoint and Qwen3-VL-4B base VLM on an 80GB CUDA GPU.vlawam+2Runner verifiedUnified environment3.1012.81947454beVchitect-2.0 T2VVchitectUse id vchitect-2-t2v. The in-tree Vchitect runtime emits generated_video when local checkpoints and runtime dependencies are available.text-to-videovideo-generationRunner verifiedUnified environment3.1112.8379368187VGGT-OmegaHuggingfaceVGGT-Omega uses an official-architecture representation runner plus the existing WorldFoundry VGGTResult/save interface.3d-reconstructiongaussian-splatting+1Runner verifiedUnified environment3.1112.8facebook/VGGT-OmegaVMemliguang0115In-tree VMem runtime at worldfoundry/synthesis/visual_generation/vmem/vmem_runtime; no external checkout is required.video-generationmemory+2Runner verifiedUnified environment3.1112.8ac5921080Wan2.1Wan-AIOnly official Wan-Video GitHub and Wan-AI Hugging Face repos are listed.text-to-videoimage-to-videoRunner verifiedUnified environment3.1112.837ec51262Wan2.1 VACEWan-AIRuntime no longer depends on external local Wan source checkouts.video-editingvideo-to-video+2Runner verifiedUnified environment3.1112.8Wan-AI/Wan2.1-VACE-14BWarp-as-Historyyyfz233Official Warp-as-History source, Helios diffusers runtime, Pi3 submodule code, CLI scripts, and demo assets are vendored under worldfoundry.synthesis.visual_generation.warp_as_history.warp_as_history_runtime.image-to-videocamera-controlled-video-generationRunner verifiedDedicated environment3.1012.1yyfz233/warp-as-historyWorldCamKAIST / Adobe Research / MAUM AIWorldCam runtime code is in-tree and the wrapper now supports load_model=False planning without external checkout dependency.worldcamera_control+1Runner verifiedUnified environment3.1112.8worldcam/worldcamYUMEYUME authorsWorldFoundry exposes in-tree YUME and YUME-1.5 pipelines backed by vendored runtime adapters.image/video conditioned interactive world video generationRunner verifiedUnified environment3.1112.8stdstu123/Yume-I2V-540PZeroScopeHuggingfaceCC-BY-NC-4.0 requires benchmark policy review before commercial or automated benchmark use.text-to-videolegacy-unet-diffusionRunner verifiedUnified environment3.1112.8cerspense/zeroscope_v2_576wAction Chunking TransformertonyzhaozhThe ACT policy, DETR-VAE, transformer, ResNet backbone, preprocessing, and action-chunk aggregation execute from the flattened in-tree package.action_chunking_policyrobot_policy+2IntegratedDedicated environment3.10Cu118 Or NewerAlayaWorldLTX-2.3 World ModelsThe runtime reuses WorldFoundry's existing LTX-2.3 Transformer, VAE, Gemma connector, RoPE, patchifier, attention dispatcher, and distributed helpers.image-to-videocamera-controlled-video+2IntegratedUnified environment3.1112.8e3f1adebeAllegrorhymes-aiGitHub verification succeeded after retry; the first attempt hit a transient TLS error.text-to-videoimage-to-videoIntegratedUnified environment3.1112.8c1b9207bbATI-Wan2.1-14BCamera-Control VideoOnly ATI's official inference delta is vendored; the unchanged Wan2.1 implementation is reused from worldfoundry/base_models.camera-controlled-videoimage-to-videoIntegratedUnified environment3.1112.8bytedance-research/ATI

What a recipe records

Each detail page is assembled from the repository manifests rather than a hand-maintained marketing table. A recipe keeps these claims separate:

RecordWhat it tells you
CatalogStable model ID, tasks, official sources, aliases, and integration status.
Runtime profileInput contract, artifact contract, backend stage, and runtime readiness.
EnvironmentPython, CUDA tier, pinned packages, validation imports, and dedicated vs. unified routing.
Pipeline bindingThe runner and concrete pipeline target used by WorldFoundry.
EvidenceNative-demo and WorldFoundry-runner parity; a catalog entry alone is not proof of a successful GPU run.

Unknown values remain Not recorded. WorldFoundry does not turn a catalog entry into a stronger “supported” claim without runtime or evidence records.

Common commands

# Inspect the complete catalog manifest.
worldfoundry-eval zoo model-show \
  --model-id <model-id> \
  --include-manifest \
  --json

# Resolve checkpoints, credentials, and local asset blockers without downloading.
worldfoundry-eval zoo model-download \
  --model-id <model-id> \
  --check-local \
  --json

# Resolve and install the environment manifest for one runtime profile.
bash scripts/setup/model_env_install.sh --model <model-id>

For the full request-file and artifact flow, continue to Run inference. For environment routing policy, see Environment reference.