WorldFoundry
English中文

World models · video_generation · multi-agent-world-model · interactive-video-generation

Solaris

nyu-visionx

In-tree inference-only Solaris runtime is packaged under worldfoundry/synthesis/visual_generation/solaris/solaris_runtime.

Runner verifiedUnified environmentsolaris

Build your run

Choose a recorded variant, then copy the exact setup or inspection command.

worldfoundry.pipeline
Taskvideo_generation
Environmentworldfoundry-unified-cu128
DeviceCUDA 12.8
worldfoundry-eval evaluate \
  --mode model \
  --model-id solaris \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/solaris \
  --metric artifact_count \
  --json
01

Compatibility & versions

Manifest-backed recipe

Integration
integrated
Runner evidence
verified
Environment
worldfoundry-unified-cu128
Python
3.11
CUDA
CUDA 12.8
PyTorch
torch
Source revision
—
Checkpoint revision
92424fb882be0056f5dbf223770769d2ebdf306e
Runtime profile
solaris
Pipeline binding
solaris
Runner
worldfoundry.pipeline
Pipeline target
worldfoundry.pipelines.solaris.pipeline_solaris:SolarisPipeline
Backend stage
in_tree_official_runtime
Runtime status
checkpoint_and_dataset_required
Driver status
compatible_unified_default
Environment kind
Unified environment
02

Install environment

The environment resolver reads the recorded profile and chooses the unified or dedicated environment shown here.

bash scripts/setup/model_env_install.sh --model solaris
Package constraints 15
  • torch
  • torchvision
  • jax[cuda12]
  • flax
  • orbax-checkpoint
  • hydra-core
  • omegaconf
  • opencv-python
  • imageio
  • imageio-ffmpeg
  • pillow
  • numpy
  • scipy
  • scikit-learn
  • tqdm
Conda packages 3
  • python=3.11
  • pip
  • ffmpeg
03

Checkpoints & assets

Run the local check before allocating compute. Gated, private, and license fields below come directly from the checkpoint manifest.

worldfoundry-eval zoo model-download --model-id solaris --check-local --json
nyu-visionx/solaris
Revision
—
License
—
Gated
—
Private
—
nyu-visionx/solaris
Revision
92424fb882be0056f5dbf223770769d2ebdf306e
License
—
Gated
—
Private
—
04

Launch & outputs

The generated command uses the shared evaluation boundary and writes durable result manifests and artifacts.

worldfoundry-eval evaluate \
  --mode model \
  --model-id solaris \
  --model-runner worldfoundry:pipeline \
  --model-manifest-dir worldfoundry/data/models/catalog \
  --requests-path tmp/requests.jsonl \
  --output-dir tmp/model_eval/solaris \
  --metric artifact_count \
  --json

Input contract

FieldRecorded contract
promptOptional
imageOptional
videoRequired
actionsmulti_agent_trajectory

Artifact contract

Artifact kindFilename / path
generated_videosolaris.mp4
05

Evidence & sources

Catalog integration, native-demo parity, and runner parity are independent records.

Integration
integrated
Runner evidence
verified
Native demo evidence
Not recorded
Validation imports
torch, torchvision, jax, flax, orbax.checkpoint, hydra, omegaconf, cv2, worldfoundry.synthesis.visual_generation.solaris
Recipe provenance
worldfoundry/data/models/catalog/world_models/solaris.yamlProjecthttps://solaris-wm.github.io/Paperhttps://arxiv.org/abs/2602.22208GitHubhttps://github.com/solaris-wm/solarisHugging Facehttps://huggingface.co/nyu-visionx/solaris