Instructions to use Plaguekind/ltx2.3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LTX-2
How to use Plaguekind/ltx2.3 with LTX-2:
# Install the LTX-2 pipelines git clone https://github.com/Lightricks/LTX-2.git cd LTX-2 uv sync --extra natten
# Download weights from this repo # Substitute filenames from this repo's "Files and versions" if they differ hf download Plaguekind/ltx2.3 \ diffusion_models/<distilled-transformer>.safetensors \ text_encoders/gemma4-12b-with-proj-ltx-2.5-bf16.safetensors \ vae/<video-vae>.safetensors \ vae/<audio-vae>.safetensors \ latent_upscale_models/<spatial-upsampler>.safetensors \ latent_upscale_models/<temporal-upsampler>.safetensors \ --local-dir models/ltx2.3 # DFR requires the detailing IC-LoRA (separate repo; strength is fixed at 0.5) hf download Lightricks/LTX-2.5-22b-IC-LoRA-Pixel-Spatial-Upscaler --local-dir models/LTX-2.5-22b-IC-LoRA-Pixel-Spatial-Upscaler# Distilled LTX-2.5 pipeline (fast) uv run python -m ltx_pipelines.distilled \ --transformer-path models/ltx2.3/diffusion_models/<distilled-transformer>.safetensors \ --text-encoder-path models/ltx2.3/text_encoders/gemma4-12b-with-proj-ltx-2.5-bf16.safetensors \ --video-vae-path models/ltx2.3/vae/<video-vae>.safetensors \ --audio-vae-path models/ltx2.3/vae/<audio-vae>.safetensors \ --spatial-upsampler-path models/ltx2.3/latent_upscale_models/<spatial-upsampler>.safetensors \ --num-frames 121 \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8# DFR pipeline (higher detail fidelity; optional temporal 2x/4x) uv run python -m ltx_pipelines.dfr_pipeline \ --transformer-path models/ltx2.3/diffusion_models/<distilled-transformer>.safetensors \ --text-encoder-path models/ltx2.3/text_encoders/gemma4-12b-with-proj-ltx-2.5-bf16.safetensors \ --video-vae-path models/ltx2.3/vae/<video-vae>.safetensors \ --audio-vae-path models/ltx2.3/vae/<audio-vae>.safetensors \ --spatial-upsampler-path models/ltx2.3/latent_upscale_models/<spatial-upsampler>.safetensors \ --temporal-upsampler-path models/ltx2.3/latent_upscale_models/<temporal-upsampler>.safetensors \ --detailing-lora models/LTX-2.5-22b-IC-LoRA-Pixel-Spatial-Upscaler/ltx-2.5-22b-ic-lora-pixel-spatial-upscaler-x2-1.0.safetensors \ --spatial-upscalings 1 \ --temporal-upscalings 1 \ --height 1088 \ --width 1920 \ --num-frames 121 \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For 4K: --spatial-upscalings 2 --width 3840 --height 2176 # For image-to-video, add: --image path/to/image.jpg 0 0.8 - Notebooks
- Google Colab
- Kaggle
Pruna vae error
#2
by fishmann-g - opened
ComfyUI Error Report
Error Details
- Node ID: 5310:5222
- Node Type: VAELoader
- Exception Type: RuntimeError
- Exception Message: RuntimeError: Error(s) in loading state_dict for VideoVAE:
size mismatch for decoder.conv_in.conv.weight: copying a param with shape torch.Size([1024, 128, 3, 3, 3]) from checkpoint, the shape in current model is torch.Size([2048, 128, 3, 3, 3]).
size mismatch for decoder.conv_in.conv.bias: copying a param with shape torch.Size([1024]) from checkpoint, the shape in current model is torch.Size([2048]).
size mismatch for decoder.up_blocks.0.res_blocks.0.conv1.conv.weight: copying a param with shape torch.Size([1024, 1024, 3, 3, 3]) from checkpoint, the shape in current model is torch.Size([2048, 2048, 3, 3, 3]).
size mismatch for decoder.up_blocks.0.res_blocks.0.conv1.conv.bias: copying a param with shape torch.Size([1024]) from checkpoint, the shape in current model is torch.Size([2048]).
<....>
fishmann-g changed discussion title from Prune error to Pruna vae error
ComfyUI Error Report
Error Details
- Node ID: 5310:5222
- Node Type: VAELoader
- Exception Type: RuntimeError
- Exception Message: RuntimeError: Error(s) in loading state_dict for VideoVAE:
size mismatch for decoder.conv_in.conv.weight: copying a param with shape torch.Size([1024, 128, 3, 3, 3]) from checkpoint, the shape in current model is torch.Size([2048, 128, 3, 3, 3]).
size mismatch for decoder.conv_in.conv.bias: copying a param with shape torch.Size([1024]) from checkpoint, the shape in current model is torch.Size([2048]).
size mismatch for decoder.up_blocks.0.res_blocks.0.conv1.conv.weight: copying a param with shape torch.Size([1024, 1024, 3, 3, 3]) from checkpoint, the shape in current model is torch.Size([2048, 2048, 3, 3, 3]).
size mismatch for decoder.up_blocks.0.res_blocks.0.conv1.conv.bias: copying a param with shape torch.Size([1024]) from checkpoint, the shape in current model is torch.Size([2048]).
<....>
You need to update comfyui to use pruna. Support was just added.
ComfyUI Error Report
Error Details
- Node ID: 5310:5222
- Node Type: VAELoader
- Exception Type: RuntimeError
- Exception Message: RuntimeError: Error(s) in loading state_dict for VideoVAE:
size mismatch for decoder.conv_in.conv.weight: copying a param with shape torch.Size([1024, 128, 3, 3, 3]) from checkpoint, the shape in current model is torch.Size([2048, 128, 3, 3, 3]).
size mismatch for decoder.conv_in.conv.bias: copying a param with shape torch.Size([1024]) from checkpoint, the shape in current model is torch.Size([2048]).
size mismatch for decoder.up_blocks.0.res_blocks.0.conv1.conv.weight: copying a param with shape torch.Size([1024, 1024, 3, 3, 3]) from checkpoint, the shape in current model is torch.Size([2048, 2048, 3, 3, 3]).
size mismatch for decoder.up_blocks.0.res_blocks.0.conv1.conv.bias: copying a param with shape torch.Size([1024]) from checkpoint, the shape in current model is torch.Size([2048]).
<....>You need to update comfyui to use pruna. Support was just added.
I've already updated to the latest version, 0.29.2, but I'm still getting the same error—it's completely unusable.